Note: The job is a remote job and is open to candidates in USA. Commerce, through BigCommerce, is building conversational AI agents for the B2B commerce lifecycle. The Senior Backend Engineer will design and build agent orchestration, tool integrations, prompts, and evaluation systems, and collaborate across product and engineering to deliver reliable conversational experiences.
Responsibilities
- Design, build, and iterate on AI agents in Go/Python using an orchestrator/sub-agent architecture, covering intent interpretation, delegation, and safe action execution
- Own eval-driven development: build and maintain golden datasets, scorers, and regression suites (Braintrust or similar) for critical quality metrics such as discovery recall and quote accuracy
- Develop and refine prompts, model configurations; treat prompts and model settings as versioned, tested artifacts
- Integrate agents with MCP servers and backend tools, defining safe tool-call contracts, approval flows for write actions, and guardrails against prompt injection and abuse
- Instrument agents with tracing, metrics, and cost tracking; use production signals to drive quality improvements
- Collaborate with product designers and frontend engineers to deliver intuitive, useful conversational experiences
- Quickly build proof-of-concept agents to validate user stories, then harden them to GA quality
- Drive architecture decisions on ambiguous problems and mentor other engineers in agent engineering practices
Skills
- 5+ years of experience in backend or full-stack software development, with hands-on experience building agentic AI/LLM applications
- Strong and proven development skills in any major language (Go/Python/Ruby/PHP)
- Experience working with LLMs (Gemini, Anthropic, OpenAI, etc.) in production systems
- Experience with LLM evaluation: building datasets, defining scorers/metrics, and using eval results to drive iteration
- Strong understanding of prompt engineering, tool/function calling, and agent orchestration patterns
- Deep experience designing and building APIs (gRPC, GraphQL, REST) and integrating data across systems
- Hands-on experience building MCP servers or LLM tool integrations
- Excellent problem-solving skills and ability to work in a fast-paced, exploratory environment
- Strong collaboration and communication skills in cross-functional teams
- Strong preference toward execution and delivery
- Preferred minimum Bachelor's degree in CS, EE, SW, CE, MIS; or equivalent experience
- Experience with agent frameworks (Google ADK, LangChain/LangGraph, Semantic Kernel, or similar)
- Experience with evaluation/observability platforms (Braintrust, LangSmith, or similar)
- Experience with RAG systems and retrieval quality tuning
- Experience with e-commerce platforms or SaaS product development
- Background in conversational AI or natural language processing
Benefits
- Remote-first work arrangement.
- For team members in Austin, Atlanta, and London, optional collaborative workspaces for team gatherings, workshops, and in-person connection.
- This role may be eligible for variable compensation (such as bonus or commission) and equity, in accordance with local policies.
Company Overview
Company H1B Sponsorship