Note: The job is a remote job and is open to candidates in USA. Protingent is an Award-Winning provider of top-tier Engineering and IT talent, trusted by companies at the forefront of innovation. They are seeking a Backend Engineer, AI (Agent Systems) to own the inference and orchestration layer that powers every AI interaction in the product, building and operating production systems that integrate AI capabilities into user experiences.
Responsibilities
- Build and operate backend systems that serve AI-powered features in production
- Design inference pipelines, orchestration layers, and service boundaries around models
- Own production concerns: monitoring, logging, alerting, and incident response
- Optimize latency and throughput across inference, caching, batching, and streaming
- Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput
- APIs are stable, clear, and support seamless integration with frontend and ML systems
- Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact
- Iterative improvements based on real usage continuously increase system performance and reliability
Skills
- Strong backend engineering fundamentals in production environments
- Experience running high-throughput, low-latency services
- Familiarity with AI inference patterns (LLMs, embeddings, multimodal)
- Comfortable debugging distributed systems under load
- Bias toward shipping and learning from production behavior
- Python
- NodeJs
- Pytorch
- OpenAI / Anthropic / open-source LLMs
- SQL & noSQL
- Kubernetes
- Docker
Company Overview
Company H1B Sponsorship