Note: The job is a remote job and is open to candidates in USA. LABUR is partnering with a client to hire a Senior AI Platform & Production Engineer to build, operate, and improve shared Enterprise AI platform capabilities and production AI systems. The role focuses on LLM platform services, secure integrations, observability, reliability, incident response, and optimization of AI applications for quality, latency, scalability, and cost.
Responsibilities
- Build, operate, and evolve the shared Enterprise AI platform alongside the production AI applications it supports
- Develop and enhance the LLM API Gateway, developer tooling, onboarding workflows, and reusable platform services
- Design and maintain secure MCP and tool integration infrastructure for agentic AI systems
- Implement and harden authentication, authorization, policy enforcement, and audit controls across the platform
- Establish and maintain production-grade observability, including tracing, monitoring, alerting, debugging, and operational dashboards
- Lead production reliability efforts such as KTLO support, incident response, root-cause analysis, and remediation
- Optimize AI systems for quality, reliability, latency, scalability, and cost while driving incremental enhancements to deployed applications
- Collaborate with application engineers, platform teams, and security stakeholders to define standards and enable reliable AI development and operations
Skills
- Strong production software engineering skills in Python and/or TypeScript/Node.js with experience designing backend APIs and distributed systems
- Hands-on experience with AWS, Kubernetes/EKS, and CI/CD pipelines
- Proven track record building, operating, and optimizing LLM or AI applications in production for reliability, latency, and cost
- Deep understanding of authentication, authorization, security, policy enforcement, and audit controls
- Experience with observability tooling (tracing, monitoring, alerting, debugging) and incident response, with a demonstrated history of evolving production systems post-launch
- Experience with React or full-stack application development is a plus
- Strong collaboration, documentation, and communication skills expected
- Familiarity with MCP, tool integrations, agentic-system architectures, or shared AI platform and gateway development (preferred)
Company Overview