Note: The job is a remote job and is open to candidates in USA. AMC Health builds and operates production AI voice agents and machine learning and LLM pipelines for regulated healthcare settings. The Senior Software Engineer will develop and operate real-time voice systems, LLM control and evaluation pipelines, traditional machine learning workflows, and secure cloud infrastructure in production.
Responsibilities
- Ship and debug code on a live, real-time voice pipeline where latency and correctness are user-facing
- Design control systems around LLMs: guardrails, budgets, watchdogs, safe fallbacks
- Build and operate LLM evaluation and batch-analysis pipelines
- Own traditional ML workflows from data to scheduled production inference
- Trace production issues from a metric anomaly to root cause, including building the evidence when the cause is a vendor
Skills
- 7+ years building and operating production backend systems, with strong general-purpose programming skills (we work primarily in Python)
- Experience running distributed systems in the cloud; comfortable debugging from telemetry to root cause
- Hands-on production experience with LLMs or generative AI (any provider or framework), plus the judgment to know when not to use a model
- Working fluency across the traditional machine learning lifecycle (you productionize; you do not need to publish)
- Disciplined in a regulated environment: small, reviewable changes and careful handling of sensitive data
- Real-time media or telephony experience
- Front-end / full-stack ability
- ML pipeline experience, vector search, or embeddings
- Fluency with AI coding assistants (our workflows assume them, with human accountability for every change)
- A resume is welcome but optional; the two items above are required
Benefits
- Remote (US) work arrangement
Company Overview