Note: The job is a remote job and is open to candidates in USA. AMC Health builds and operates production AI voice agents and the machine learning and LLM pipelines that support them in a regulated healthcare setting. The Senior Software Engineer: Applied AI will develop and operate real-time voice systems, LLM control and evaluation pipelines, traditional machine learning workflows, and cloud infrastructure, while debugging production issues and maintaining strict security and privacy standards.
Responsibilities
- Ship and debug code on a live, real-time voice pipeline where latency and correctness are user-facing
- Design control systems around LLMs: guardrails, budgets, watchdogs, safe fallbacks
- Build and operate LLM evaluation and batch-analysis pipelines
- Own traditional ML workflows from data to scheduled production inference
- Trace production issues from a metric anomaly to root cause, including building the evidence when the cause is a vendor
Skills
- 7+ years building and operating production backend systems, with strong general-purpose programming skills (we work primarily in Python)
- Experience running distributed systems in the cloud; comfortable debugging from telemetry to root cause
- Hands-on production experience with LLMs or generative AI (any provider or framework), plus the judgment to know when not to use a model
- Working fluency across the traditional machine learning lifecycle (you productionize; you do not need to publish)
- Disciplined in a regulated environment: small, reviewable changes and careful handling of sensitive data
- This role is open only to US citizens and lawful permanent residents (Green Card holders). We cannot consider candidates who require visa sponsorship now or in the future, and we are unable to make exceptions of any kind
- Real-time media or telephony experience
- Front-end / full-stack ability
- ML pipeline experience, vector search, or embeddings
- Fluency with AI coding assistants (our workflows assume them, with human accountability for every change)
- A resume is welcome but optional; the two items above are required
Benefits
- Remote (US)
- Full-time
Company Overview