Note: The job is a remote job and is open to candidates in USA. Xsolis is an AI-driven healthcare technology company focused on reducing administrative waste and enabling smarter collaboration between healthcare providers and payers. The Manager, AI Operations will lead the reliability, performance, observability, security, and production support of traditional ML, Generative AI, and Agentic AI systems while managing an AI operations team and advancing ethical AI practices.
Responsibilities
- Own deployment support, monitoring, and day-to-day reliability of AI systems in production across traditional ML, GenAI, and agentic AI
- Lead incident response and root-cause troubleshooting for AI/ML services, including agentic systems with autonomous or tool-using behavior
- Partner with MLOps, Cloud Engineering, and Infrastructure teams to build and maintain robust deployment pipelines
- Build and maintain observability practices (drift detection, latency, uptime, accuracy decay, agent action-level tracing) across all AI system types
- Define and track production health metrics; flag performance degradation and route it to the appropriate build team for remediation
- Establish dashboards and alerting that give the organization real-time visibility into AI system health
- Serve as the primary connection point between AI systems and enterprise Security, Infrastructure, and IT teams — ensuring production AI meets security and access-control standards
- Support the AI Governance function by instrumenting and operating the fairness, safety, and bias-monitoring metrics it defines (governance sets the requirement; this team builds and runs the instrumentation)
- Coordinate handoffs from the AI Build team into production, including a defined production-readiness review before launch
- Lead and grow a small, high-leverage production support and observability team
- Set clear priorities across production support and monitoring workstreams and manage team capacity as the AI portfolio scales
- Mentor team members and build a strong operational and on-call culture
- Lead cross functional team to assess what is required in design, dev and run-time across our entire AI stack to establish “Ethical AI” best practices and SOPs for Xsolis
- Ensure the Cost of AI Dev and Run-time is clear and targeted for specific annual reduction YoY
- Work with Governance and Compliance team to set standards that are measurable, monitored and auditable through the observability platform across Traditional, Generative and Agentic AI
Skills
- 7+ years of experience in AI/ML operations, MLOps or production data science, including 2+ years of people or team leadership
- Hands-on experience operating traditional ML and GenAI systems in production (deployment, monitoring, incident response)
- Strong understanding of observability practices — drift detection, model performance monitoring, logging, alerting — at scale
- Experience partnering with Security and Infrastructure teams on production risk and access controls
- Excellent communication skills, with the ability to translate operational risk into terms both technical and business stakeholders understand
- This role requires travel to our home offices in TN for training
- Position requires little to moderate physical activity. Mostly sedentary work exerting up to 10 pounds of force occasionally or a negligible amount of force to lift, carry, push, pull, or otherwise move objects. Work involves sitting most of the time, but may involve walking or standing for brief periods of time. No significant stooping is usually required
- Applicants must already be authorized to work in the United States on a full-time, permanent basis without the need for current or future sponsorship
- Prior experience in healthcare, health tech, payer, or provider organizations
- Experience operating agentic AI systems specifically (tool-use monitoring, guardrails, action-level tracing)
- Familiarity with MLOps/observability tooling (Datadog, AWS Cloud Watch, LangFuse) and native AWS cloud platform capabilities
- Experience working alongside a dedicated AI Governance function, with clear boundaries between operational monitoring and governance policy
Benefits
- Medical/Dental/Vision insurance
- 401K company match
- Flexible Paid Time Off
- Paid parental leave
- HSA/FSA options
- Educational reimbursement program
- Employer-paid EAP & Mental Health services
Company Overview