Note: The job is a remote job and is open to candidates in USA. The Mutual Group is seeking a Lead AI Infrastructure Operations Engineer to enable, operate, and continuously improve the infrastructure and operational capabilities supporting production AI solutions. The role coordinates infrastructure services, environments, observability, security, capacity, production readiness, incident resolution, and AI operational governance across internal teams and managed-services providers.
Responsibilities
- Partner with AI engineering, application, data, security, architecture, and platform teams to understand the infrastructure and operational needs of new AI use cases
- Translate AI solution designs into requirements for environments, compute, storage, networking, connectivity, identity, security, observability, capacity, and supporting cloud services
- In Collaboration with other Infrastructure resources and managed service provider, coordinate infrastructure provisioning, configuration, access, and changes with TMG’s AWS managed-services provider and other technology partners
- Support operational readiness for AI solutions transitioning into production
- Identify infrastructure dependencies, constraints, risks, costs, and lead times early in the delivery lifecycle
- Establish reusable infrastructure patterns, operational standards, dashboards, runbooks, and production-readiness requirements across AI use cases
- Validate that environments and supporting services are appropriately configured, monitored, secured, scalable, and ready for production use
- Implement new cloud functionality requirements in collaboration with architecture and AI engineering within approved architecture and guardrails
- Follow and enforce established security, compliance, and operational controls across AI platforms and infrastructure
- Work with managed services to Implement and maintain observability, logging, tracing, monitoring, dashboards, and alerting for production AI applications
- Define and track operational metrics covering AI quality, reliability, latency, cost, utilization, adoption, and business outcomes
- Work with AI engineering team to diagnose production issues across AI applications, models, prompts, retrieval systems, data, integrations, and supporting infrastructure
- Support root-cause analysis and coordinate resolution with AI engineers, application teams, platform teams, and managed-services providers
- Support AI-related incident management, problem management, operational reviews, release validation, and production-readiness activities
- Create and maintain service-health dashboards, runbooks, troubleshooting guidance, support procedures, and escalation paths
- Define and track service health indicators, SLIs, SLOs, and operational KPIs for production AI solutions
- Use telemetry, evaluations, and production data to validate fixes, releases, configuration changes, and system improvements
- Partner with AI and IT governance team to operationalize applicable controls and monitoring requirements
- Operationalize evaluation processes and support AI Governance team to monitor AI performance, regressions, drift, grounding, retrieval quality, and overall effectiveness
- Support the collection and retention of operational evidence, including model and prompt versions, evaluation results, incidents, exceptions, and corrective actions
- Identify material changes in AI behavior and help ensure they are evaluated, documented, and appropriately addressed
- Analyze trends and proactively identify degradation, drift, capacity constraints, reliability risks, and quality issues before they become production incidents
Skills
- Bachelor's degree in computer science, engineering, information technology, or a related field, or equivalent practical experience
- 8+ years of overall information technology experience, including 5+ years in infrastructure operations, cloud operations, site reliability engineering, DevOps, platform operations, application operations, or production engineering
- Experience supporting cloud-hosted, distributed, data-intensive, or AI-enabled production applications
- Experience implementing and supporting observability, logging, tracing, monitoring, dashboards, alerting, and operational reporting
- Working knowledge of cloud infrastructure, networking, APIs, integrations, identity and access management, security, and data pipelines
- Experience coordinating infrastructure services, changes, dependencies, and issue resolution across internal teams, technology partners, and managed-services providers
- Familiarity with AWS services and capabilities related to monitoring, logging, networking, security, identity, and infrastructure operations
- Experience with automation, CI/CD pipelines, infrastructure-as-code, configuration management, and release-management practices
- Familiarity with AI observability, evaluation, model monitoring, hallucination detection, grounding, retrieval quality, model or data drift, and prompt-related risks
- Familiarity with vector databases, model APIs, AI gateways, prompt-management platforms, or agent orchestration frameworks
- Strong analytical, documentation, communication, and cross-functional collaboration skills, with the ability to manage multiple priorities across concurrent technology initiatives
- Experience operating or supporting LLM, generative AI, machine-learning, RAG, or agent-based applications in production is strongly preferred
- Experience in insurance, financial services, or another regulated industry, along with relevant AWS, cloud, infrastructure, DevOps, SRE, security, or AI certifications, is preferred
Benefits
- Incentive plans for eligible team members
- 401(K) retirement plan that includes a company match of up to 6% of your eligible salary
- Free basic life and AD&D, long-term disability and short-term disability insurance
- Medical, dental and vision plans to meet your unique healthcare needs
- Wellness incentives
- Generous time off program that includes personal, holiday and volunteer paid time off
- Flexible work schedules and hybrid/remote options for eligible positions
- Educational assistance
Company Overview
Company H1B Sponsorship