Note: The job is a remote job and is open to candidates in USA. Cantina Labs is a social AI company developing real-time models for expression, personality, and realism. The Machine Learning Engineer, Ops will build and scale inference infrastructure for generative audio models, optimizing reliable, low-latency, and cost-efficient serving across streaming and batch applications.
Responsibilities
- Design and maintain inference infrastructure for generative audio model architectures
- Implement and manage high-performance inference engines
- Orchestrate service deployments using Kubernetes (K8S), implementing advanced autoscaling paradigms to handle varying traffic loads efficiently
- Develop and automate robust CI/CD pipelines to streamline the testing and deployment of model artifacts and inference configurations
- Monitor production systems, establishing observability practices to track latency, resource utilization, and overall model performance
- Collaborate closely with research teams to optimize model serving paths and evaluate various inference strategies
- Optimize inference performance for both streaming and batch applications
Skills
- Deep understanding of modern audio model architectures (e.g., TTS, ASR) and their specific inference requirements
- Strong hands-on experience with Kubernetes (K8S), container orchestration, and implementing autoscaling strategies for production workloads
- Solid background in MLOps, including CI/CD automation and managing scalable cloud infrastructure
- Proficiency in software engineering principles and experience with Python or Go for infrastructure tooling and backend services
- Experience with GPU-accelerated inference and performance profiling techniques
- Familiarity with high-performance inference engines (e.g., Triton Inference Server, vLLM-Omni) is a plus
Benefits
- Generous company equity
- Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
- 42 days of paid time off, including 15 PTO days, 10 sick days, 15 company holidays, and 2 floating holidays
- Generous parental leave & fertility support
- 401(k) retirement savings plan
- Lifestyle spending account – $500/month to use however you’d like
- Complimentary lunch and snacks for in-office employees
- One Medical membership
Company Overview
Company H1B Sponsorship