Note: The job is a remote job and is open to candidates in USA. Netflix is an entertainment company developing global streaming experiences through creativity and technology. The Staff ML Software Engineer will own observability, cost, reliability, and platform subsystems supporting next-generation AI/ML workflows, while helping modernize the AIMS machine learning stack. The role includes designing scalable infrastructure, improving operational excellence, and coordinating cross-functional architecture and migration efforts.
Responsibilities
- Design, build, and operate subsystems for observability, evaluation, and tooling that Netflix's next generation ML architecture depends on
- Prove the subsystems on AIMS's current operations first, including anomaly detection, root cause analysis, and operational automation
- Design and build observability systems, including observability primitives built for next generation ML systems rather than just classical ML, that give AIMS ML practitioners deep visibility into model behavior, training pipeline health, serving latency, and data quality, making issues detectable and diagnosable before they become incidents
- Identify and drive cost optimization across AIMS training and serving infrastructure, developing frameworks and tooling, increasingly automated, that make compute efficiency a first class concern rather than an afterthought
- Architect reliability improvements across the AIMS AI/ML stack, reducing toil, improving on-call ergonomics, and setting the standard for operational excellence across the org
- Contribute to the target architecture and migration path for the modernized AIMS AI/ML stack, coordinating with the teams driving that effort
- Continuously evaluate emerging infrastructure patterns, model paradigms, and platform capabilities, and translate them into a forward looking roadmap before they become urgent migrations
Skills
- Significant experience designing, building, and operating production AI/ML systems at scale, including training pipelines and familiarity with model serving and online inference under high traffic
- Hands-on experience building subsystems that support advanced agentic architectures, such as memory, trace, eval, and replay pipelines, or orchestration and routing layers for complex model systems. This means you've built the orchestration or control logic itself, not just called an API from a script
- Strong software engineering fundamentals with deep Python expertise and working proficiency in at least one JVM language (Scala or Java)
- Proven track record of improving AI/ML system reliability, reducing infrastructure costs, and improving operational scalability
- Experience building observability and monitoring systems for AI/ML workloads; you understand what good visibility looks like across training, serving, and data pipelines
- Strong distributed systems background, including batch processing at scale and real time serving infrastructure
- Collaboration with partner teams to drive technical programs across functions, setting direction, managing dependencies, and building consensus without formal authority
- High technical judgment: able to identify common patterns, build reusable frameworks, and make pragmatic calls on what to invest in, what to defer, and what to leave alone
- Comfortable operating without full information; you can scope a problem, define an approach, and adjust course as you learn more
- Familiarity with LLM evaluation, trace, or replay tooling, such as LLM observability platforms or debugging frameworks for complex model systems
- Familiarity with modern AI/ML infrastructure patterns including feature stores, model serving platforms, and experiment frameworks
- Hands on experience migrating production AI/ML systems across technology generations
- Applied experience in personalization domains such as recommendation systems, search, or discovery
Benefits
- Health Plans
- Mental Health support
- A 401(k) Retirement Plan with employer match
- Stock Option Program
- Disability Programs
- Health Savings and Flexible Spending Accounts
- Family-forming benefits
- Life and Serious Injury Benefits
- Paid leave of absence programs
- Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off.
- Full-time salaried employees are immediately entitled to flexible time off.
Company Overview
Company H1B Sponsorship