Note: The job is a remote job and is open to candidates in USA. Waymo is an autonomous driving technology company developing the Waymo Driver and autonomous ride-hail services. The Software Quality Operations Specialist supports the safe scaling of autonomous vehicle operations by applying machine learning and generative AI to issue discovery, triage, quality assurance, deployment monitoring, and operational workflows.
Responsibilities
- Support the development of a single, automated, end-to-end machine learning flywheel for the entire Waymo Driver: the core engine for scaling our technology, enabling faster ODD expansion, quicker remediation of driving issues, and a significant reduction in the engineering effort required to maintain and improve the driver
- De-risking New Deployments: Through triage of driving events, issue discovery, and field monitoring, SWQOps provides early warnings and critical insights. This "early intervention in RO issue detection" ensures operational resilience and safety which is critical as Waymo enters multiple new cities and ramps up platforms like W12
- Enabling Market Expansion which will allow our team is deeply integrated into every stage of Waymo's market entry framework, from initial city evaluation (OK2Plan) to scaling operations (OK2Scale). We provide the necessary data analysis, policy development, and quality assurance to unblock critical milestones, preventing slowdowns in market expansion velocity
- Driving Engineering Velocity: By handling the vital work of performance evaluation, issue deep-dives, and data set curation, SWQOps collaborates heavily and allows Waymo's Engineering, SysEng, Simulation, and Data Science teams to focus on their core tasks of developing and improving the Waymo Driver
- Partner with Engineering to design, test, and deploy cutting-edge Machine Learning (ML) and Generative AI (Gen-AI) models and tools to drive step-change improvements in issue discovery & detection, triage efficiency, and quality assurance
- Leverage AI-powered insights and traditional triage signals to proactively identify emerging on-road issue trends, new risk scenarios, and edge cases. Develop and refine data-driven strategies for issue discovery and monitoring, enhanced by ML model outputs
- Be a main link between AI/ML development and operational execution. Define and document new policies, and Standard Operating Procedures (SOPs) that integrate AI tools and insights into daily vendor workflows
- Design and implement quality control processes for both human and AI-generated outputs. Perform meta-quality checks, validate the integrity of vendor work, and provide feedback to improve both human and model performance
- Be the subject matter expert for our Software Quality Operations, working with partners, program lead, and vendor teams to ensure seamless adoption and maximum impact of AI/ML advancements in our quality processes. Be the trusted source for creating and updating technical guidelines, and standard operating procedures for new scopes, platforms, and driving signals
- Provide technical leadership and consultation to partners to enhance our workflows and quality. You'll identify and escalate issues with our tools, providing technical requirements to engineering, and driving user testing to support the development and deployment of new tooling features
Skills
- BS/BA degree or 4 years of relevant work experience in AV Software Quality Operations
- Increased competency in supporting all phases of the machine learning development lifecycle, from data preparation and training to validation, deployment, and monitoring
- Experience with ML testing and validation, including dataset quality assurance, bias detection, edge-case scenario testing, and performance evaluation using statistical metrics
- Implement new concepts and use proprietary tools
- Experience with driving rules and regulations
- Problem solve and make data-informed decisions
- Collaborate with many individuals in a diverse work environment
- This is a remote position
- US-Remote includes employees working from their primary residence in certain locations only, such as Arizona, California, Colorado, Connecticut, DC, Florida, Georgia, Hawaii, Idaho, Illinois, Indiana, Maine, Maryland, Massachusetts, Michigan, Minnesota, Missouri, New Hampshire, Nebraska, New Jersey, New York, North Carolina, Ohio, Oregon, Pennsylvania, South Carolina, Tennessee, Texas, Utah, Virginia, Washington, and Wisconsin. This list may not be complete or accurate, and candidates should speak with their recruiter about their specific location for remote work
- Demonstrated execution with an ability to improve outcomes
- Experience working with offshore teams / multiple local operations hubs
- Basic SQL querying
- Competency in LLM / transformer models, or ML for robotics domain experience
- A greater focus on using your subject matter expertise for results analysis and direct customer consultation in the development of new and improved solutions
- Basic skills in task planning
Benefits
- Health, dental, vision, life, disability insurance
- Retirement Benefits: 401(k) with company match
- Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
- Sick Time: 40 hours/year (statutory, where applicable); 5 days/event (discretionary)
- Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
- Baby Bonding Leave: 18 weeks
- Holidays: 13 paid days per year
- This is a remote position.
- Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Company Overview
Company H1B Sponsorship