Note: The job is a remote job and is open to candidates in USA. Amazon Web Services (AWS) is a cloud platform provider developing software and hardware solutions for deep learning and cloud computing. The Senior Machine Learning Compiler Engineer will build and optimize the AWS Neuron compiler for ML models running on Inferentia and Trainium accelerators, while collaborating with chip, runtime, science, and ML application teams. The role also involves compiler optimization, verification, defect resolution, open-source engagement, and delivering features for AWS customers.
Responsibilities
- You will design, implement, test, deploy and maintain innovative software solutions to transform Neuron compiler’s performance, stability and user-interface
- You will work side by side with chip architects, runtime/OS engineers, scientists and ML Apps teams to seamlessly deploy cutting edge ML models from our customers on AWS accelerators with optimal cost/performance benefits
- You will have opportunity to become front-face of Neuron Compiler to work with open-source communities (e.g., StableHLO, OpenXLA, MLIR) and influence industry wide partners to pioneer optimizing cutting-edge ML workloads on AWS software and hardware
- You will also work on building innovative features that will deliver best possible experiences for our customers – developers across the globe
- As you design and code solutions to help our team drive efficiencies in compiler architecture, you’ll create compiler optimization and verification passes, build features surface features and peculiarities of AWS accelerators to developers, implement tools to analyze numerical errors, and resolve the root cause of compiler defects
- You’ll also participate in design discussions, code review, and communicate with internal (other Neuron SDK and Amazon wide teams) and external stakeholders (open-source communities and respond to Neuron compiler related questions in open forums, e.g. GitHub)
- Lastly, work in a startup-like development environment, where you’re always working on the most important stuff
Skills
- • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- • 2+ years of experience in developing compiler features and optimizations
- • Proficiency with 1 or more of the following programming languages: C++ (preferred), C, Python
- Experience in object-oriented languages like C++/Java is a must, experience with compilers or building ML models using ML frameworks on accelerators (e.g., GPUs) is preferred but not required
- • Master or PhD degree in computer science or equivalent
- • Proficiency with resource management, scheduling, code generation, and compute graph optimization
- • Experience optimizing Tensorflow, PyTorch or JAX deep learning models
- • Experience with multiple toolchains and Instruction Set Architectures
Benefits
- Sign-on payments
- Restricted stock units (RSUs)
- Health insurance including medical, dental, vision, prescription, Basic Life & AD&D insurance, option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, and Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off
- Parental leave
- Knowledge-sharing, mentorship and other career-advancing resources
- Flexibility as part of the working culture
- Ongoing events and learning experiences
- Employee-led affinity groups that foster a culture of inclusion
Company Overview
Company H1B Sponsorship