Note: The job is a remote job and is open to candidates in USA. Modular, a Qualcomm company, is building an AI platform and expanding its software stack to new hardware platforms. The Engineering Manager will lead the Hardware Bringup team, overseeing accelerator enablement across the Modular stack, setting technical direction, managing vendor partnerships and Statements of Work, and delivering hardware platform projects.
Responsibilities
- Lead, mentor, and grow a 2 to 7 people team of mixed skillset (compiler, kernel, and runtime engineers) focused on bringing up new accelerator architectures across the Modular stack
- Stay hands-on: participate directly in design reviews, contribute to architecture and prototypes, write and review code for non-trivial portions of the stack (Mojo kernels, MLIR passes, runtime integration), and strive to unblock the hardest technical issues on the team
- Support end-to-end delivery of one or more hardware platform enablement efforts, from initial viability and dev-environment bring-up through merged compiler integration, kernel development, MAX serving, and production-quality model deployment
- Contribute to Statement of Work (SOW) scoping, milestone definition, and acceptance criteria with hardware partners, including translating engineering plans into contractual milestones, negotiating timelines, and managing delivery against commercial commitments
- Partner with Kernels, Graph Compiler, MAX, and Cloud teams to align roadmaps, resolve cross-team dependencies, and produce credible FTE plans and forecasts for executive review
- In collaboration with Head of Mojo, hire to a high bar: define the engineering profile, run interview loops, calibrate the team, and close senior candidates
- Foster a write-things-down, demo-driven engineering culture; ensure the team shares findings on new architectures (ISAs, memory hierarchies, vendor toolchains) through write-ups, internal demos, and onsites
Skills
- 7+ years of industry experience in compiler engineering, high-performance computing, kernel development, or related domains, with 2+ years managing engineers (strong IC-to-manager transitions welcome)
- Strong technical foundation in compilers, systems software, or accelerator programming
- Sufficient to be hands-on with the team's codebase, lead architecture discussions, and credibly review designs in MLIR/LLVM, kernel codegen, or runtime systems
- Proficiency in C++ and direct experience working in complex, multi-component software systems
- Hands-on experience with at least one heterogeneous programming model (CUDA, SYCL, OpenCL, or similar), as a contributor rather than only a user
- Demonstrated track record of delivering multi-quarter technical roadmaps with external dependencies, including managing scope, risk, and external commitments
- Experience working directly with hardware vendor engineering teams joint bring-up efforts, partner escalations, or vendor-facing technical leadership
- Experience scoping or negotiating engineering deliverables under formal agreements (SOWs, joint engineering plans, or equivalent contractual frameworks)
- Strong written communication
- Experience leading bring-up on non-GPU accelerators (DSPs, NPUs, custom ASICs, or other novel architectures)
- Familiarity with MLIR or LLVM compiler infrastructure at a contributor level
- Background in AI compilers, kernel libraries, or GPU DSLs/DSELs such as Triton, CUTLASS, or CuTe
- Familiarity with how AI operators are implemented at a low level — custom kernels, fused operators, or framework-level integration (e.g., PyTorch at the C++ layer)
- Experience drafting, negotiating, or executing engineering SOWs with hardware vendors or cloud partners
- Exposure to model serving or inference optimization workflows at production scale
Benefits
- Your benefits package may include comprehensive healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities. Specific benefit packages may vary based on your location.
- RSU grants.
- Annual target bonus.
- Equity, with equity making up a significant portion of total compensation.
- Regular team onsites and local meetups in Los Altos, CA as well as different cities.
- Remote work from home.
Company Overview
Company H1B Sponsorship