Posted Oct 11, 2026

Software Engineer

Apply Now
We're hiring on behalf of a Haystack partner! The Role Design, implement, test, deploy, and maintain innovative software solutions for a next-generation compiler. Optimize the performance of complex machine learning models on custom AI hardware. Collaborate with chip architects, runtime engineers, and ML application teams to ensure seamless model deployment. Work with open-source software tools to pioneer advanced ML workload optimization. Develop new features to enhance the performance and usability of the compiler for global developers. Solve challenging compiler optimization problems for various ML model families, including large language models and diffusion models. What You'll Need 3+ years of professional software development experience. 2+ years of experience in designing or architecting new and existing systems. Proficiency in object-oriented programming languages such as C++ or Java. Experience with compiler design or building ML models using ML frameworks on accelerators is preferred. Familiarity with technologies like OpenXLA, StableHLO, or MLIR is a plus. Experience with modern build systems like Bazel or CMake is beneficial. What's On Offer Competitive annual salary ($165,200 - $223,600) plus potential for sign-on bonuses and stock units. Comprehensive benefits package including health insurance, 401(k) matching, paid time off, and parental leave. Opportunity to work on cutting-edge AI hardware and software solutions. A collaborative and supportive team environment with a focus on mentorship and career growth. Apply via Haystack today!