[Remote] Software Engineer II and/or Senior Software Engineer - AI Compilers

Note: The job is a remote job and is open to candidates in USA. Microsoft's AI Frameworks team develops AI software used to train and deploy advanced AI models, including AI compilers for next-generation supercomputers and the Maia-200 AI accelerator. The role focuses on developing compiler features, code generation techniques, AI software, programming abstractions, and workload optimizations while collaborating across hardware, machine learning, research, and platform disciplines.

Responsibilities

• Invent and implement innovative compiler features and advanced optimization passes, leveraging tools such as LLVM, MLIR, Torch Dynamo, and Triton
• Develop code generation techniques for new hardware platforms
• Design and develop cutting edge AI software in C++ and Python
• Optimize AI workloads
• Design new programming abstractions for AI
• Collaborate broadly across multiple disciplines from hardware architects to ML developers
• Identify requirements, plan and design solutions, estimate effort, and schedule deliverables
• Help establish and drive the adoption of outstanding coding standards and patterns and help enhance our inclusive engineering culture
• Embody Microsoft's culture and values

Skills

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience
• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience
• Or PhD in Computer Science or related technical field AND 4+ years technical software engineering experience
• 3+ years experience programming in C/C++
• 1+ years experience with optimized systems‑level programming
• Experience building compilers, using compiler frameworks like LLVM/MLIR, OR experience optimizing AI/numerical workloads, OR experience in numerical high-performance computing
• Experience with AI frameworks, AI inference systems, AI kernel development, and AI workload optimization

Benefits

• Certain roles may be eligible for benefits and other compensation.

Company Overview

Microsoft provides computer software, consumer electronics, cloud computing platforms, and digital enterprise systems. It was founded in 1975, and is headquartered in Redmond, Washington, USA, with a workforce of 10001+ employees. Its website is https://www.microsoft.com.

Company H1B Sponsorship

Microsoft has a track record of offering H1B sponsorships, with 2855 in 2026, 9192 in 2025, 9343 in 2024, 7677 in 2023, 11403 in 2022, 7210 in 2021, 7852 in 2020. Please note that this does not guarantee sponsorship for this specific role.