Note: The job is a remote job and is open to candidates in USA. Mirantis is a Kubernetes-native AI infrastructure company enabling organizations to build and operate scalable, secure, and sovereign infrastructure for AI, machine learning, and data-intensive applications. The Senior Software Engineer will build and own LLM serving infrastructure on Kubernetes, package it for enterprise environments, integrate it with platform services, develop production observability, and help guide engineering direction.
Responsibilities
- Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management
- Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks
- Integrate the serving layer with the platform's API gateway, identity, and metering services
- Build the observability for operating GPU inference in production (serving metrics, GPU telemetry)
- Contribute across a multi-service codebase and help set engineering direction through design docs and reviews
Skills
- • 5+ years of software engineering experience in infrastructure, platform, or distributed systems
- • Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts, not just consuming managed clusters
- • Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast
- • Strong Go programming skills; solid CI/CD and infrastructure-as-code skills
- • Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily engineering workflow
- • Comfortable with high autonomy on a small, remote-first, written-culture team
- • Inference performance work (quantization, batching, caching) or distributed serving frameworks
- • Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security
- • UI development experience (e.g. React/TypeScript), useful as the product's management surfaces grow
- • Open-source contributions in the Kubernetes or ML-infrastructure ecosystems
Benefits
- Work with an established Silicon Valley leader in the cloud infrastructure industry
- Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies
- Be a part of cutting-edge, open-source innovation
- Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued
- Professional development and training
- Attend conferences and working groups
- Company outings, happy hours, hackathons, and tech talks
- A competitive compensation package with a strong benefits plan
Company Overview
Company H1B Sponsorship