Note: The job is a remote job and is open to candidates in USA. AZX is a public benefit corporation focused on accelerating positive impact in critical industries through AI transformation. The Software Engineer will build and maintain backend services, infrastructure, and platform capabilities for LLM gateways, sandboxing, Kubernetes-based systems, and model inference. The role also involves observability, performance optimization, and collaboration across gateway, sandbox, and inference platform teams.
Responsibilities
- Build and maintain backend services for our LLM gateway — routing, rate limiting, key management, and observability in front of the inference fleet
- Contribute to sandboxing and isolation infrastructure that keeps agent-generated code safe to execute, working alongside our security-focused engineers
- Support Kubernetes-based platform services, including operators and autoscaling logic adjacent to our inference platform
- Write high-performance backend code in Go, Rust, or async Python (FastAPI/Starlette), working with infrastructure like Envoy and gRPC
- Instrument services with OpenTelemetry so behavior, latency, and cost stay observable as the platform scales
- Collaborate across the gateway, sandbox, and inference platform teams, flexing across areas as priorities shift
Skills
- • 4+ years of experience in backend engineering fundamentals: distributed systems, API design, and production experience in Go, Rust, or async Python
- • Exposure to Kubernetes and containerization; interest in sandboxing or security is a plus
- • Comfort working across a range of platform concerns rather than one narrow specialty — this role is intentionally broader than our specialist infra profiles
- • Eagerness to grow into deeper specialization in gateway, sandbox, or inference infrastructure over time
- • High emotional intelligence and a learning mindset
- • Strong collaboration skills
- • Enjoy others' success and a fun, positive environment
- • Comfortable making decisions in the face of ambiguity and course correcting as needed
- • Must be willing to travel to Seattle area for final interview and travel 2x/year for company summits
- • Applicants must be currently authorized to work in the United States on a full-time basis
- • We are unable to sponsor or take over sponsorship of employment visas at this time
- • Familiarity with LLM-specific backend concerns (rate limiting, caching, token accounting) is a plus, though not required on day one
- • Experience in both startup and enterprise environments
- • Past work in energy, real estate, utilities, climate or related fields
- + Additional web frameworks (e.g. Svelte, Vue, Angular)
- + Lower-level languages e.g. C++, Rust
- + Networking paradigms e.g. GraphQL, Websockets
- + ML capabilities e.g. Sk-learn, xgboost, Pytorch/Tensorflow/JAX, Onnx…
- + Additional database types such as graph or vector databases
- + DevOps e.g. CI/CD pipelines, Docker, Kubernetes, Terraform, Pulumi and/or Bicep
- + Generative AI e.g. prompt engineering, RAG, fine-tuning, tooling ecosystem
Benefits
- Bonus eligibility
- Health insurance with meaningful coverage for dependents
- Flexible paid time off
- Equity
- Fully remote culture with a cluster of teammates in Seattle
- Training and learning opportunities
- Be part of a fast-growing, profitable, mission-driven company with industry leading clients tackling the massive opportunity of AI transformation in critical industries
Company Overview