Note: The job is a remote job and is open to candidates in USA. 10a Labs provides safety and threat-intelligence services for advanced AI systems through adversarial red teaming, model evaluations, and intelligence collection. The company is seeking a Software Engineer, Infrastructure & Platform to build secure, reproducible backend systems, infrastructure, sandboxes, and evaluation harnesses for large-scale AI and agentic evaluations. The role will also focus on observability, reliability, orchestration, and diagnosing failures across model and infrastructure layers.
Responsibilities
- Design and build sandboxed evaluation environments where AI models can safely execute code, use tools, interact with services, and complete complex tasks
- Build backend services and infrastructure supporting large-scale, repeatable AI and agentic evaluations
- Develop agent scaffolding and evaluation harnesses, including tool-use loops, context management, retries, state management, token budgets, and multi-agent or subagent workflows
- Build systems for provisioning and orchestrating isolated environments using technologies such as Docker, Kubernetes, VMs, and cloud infrastructure
- Design secure approaches to networking, permissions, secrets, credentials, and resource isolation for model-driven environments
- Develop APIs, internal tools, and automation that allow researchers, engineers, and subject-matter experts to create and run evaluations efficiently
- Improve the reliability and reproducibility of evaluations through logging, observability, snapshotting, debugging tools, and automated testing
- Build systems capable of running thousands of evaluation tasks reliably and capturing the artifacts and telemetry needed to understand model behavior
- Partner with analysts, red teamers, and domain experts to translate complex evaluation ideas into robust technical systems
- Investigate failures across the evaluation stack and distinguish between model limitations and infrastructure, harness, or environment failures
Skills
- * 3–5+ years of professional software engineering experience, particularly in backend, infrastructure, platform, SRE, or distributed systems engineering
- * Strong programming skills in Python and experience building production-quality software
- * Experience designing and operating backend services, APIs, or distributed systems
- * Hands-on experience with Docker, Kubernetes, virtual machines, or other container/orchestration technologies
- * Experience working with AWS, GCP, or similar cloud infrastructure
- * Strong understanding of Linux systems, networking, authentication, permissions, and infrastructure security
- * Experience with infrastructure-as-code or automation tools such as Terraform
- * Strong debugging skills and comfort diagnosing failures across application, infrastructure, and networking layers, especially in agentic loops
- * Ability to build systems that are reproducible, observable, scalable, and secure
- * Comfort working on ambiguous technical problems where the architecture and requirements may evolve quickly
- * Interest in AI systems, agentic workflows, AI security, or model evaluations. Prior professional AI experience is helpful but not required
- * Experience building developer platforms, CI/CD systems, test infrastructure, sandboxes, or ephemeral compute environments
- * Experience with agent frameworks, LLM APIs, tool-calling systems, or AI evaluation infrastructure
- * Experience designing secure execution environments for untrusted or semi-trusted code
- * Background in SRE, platform engineering, cloud infrastructure, cybersecurity, or developer tooling
- * Experience with distributed task execution, queues, workflow orchestration, or large-scale automated testing
- * Familiarity with AI safety, adversarial testing, model evaluations, or autonomous-agent systems
Benefits
- Performance-based annual bonus
- Support for conferences, continuing education, or leadership training
- Fully remote, U.S.-based
- Comprehensive health, dental, and vision coverage
- Generous PTO and paid holiday schedule
- 401(k) plan
Company Overview