Posted Sep 30, 2026

Member of Technical Staff | Inference Platform

Apply Now

About the role

At Avra, every technical IC is a Member of Technical Staff (MTS). The title doesn't put anyone in a silo: you own systems and outcomes, not steps in a function, and you keep building depth in your area. Seniority shows up in your scope, level, and compensation, not in titles.

In this role, you'll join the Platform team to own where our models execute. Customers consume our models through large batches of millions of records and through real-time APIs, and they make business decisions on every response. You'll run governed model releases reliably and efficiently — in our cloud and on customer-hosted Kubernetes — and make inference fast, predictable, and cheap enough to serve both enterprise and mid-market customers.

What you'll do

How we measure success

What we're looking for

Nice to have

Experience running model serving or large-scale batch compute on Kubernetes; building Kubernetes controllers or operators; profiling and optimizing data-heavy Python pipelines; production-quality code and willingness to operate what you build.

Key Responsibilities

Skills & Tools

Kubernetes, Kueue, Python, Ray, Ray Serve, KubeRay, Arrow, Parquet, Lance, GCP, AWS, GKE, EKS

Job Details

About Avra

A technology company building an inference platform for enterprise and mid-market customers. — Industry: Information Technology