Note: The job is a remote job and is open to candidates in USA. Irys is a legal AI company building tools that help legal professionals complete inspectable and refinable work. The AI Infrastructure / Product Engineer will build model, agent, and legal workflow evaluations; production AI features; backend services and APIs; and reliable cloud deployments and operations.
Responsibilities
- Repeatable benchmarks for models, agents, and legal workflows
- Evaluation pipelines covering accuracy, hallucinations, retrieval quality, latency, and cost
- Dashboards that make changes in system performance visible
- Production features that turn research prototypes into usable retrieval, drafting, document, and agent workflows
- Backend services, APIs, and internal tools that help the team test and release improvements
- Cloud deployments with monitoring, databases, delivery pipelines, and reliable operations
Skills
- Strong Python skills and experience deploying software to the cloud
- Confidence working with APIs, databases, backend services, and deployment pipelines
- An interest in LLMs, retrieval-augmented generation, agents, and evaluation
- The ability to turn an ambiguous idea into a usable, maintainable system
- Full-stack experience is preferred
- Experience with FastAPI, Docker, React/Next.js, Postgres, vector databases, AI benchmarks, or document automation would be helpful
Benefits
- Full-time · Remote · United States only
- Substantial ownership on a distributed team
- Direct access to leadership
- The opportunity to influence how we measure and improve quality
Company Overview