Note: The job is a remote job and is open to candidates in USA. Aleph is an AI-native platform for Financial Planning & Analysis (FP&A). The Staff+ Software Engineer, AI will own the shared AI foundation, including model selection and routing, proxy infrastructure, context management, tool design, and evaluation systems. The role will also ship agentic features, build observability, and establish scalable practices for production LLM systems.
Responsibilities
- Own the AI foundation product teams build on: model selection and routing, the model proxy layer, context management, and tool design
- Own eval infrastructure. Work with customers and finance domain experts to define what excellent output looks like, then encode it in evals every team can run - in FP&A, a wrong answer ends up in someone's board deck
- Ship agentic features end to end, from v0 through the optimization loop: prompt and context engineering, caching, parallel tool calls, subagent patterns
- Build observability into agent behavior so we can profile it, find bottlenecks, and decide what to fix with data
- Track what's changing in agentic systems and bring the practices that prove out into how we build
Skills
- You've shipped production LLM systems - evals, context management, multi-model or multi-provider routing - and can talk concretely about what broke and what you changed
- You build proof of concepts, decide quickly, and ship v0s. Evals drive your quality bar
- Strong judgment about abstractions: opinionated about design, pragmatic about shipping incrementally
- Experience with LLM APIs and agent frameworks, and shipped user-facing products
- You want to ship production systems, not do research
- Adoption: teams you don't manage have picked up systems you built - because they were that good
- Strong fundamentals: you can trace requests from UI to data store and make good technical decisions at every layer
- High agency: background as a founder, engineering lead, or startup builder. You have a builder's mindset and find creative ways to ship
- Pragmatism: you choose the fewest and simplest tools that will actually work
- Craft: you care deeply about code quality and write code that's correct and easy to understand
- Communication: clear, direct, and persuasive across technical and non-technical audiences
- Experience: you've built complex B2B products, ideally from scratch
- While this is a remote-first opportunity, we're focusing on candidates within the Americas to better align with our working hours as a team
Benefits
- Remote work across the Americas (United States, Canada, LATAM)
- Remote-first opportunity
Company Overview
Company H1B Sponsorship