Note: The job is a remote job and is open to candidates in USA. Luminary is an AI-native system of action for wealth transfer services, transforming complex estate planning and ownership documents into structured data for agent-driven workflows. The Software Engineer - Applied AI will improve document extraction accuracy, design and maintain evaluations, enhance agent orchestration, and build human-review workflows for dependable AI systems.
Responsibilities
- Improve accuracy on our core extractions. Documents can be long, amended in unanticipated ways, or have unclear language. You'll work with our JDs and other experts to find the failure modes, figure out what's happening, fix them
- Own our evals. The only way to maintain a system like this is through tests and evals. We have a strong foundation for evals, but think that it can be better and want to invest heavily here. You'll design and maintain the suites that tell us whether a change helped and to prevent regressions
- Improve our shared agent harness. Tooling, parallel tool calls, context strategy, and the orchestration behind our agentic advisory workflows
- Design for human review. Our users don't want a black box. Work with product and design on how a suggestion gets surfaced, explained, and accepted or rejected, then feed the corrections back into the system
- Be informed on the state of AI. Models, capabilities, and usage pattern best practices shift weekly and it's our job to be aware of what's out there so we can remain at the frontier of the industry. You'll stay on top of the latest developments and, leveraging our evals, take advantage of the rising tide of models!
Skills
- Four or more years of software engineering experience, at companies with strong engineering practices
- An engineer who works on AI, not a researcher. You like shipping to production systems. You're interested in and have experience with prompt and context engineering, eval design, and the unglamorous work of making probabilistic systems dependable
- Curious about the domain. There's so much nuance in the world of trusts, and understanding the pieces and how they fit together – and how our customers expect them to fit together! – is how we're going to build the best product
- Our backend is Go, Postgres, Temporal, and GraphQL
- Our monitoring is mostly in Honeycomb, Braintrust, and PostHog
- You communicate well. With half the team remote, overcommunication is the name of the game!
- At this time, Luminary is unable to sponsor employment visas or provide immigration support
Benefits
- 100% employee health insurance coverage (plus 50% dependent coverage)
- Monthly wellness, commuter, and educational stipends
- 4 weeks PTO, plus holidays
- NYC office near Bryant Park, for those who want it. Remote-friendly by default.
- 401(k) plan
- Parental leave policy
- Meaningful equity
Company Overview