Note: The job is a remote job and is open to candidates in USA. BJAK is building proactive, AI-native applications that help users manage conversations, errands, organization, and workflows with minimal prompting. The Product Engineer, AI Email App will define AI product and system requirements, balance model and engineering trade-offs, establish evaluation frameworks, and drive reliable, user-trusted AI experiences in collaboration with ML, backend, and client engineering teams.
Responsibilities
- Define end-to-end requirements for AI capabilities, from model behavior to system behavior to user experience
- Translate model capabilities, evaluation results, and technical constraints into clear product and system decisions
- Make trade-offs across quality, latency, cost, reliability, safety, and UX
- Work closely with ML, backend, and client engineers on system design, evaluation, and iteration
- Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback
- Establish clear quality bars and feedback loops for AI-powered experiences
- Drive execution through clear specifications, prioritization, and strong technical judgment
- Identify failure modes and ensure AI systems behave predictably and recover gracefully
- Own product quality end-to-end, correctness, reliability, usefulness, and user trust
Skills
- Strong computer science fundamentals and system design skills
- Solid understanding of modern ML and how AI systems behave in production
- Comfortable reading technical designs, understanding architectures, and engaging deeply with engineers
- Strong intuition for model limitations, hallucinations, evaluation, and failure modes
- Significant experience owning complex, technical products end-to-end
- Hands-on experience with AI-powered products, particularly LLM-based systems
- Experience with model evaluation, experimentation, prompting, or AI system iteration
- Ability to turn ambiguous problems into clear requirements, measurable outcomes, and executable plans
- Strong judgment and the ability to make decisions when the right answer is not obvious
- Highly technical, curious, and comfortable going deep
- Strong bias toward shipping, experimentation, and learning from real-world usage
- Able to challenge engineers and researchers constructively while maintaining strong collaboration
- Comfortable operating with significant ownership in a fast-moving, zero-to-one environment
- Experience shipping AI-heavy consumer products
- Background as an engineer or highly technical product manager
- Experience defining evaluation metrics for ML systems
- Strong intuition for AI UX patterns and failure handling
- Prior experience in zero-to-one product environments
- An engineering background is a strong plus, but what matters most is the ability to reason deeply about both AI systems and product outcomes
Benefits
- Hybrid work arrangement
- Virtual meetings and/or onsite interviews
Company Overview