Note: The job is a remote job and is open to candidates in USA. Incredible Health operates an AI-powered healthcare career marketplace that connects healthcare professionals with employers. The Senior AI Engineer will lead LLM-powered products, matching, search, and ranking systems end to end, from prototyping and evaluation through production deployment and iteration. The role also involves shipping full-stack software, analyzing product data, and improving AI and ML systems through experimentation.
Responsibilities
- Lead LLM-powered products end to end using the foundation models best suited to the job: prototype a capability, validate it with evals, deploy, monitor, and iterate
- Take end-to-end ownership of matching, search, and ranking — model design, offline validation, shadow-scoring, and A/B experiments — across embeddings and ElasticSearch
- Ship production code across the stack — Python ML services, Rails and React web app — and diagnose whatever breaks: hallucinations, retrieval misses, ranking regressions
- Turn ambiguous questions into production-minded data analysis that changes what we build, and raise the bar through rigorous code review with our ML, AI, and product engineers
Skills
- 6+ years of software engineering, including 2+ recent years taking ML- and LLM-powered features from concept through deployment and long-term production maintenance
- Strong Python software engineering skills — with the depth to independently run, validate, and interpret a ranking-model retrain, an embedding pipeline, or an eval harness
- Evaluation for non-deterministic systems: golden datasets, LLM-as-judge, regression tests that gate launches
- Core ML foundations — classification, ranking, model evaluation — and the rigor to know what offline metrics predict about real users
- Production LLM experience (prompt engineering, tool calling, structured outputs, agent and voice workflows), plus SQL-driven product analysis and the notebook fluency to set up an environment and train or run a model on your own box
- Marketplaces or recommendation systems where both sides say yes
- Voice agents in production
- Embedding retrieval at scale
- Claude Code as a daily force multiplier
- Confident full-stack contributor
Benefits
- 100% remote work, with the role available in the listed states
- Competitive, market based salary aligned with your skills and experience
- Medical, dental and vision coverage with shared premiums
- Company-sponsored 401(k) retirement savings plan
- Commission and/or equity may be offered based on the position
- Unlimited vacation
- Generous family leave policy
- Team events and trivia
Company Overview
Company H1B Sponsorship