Note: The job is a remote job and is open to candidates in USA. Chaos Labs is building an enterprise AI platform designed for how organizations operate and create value in an AI-native world. The Senior Data Scientist, Applied AI will develop and evaluate machine learning systems, LLM-powered capabilities, scalable data pipelines, and analytical frameworks for enterprise search, recommendations, AI agents, and product decision-making.
Responsibilities
- Design and build machine learning systems that power **enterprise search, retrieval, recommendations, and AI agents**
- Develop evaluation frameworks and metrics to measure the **quality, performance, and business impact of LLM-powered applications**
- Build scalable data and ML pipelines that process and analyze **large-scale AI interaction data**
- Apply **statistical modeling, experimentation, and causal inference** to guide product development and strategic decision-making
- Collaborate closely with **Product, Engineering, and Design** to translate research and insights into production features
- Analyze product usage and customer behavior to identify opportunities for improving **AI adoption, productivity, and user experience**
- Prototype, evaluate, and deploy new AI capabilities using **foundation models, embeddings, and retrieval-augmented generation (RAG)** techniques
- Define key performance indicators and build analytical frameworks that inform **product strategy and company-wide decisions**
- Contribute to the technical direction of our AI platform by identifying new opportunities to leverage **machine learning and generative AI**
- Identify opportunities, form strong points of view, and turn them into action
Skills
- **5+ years** of experience in Data Science, Applied Machine Learning, or a quantitative research role
- A degree in **Computer Science, Statistics, Mathematics, Machine Learning, Economics, Physics**, or another highly quantitative field
- A track record of developing and deploying **machine learning models in production** and turning ambiguous problems into measurable solutions
- Strong proficiency in **Python and SQL**, with experience building scalable data and ML pipelines
- Deep understanding of **statistics, experimentation, causal inference, and predictive modeling**
- Experience working with **large-scale datasets and modern data infrastructure**
- Familiarity with **LLMs, embeddings, retrieval systems, RAG, or AI agents**
- Strong analytical and technical judgment, with the ability to translate ambiguous product and business questions into rigorous analytical or machine learning approaches
- Excellent communication skills and the ability to work cross-functionally with **Engineering, Product, Design, and Leadership**
- Comfort operating in ambiguity and taking ownership without waiting for direction
- Exceptional standards for your own work and the ability to move quickly without sacrificing quality
- Experience building or evaluating **LLM-powered products or AI applications**
- Background in **search, recommendation systems, information retrieval, or knowledge graphs**
- Experience designing **A/B tests, offline evaluations, and ML benchmarking frameworks**
- Familiarity with **vector databases, embedding models, and agent orchestration frameworks**
- Contributions to **open-source ML projects** or publications in machine learning, NLP, or related fields
- Experience in **B2B SaaS, developer tools, or enterprise AI products**
- Based in **NYC** and able to work from our Brooklyn office, **or remote within the U.S. with the ability to travel up to 30% of the year** for in-person team collaboration
Benefits
- Paid Time Off – 21 vacation days + 7 sick days + 8 observed U.S. company holidays
- Health Coverage – 100% employer-paid options (medical, dental & vision) for you and your dependents
- FSA / HSA Options – depending on selected health insurance plan
- Wellness Programs – OneMedical, Teladoc, Talkspace, and EAP
- 401(k) - with a 100% company match on the first 6% contributed
- Career Growth – opportunities in a rapidly expanding, global technology company with personalized professional development
- Pre-tax Commuter Benefits
- Equity
Company Overview
Company H1B Sponsorship