Note: The job is a remote job and is open to candidates in USA. Abacus Insights is transforming healthcare data for health plans by creating trusted, connected data foundations that support better decisions and GenAI use cases. The Senior AI Engineer will architect, build, and implement AI platforms, models, pipelines, and agentic systems while providing technical leadership, mentoring, and architectural guidance across distributed engineering teams.
Responsibilities
- Help shape the direction of our applied AI areas and intelligence features, driving deployment of state-of-the-art AI models and systems that directly impact Abacus's products and services (Abacus Agents, MCP, SQL and RAG agents and tools, and more)
- Develop novel data collection, fine-tuning, and LLM techniques that achieve optimal performance on specific tasks and domains
- Design and implement ML/AI pipelines for data preprocessing, feature engineering, model training, hyperparameter tuning, and evaluation — enabling rapid experimentation, iteration, and self-healing systems
- Build scalable, reusable backend systems to support GenAI products company-wide, with robust logging, telemetry, and evaluation harnesses to ensure reliable performance
- Partner with cross-functional teams — AI engineers, data engineers, and product — to deliver AI solutions that meaningfully improve user productivity and satisfaction
- Drive critical initiatives spanning AI and data engineering innovation, development productivity, and benchmarking
- Mentor and coach software and AI developers, helping them grow their skills and ensuring delivered solutions align with our architecture strategy, coding standards, and organizational policies
- Participate in architectural discussions, influence key technical decisions, and collaborate with peers to keep the organization's engineering approach consistent
- Identify people and process improvements for Agile/Scrum teams, especially where innovation and rapid iteration are critical to AI work
- Balance delivery against roadmap commitments while navigating interruptions and client escalations, with a solid grasp of incident management, configuration management, and operational efficiency
- Communicate architecture, design, and implementation objectives upward, and keep teams aligned with established policies and procedures
- Represent Abacus credibly in customer-facing technical conversations
Skills
- 3+ years of ML/AI engineering experience in high-velocity, high-growth companies (a strong background in relevant ML/AI research in academia will also be considered)
- 6+ years of experience as a software developer at some point in your career
- 2+ years of experience with Databricks, Mosaic AI Gateway, and associated technologies in the Databricks stack for data and AI engineering
- A strong track record with language modeling technologies and GenAI — generative and embedding techniques, modern model architectures, fine-tuning/pre-training datasets, evaluation benchmarks, agents and agentic workflows (orchestration, workflow management, observability, debugging), RAG, SQL agents, MCP, and similar
- Proficiency in Python, TensorFlow/PyTorch, and scalable ML/AI architecture
- Proven ability to drive end-to-end model and system development, from research and prototyping through deployment and monitoring
- Strong coding and software engineering fundamentals, with familiarity with testing, code review, and deployment best practices
- Experience designing scalable, distributed systems for data processing applications and services at the 10s–100s of TBs scale
- A track record of leading software development teams or projects toward production-grade systems supporting real customers
- Excellent knowledge of software development design, QA, test automation, and Agile methodologies
- Demonstrated knowledge of Cloud Architecture, AI Architecture, Agents/Agentic systems, Massive Parallel Processing (MPP) compute frameworks for Data+AI platforms, security, and MCP/API-based services
- Enough breadth and depth in software and AI development to hold your own — and influence outcomes — in technical discussions with internal and external stakeholders
- Solid understanding of roles adjacent to software development (product management, project management, client delivery, operations) and the ability to work fluidly with each
- Strong analytical and problem-solving instincts, with a genuine passion for improving AI-driven user experiences
- Bachelors Degree or equivalent relevant professional experience
- Experience with Snowflake
- Familiarity with FHIR
- Exposure to healthcare data
Benefits
- Compensation for this role is based on experience, skills, and location, and includes base salary plus eligibility for performance bonuses and equity grants.
- Unlimited paid time off — recharge when you need it.
- Work from anywhere — flexibility to fit your life.
- Comprehensive health coverage — multiple plan options to choose from.
- Equity for every employee — share in our success.
- Growth-focused environment — your development matters here.
- Home office setup allowance — one-time support to get you started.
- Monthly cell phone allowance — stay connected with ease.
Company Overview
Company H1B Sponsorship