Note: The job is a remote job and is open to candidates in USA. Diverge Health partners with primary care providers to improve engagement and outcomes for Medicaid patients. The Senior Data Engineer will own the reliability and architectural direction of the company’s data pipelines and warehouse, with a focus on payer data, while providing technical leadership and collaborating with technical and non-technical stakeholders.
Responsibilities
- Own the ongoing upkeep and maintenance of our data pipeline, focusing primarily on the health and timeliness of payer data flowing into the company
- Ingest and standardize new member rosters and claims data as they arrive from payers, building the models to interpret each payer's structure and combine it with existing payer data into a consistent view for analysts and stakeholders
- Make architectural decisions regarding our database, schema design, and Snowflake environment structure, balancing performance, cost, and scalability
- Administer Snowflake as infrastructure, including provisioning, account and user creation, and access and role management
- Stand up and support Snowflake as a service for teams across the business, including our application development team
- Oversee our Git environment, including repository and permissions management, setup, and governance
- Develop and maintain data pipelines from file receipt through processing, ensuring reliability, graceful failure handling, and appropriate monitoring and alerting
- Participate in the team's circulating support rotation, providing day-to-day response to issues as they arise during business hours
- Support iterative, definitional work with stakeholders, such as refining how patients are scored for outreach, by building and running proposed definitions against the data and presenting the resulting impact to inform the decision
- Lead a team or project independently, providing technical guidance and mentorship to other engineers as we grow
- Partner with teams across the business, including Finance and Payer Account Management, to understand data needs, align on shared definitions, and translate technical concepts and tradeoffs into clear, actionable terms for non-technical partners
- Continually evaluate areas for process improvement, implementing solutions that streamline development, and improve pipeline performance
Skills
- 10+ years of professional data engineering experience, with a track record of independently owning production data pipelines
- Healthcare industry experience, including hands-on work with claims data, membership data, and healthcare data transformation
- Demonstrated hands-on expertise with Dagster as a primary orchestration tool
- Expert-level proficiency in Python
- Extensive hands-on experience with Snowflake, including schema design, performance optimization, and environment structure decisions
- Snowflake administration experience, including provisioning, account and user creation, access and role management, and supporting Snowflake as a service for other teams
- Strong SQL skills and broad data warehousing fundamentals beyond any single platform
- Git administration experience, including repository and permissions management, setup, and governance
- Demonstrated ability to lead and mentor other engineers, serving as a technical resource for the team
- Comfort operating where definitions do not yet exist, with the judgment to establish them in partnership with the business rather than waiting for an existing answer
- Strong communication skills, with the ability to explain technical concepts clearly to non-technical audiences
- Proven ability to balance competing priorities and follow work through to completion in a dynamic, fast-paced environment
- Candidates must be authorized to work in the United States without the need for employer sponsorship, now or at any time in the future
- Bachelor's degree, or equivalent experience, in computer science, engineering, or a related technical field
- Salesforce development experience
- Proficiency with VS Code or comparable development tooling
- Experience incorporating AI coding assistants, such as Claude, ChatGPT, or Copilot, into a professional development workflow
Company Overview