DQA Engineering Lead - Databricks & Snowflake
100% Remote
12+months Contract
Required Experience & Technical Expertise
10+ Years of Experience:
Extensive background in Data Engineering, Data Architecture, or highly technical Data Quality Engineering.
Databricks SME (Required):
Deep, hands-on expertise in Databricks, including PySpark, Spark SQL, Delta Lake architecture, and performance tuning for large-scale data processing.
Snowflake SME (Highly Preferred):
Strong experience with Snowflake architecture, Snowpark (Python), task scheduling, and data sharing.
Programming & Scripting:
Advanced proficiency in Python, PySpark, and SQL. Must be a hands-on coder who treats data quality as a software engineering discipline.
Shift-Left & DQxC:
Proven experience building programmatic data quality frameworks from the ground up, such as Great Expectations, dbt tests, Soda, or custom PySpark/Python frameworks.
Preferred Qualifications
Healthcare Payer Domain:
Understanding of healthcare payer data ecosystems, including Medicare, Medicaid, claims processing, HL7/FHIR, and PHI/PII compliance.
Platform Certifications:
Active Databricks Certified Data Engineer Professional and/or SnowPro Advanced: Data Engineer certifications.
Agile/Pod Delivery:
Experience operating as a technical lead in a scaled Agile (SAFe) or Pod-based delivery model