Lead Data Engineer – Databricks
Location: Bay Area, CA / Remote – Local or Nearby Candidates Only
Experience: 12+ Years
Domain: Healthcare – Mandatory
Work Authorization: / // L2S / H1B
Mandatory Skills:
Databricks, Delta Lake, Apache Spark/PySpark, Python, SQL, Healthcar
Job Description:
We are looking for a Lead Data Engineer with Databricks expertise to design, develop, and optimize scalable data engineering solutions in the Healthcare domain
Required:
10–15+ years of Data Engineering experience.
Active Databricks Certification required; Databricks Certified Data Engineer Professional preferred.
Strong hands-on experience with Databricks, Apache Spark/PySpark, Delta Lake, Python, and SQL.
Experience with Unity Catalog, Delta Live Tables (DLT), Databricks SQL, and Databricks Workflows.
Strong knowledge of Medallion Architecture (Bronze/Silver/Gold) and data modeling.
Experience with AWS, Azure, or Google Cloud Platform.
Experience with Airflow or similar orchestration tools.
Strong understanding of Git, CI/CD, and data pipeline development.
Experience leading data engineering projects and mentoring teams.
Healthcare industry experience is mandatory.