We're Hiring: Lead Data Engineer (Hands-On)
Location: Remote
Experience: 12 18 Years
Employment: Full-Time
We are looking for an experienced Lead Data Engineer with strong expertise in Azure Databricks, large-scale data engineering, and Generative AI to build an enterprise-scale, AI-first Data Hub for a leading financial services and insurance client.
Key Skills Required:
Strong Python, PySpark, Scala, and SQL
Azure Databricks, Delta Lake, and Medallion Architecture
Azure Data Factory (ADF) and ADLS Gen2
Generative AI, LLMs, RAG, and AI-powered data pipelines
LangChain, LangGraph, or LlamaIndex
Data quality, anomaly detection, and data governance
Azure DevOps, Terraform, and CI/CD
Enterprise data platform architecture and technical leadership
Must Have: 3+ years of hands-on experience building and deploying production-grade LLM-based systems, along with strong data engineering and architecture expertise.
We are looking for a hands-on technical leader who can design scalable data platforms, write production code, optimize pipelines, and mentor engineering teams.