Note: The job is a remote job and is open to candidates in USA. eNGINE is a Solutions and Placement firm that builds Technical Teams, inspired by continuous learning and engagement with the markets they serve. They are hiring multiple Senior Data Engineers to own and evolve their enterprise data warehouse, focusing on data movement through the Databricks platform and ensuring pipeline reliability and quality.
Responsibilities
- You'll be responsible for how data moves through our Databricks platform — from raw ingestion all the way through to the clean, trusted tables the business relies on every day
- You'll own specific domains within the warehouse outright — the data models, the pipeline reliability, the quality checks that keep everything trustworthy
- You'll also help build out the automation and event-driven architecture that moves us away from older, slower batch patterns
- Day to day, you'll design and build pipelines across our Bronze, Silver, and Gold layers, write the transformation and harmonization logic that turns raw data into something usable, and build out the Gold-layer tables that feed our reporting and analytics work
- You'll also spend real time on documentation — not as an afterthought, but because we don't want any part of this platform to depend on one person's memory
Skills
- Several years of hands-on data engineering experience, including real ownership of a warehouse or large-scale pipelines with actual SLAs to hit
- Deep, practical experience with Databricks — Delta Lake, medallion architecture, Unity Catalog
- Strong data modeling background, especially conformance and harmonization logic
- Advanced SQL along with solid PySpark and Python skills
- Experience with Azure's data stack — Data Factory, Data Lake Storage, and Azure DevOps for CI/CD
- Ability to walk into a complex, loosely documented system and make sense of it
- Comfortable communicating directly with technical and business stakeholders alike
- Background in healthcare, specialty pharmacy, or another regulated industry
- Experience with event-driven ingestion tools like Event Hubs or Kafka
- Familiarity with data contract standards or observability platforms like Monte Carlo
- Exposure to enterprise data catalog tools such as Atlan or Collibra
- A track record of mentoring engineers and setting technical standards without needing a formal title to back it up
Benefits
- Consulting Workforce is encouraged to enjoy career fulfillment in the form of challenging projects, schedule flexibility, and paid training/certifications.
Company Overview