Note: The job is a remote job and is open to candidates in USA. eNGINE is a Solutions and Placement firm that builds technical teams and provides consulting workforce opportunities through challenging projects, flexible schedules, and paid training and certifications. The Senior Data Engineer will own and evolve enterprise data warehouse domains on Databricks, developing reliable pipelines, data models, transformation logic, quality checks, and Gold-layer tables while helping advance automation and event-driven architecture.
Responsibilities
- Own and evolve our enterprise data warehouse
- Be responsible for how data moves through our Databricks platform — from raw ingestion all the way through to the clean, trusted tables the business relies on every day
- Own specific domains within the warehouse outright — the data models, the pipeline reliability, the quality checks that keep everything trustworthy
- Help build out the automation and event-driven architecture that moves us away from older, slower batch patterns
- Design and build pipelines across our Bronze, Silver, and Gold layers
- Write the transformation and harmonization logic that turns raw data into something usable
- Build out the Gold-layer tables that feed our reporting and analytics work
- Spend real time on documentation — not as an afterthought, but because we don't want any part of this platform to depend on one person's memory
Skills
- • Several years of hands-on data engineering experience, including real ownership of a warehouse or large-scale pipelines with actual SLAs to hit
- • Deep, practical experience with Databricks — Delta Lake, medallion architecture, Unity Catalog
- • Strong data modeling background, especially conformance and harmonization logic
- • Advanced SQL along with solid PySpark and Python skills
- • Experience with Azure's data stack — Data Factory, Data Lake Storage, and Azure DevOps for CI/CD
- • Ability to walk into a complex, loosely documented system and make sense of it
- • Comfortable communicating directly with technical and business stakeholders alike
- No C2C, relocation, referral, or sponsorship candidates for this role
- • Background in healthcare, specialty pharmacy, or another regulated industry
- • Experience with event-driven ingestion tools like Event Hubs or Kafka
- • Familiarity with data contract standards or observability platforms like Monte Carlo
- • Exposure to enterprise data catalog tools such as Atlan or Collibra
- • A track record of mentoring engineers and setting technical standards without needing a formal title to back it up
Benefits
- Challenging projects
- Schedule flexibility
- Paid training/certifications
Company Overview