Note: The job is a remote job and is open to candidates in USA. Inceed is a staffing direct placement firm that helps clients, candidates, and employees find better opportunities. The company is seeking a Senior Data Engineer to own and evolve a Databricks lakehouse platform, build scalable data pipelines, modernize legacy workloads, and deliver trusted data for reporting and AI use cases.
Responsibilities
- Own the technical design of the Databricks lakehouse platform
- Build and optimize pipelines using PySpark, Spark SQL, and Delta Live Tables
- Design enterprise data models and gold-layer reporting structures
- Support migration from legacy SQL Server, SSIS, Synapse, and ADF workloads
- Implement Unity Catalog governance and data access controls
- Tune performance, reliability, and cloud costs across the platform
- Establish CI/CD, testing, and environment promotion standards
- Partner with business users and BI teams on self-service analytics
- Review offshore partner work and maintain engineering quality
- Document architecture decisions and operational runbooks
Skills
- 8+ years of experience in data engineering, warehousing, or BI
- 5+ years building production platforms on Databricks or Spark
- Strong hands-on experience with PySpark and Spark SQL
- Experience owning the design of an enterprise data platform
- Advanced knowledge of Delta Lake and Databricks workflows
- Experience with dimensional modeling and star schema design
- Strong SQL skills, including complex stored procedure analysis
- Experience migrating legacy data platforms to modern cloud architecture
- Hands-on experience with Unity Catalog and data governance
- Ability to remain technical and hands-on in day-to-day development
- Our client unable to provide sponsorship at this time
Benefits
- This position can be fully remote
Company Overview