Note: The job is a remote job and is open to candidates in USA. PHT Staffing LLC is seeking an experienced Senior Data Engineer for a remote contract opportunity in the United States. The role focuses on designing and developing scalable data pipelines and Lakehouse architectures using Azure Databricks and Azure Cloud services, while supporting data integration, governance, optimization, and deployment practices.
Responsibilities
- 13+ years of experience in Data Engineering, Data Architecture, or Cloud Data Platforms
- 5+ years of strong hands-on experience with Azure Databricks and Azure Cloud services
- Strong expertise in PySpark, Apache Spark, Spark SQL, SQL, and Python
- Experience designing and developing scalable ETL/ELT data pipelines
- Experience designing and implementing Lakehouse and Medallion Architecture (Bronze, Silver, Gold)
- Hands-on experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), and Delta Lake
- Strong understanding of data modeling, data warehousing, performance tuning, and optimization
- Experience with CI/CD, Git, Azure DevOps, and deployment best practices
- Knowledge of Unity Catalog, data governance, security, and access management in Azure Databricks
- Experience with data integration, ingestion, transformation, and processing of large-scale datasets
- Strong problem-solving, stakeholder communication, and Agile/Scrum experience
Skills
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field
- 13+ years of experience in Data Engineering, Data Architecture, or Cloud Data Platforms
- 5+ years of strong hands-on experience with Azure Databricks and Azure Cloud services
- Strong expertise in PySpark, Apache Spark, Spark SQL, SQL, and Python
- Experience designing and developing scalable ETL/ELT data pipelines
- Experience designing and implementing Lakehouse and Medallion Architecture (Bronze, Silver, Gold)
- Hands-on experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), and Delta Lake
- Strong understanding of data modeling, data warehousing, performance tuning, and optimization
- Experience with CI/CD, Git, Azure DevOps, and deployment best practices
- Knowledge of Unity Catalog, data governance, security, and access management in Azure Databricks
- Experience with data integration, ingestion, transformation, and processing of large-scale datasets
- Strong problem-solving, stakeholder communication, and Agile/Scrum experience
Company Overview