Note: The job is a remote job and is open to candidates in USA. PHT Staffing LLC is seeking an experienced Senior Data Engineer for a full-time remote role in the United States. The position focuses on designing and developing scalable data pipelines and Lakehouse architectures using Azure Databricks and Azure Cloud services, along with data integration, governance, performance optimization, and deployment best practices.
Responsibilities
- Designing and developing scalable ETL/ELT data pipelines
- Designing and implementing Lakehouse and Medallion Architecture (Bronze, Silver, Gold)
- Data integration, ingestion, transformation, and processing of large-scale datasets
Skills
- Candidates who currently hold an active security clearance or are eligible to obtain the clearance
- Bachelor's degree in computer science, Information Technology, Engineering, or a related field
- 13+ years of experience in Data Engineering, Data Architecture, or Cloud Data Platforms
- 5+ years of strong hands-on experience with Azure Databricks and Azure Cloud services
- Strong expertise in PySpark, Apache Spark, Spark SQL, SQL, and Python
- Experience designing and developing scalable ETL/ELT data pipelines
- Experience designing and implementing Lakehouse and Medallion Architecture (Bronze, Silver, Gold)
- Hands-on experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), and Delta Lake
- Strong understanding of data modeling, data warehousing, performance tuning, and optimization
- Experience with CI/CD, Git, Azure DevOps, and deployment best practices
- Knowledge of Unity Catalog, data governance, security, and access management in Azure Databricks
- Experience with data integration, ingestion, transformation, and processing of large-scale datasets
- Strong problem-solving, stakeholder communication, and Agile/Scrum experience
Benefits
- Full-time opportunity
- Remote work (USA)
Company Overview