Note: The job is a remote job and is open to candidates in USA. PHT Staffing LLC is seeking an experienced Senior Data Engineer for a full-time remote opportunity serving a client. The role focuses on designing and developing scalable data pipelines and lakehouse architectures using Azure Databricks, Azure data services, PySpark, SQL, and Python.
Skills
- • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field
- • 13+ years of experience in Data Engineering, Data Architecture, or Cloud Data Platforms
- • 5+ years of strong hands-on experience with Azure Databricks and Azure Cloud services
- • Strong expertise in PySpark, Apache Spark, Spark SQL, SQL, and Python
- • Proven experience designing and developing scalable ETL/ELT data pipelines
- • Hands-on experience designing and implementing Lakehouse and Medallion Architecture (Bronze, Silver, Gold)
- • Strong hands-on experience with Azure Data Factory (ADF), Azure Data Lake Storage Gen2 (ADLS Gen2), and Delta Lake
- • Strong understanding of data modeling, data warehousing, performance tuning, and optimization
- • Experience with CI/CD, Git, Azure DevOps, and deployment best practices
- • Knowledge of Unity Catalog, data governance, security, and access management in Azure Databricks
- • Experience with data integration, ingestion, transformation, and processing of large-scale datasets
- • Strong problem-solving and stakeholder communication skills
- • Experience working in Agile/Scrum environments
- Note : Due to the client's requirements, we are only considering US Citizens, Green Card holders, and TN visa holders at this point in time. No H-1B, EAD, or Third-Party vendors
- • Databricks Certification is a plus
Benefits
- Remote work opportunity
Company Overview