Note: The job is a remote job and is open to candidates in USA. Apton, Inc. is seeking a Senior Azure Data Engineer to support the design, development, and optimization of scalable data solutions on the Microsoft Azure platform. The role focuses on cloud-based data engineering, ETL/ELT pipelines, Azure data services, healthcare data integration, and data governance, security, and performance.
Responsibilities
- Design, develop, and optimize scalable data pipelines and data solutions using Azure
- Build and maintain ETL/ELT pipelines using Azure Data Factory (ADF)
- Develop data processing and transformation solutions using Azure Databricks, PySpark, and Python
- Work with Azure Synapse Analytics, Azure SQL Database, and Data Lake Storage Gen2
- Integrate data from multiple sources, including healthcare systems and EHR platforms
- Implement data quality, validation, governance, security, and monitoring processes
- Optimize data pipelines and queries for performance, scalability, and reliability
- Collaborate with data architects, analysts, application teams, and business stakeholders
- Develop solutions following Azure cloud architecture and best practices
Skills
- · Strong experience with Azure Data Engineering
- · Hands-on experience with Azure Data Factory (ADF)
- · Strong knowledge of Azure Databricks, PySpark, and Python
- · Experience with Azure Synapse Analytics
- · Strong SQL skills and experience with Azure SQL
- · Experience with Azure Data Lake Storage (ADLS Gen2)
- · Knowledge of ETL/ELT, data warehousing, and data modeling
- · Experience working with large and complex datasets
- · Understanding of healthcare data, EHR, HL7/FHIR, or related healthcare systems is preferred
- · Experience with Git, CI/CD, Azure DevOps, and cloud deployment practices
- · Strong understanding of data security, governance, and compliance
- · 8+ years of overall data engineering experience
- · 5+ years of experience working with Microsoft Azure data services
- · Experience developing enterprise-scale data platforms
- · Experience with HIPAA-compliant data environments is a plus
- · Healthcare/health insurance domain experience is highly preferred
Benefits
- Remote work
Company Overview
Company H1B Sponsorship