Note: The job is a remote job and is open to candidates in USA. Nordic is an IT services firm serving the healthcare industry and helping healthcare providers leverage technology for digital transformation. The Senior Data Engineer designs, develops, optimizes, and maintains data architectures, pipelines, and DataOps workflows while providing data engineering expertise for business solutions. The role also focuses on data quality, security, governance, engineering standards, and mentoring data team members.
Responsibilities
- Designs, develops, optimizes, and maintains data architecture and pipelines that adhere to Extraction, Transformation, Loading (ETL) principles and best practices using Azure Databricks (PySpark)Works to identify business problems that can be solved and product features that can be enhanced by data engineering and analytics
- Provides subject matter expertise as a product team member, for identification, estimation, and implementation of data solutions to business use cases
- Collaborates with data analysts, key data consumers and application developers to optimize models and algorithms for data quality, security, and governance
- Solicits, understands, and ensures compliance with data governance and data security requirements while creating and improving integrated and reusable data pipelines, to enable faster data access and improved time-to-solution for data and analytics initiatives
- Leads engineering communities of practice (CoP) to expand influence and quality across the digital organization
- Designs end to end DataOps and analytical workflows, including overall architecture, capabilities, platforms, tools, and governing processes
- Mentors’ data team members to grow capabilities and mitigate product delivery risks
Skills
- Bachelors degreea0anda05a0years'a0experiencea0ina0aa0Dataa0Engineeringa0role,a0ina0aa0healthcarea0settinga0(required)a0ora07a0yearsa0ofa0relateda0experiencea0ina0lieua0ofa0degree.a0(required)
- 5 years experience in a data engineering or architecture role (required)
- 5 years experience designing, building, deploying, and troubleshooting data extract and load jobs (required)
- 3 years experience building DB objects, authoring, and troubleshooting SQL queries, stored procedures and ETL processes (required)
- 5 years experience writing complex T-SQL queries, strong knowledge of DML, DDL, triggers, common table expressions (CTE), query tuning and performance optimization (required)
- 3 years experience working with DevOps and continuous integration capabilities for version control, build automation, testing, and release management (e.g., Visual Studio, Git, Jenkins, Azure DevOps) (required)
- Master's degree Computer Science, Statistics, Applied mathematics, or information systems and 6 years of related experience or 11 years of related experience and no degree. (preferred)
- 5+ years experience in building cloud data pipelines using Azure Databricks (PySpark) and Azure data factory
- 3 years experience foundational data management practices, including:
- Implement Delta Lake architectures, including medallion data models (bronze/silver/gold layers)
- Demonstrated ability to design, build, manage and automate pipelines for data structures encompassing data transformation, data models, schemas, metadata, and workload management
- Build reusable frameworks for metadatadriven ingestion, orchestration, and error handling
- License/Certification - Azure Data Engineer Associate (preferred)
- 1 year experience working with C#, PowerShell, Azure functions and logic apps, Azure Key Vault, .Net core, Azure PaaS (preferred)
- 3 years experience Exposure to hybrid deployments, cloud and on premise, with demonstrated ability to work across multiple deployment environments, operating systems (preferred)
Company Overview
Company H1B Sponsorship