Note: The job is a remote job and is open to candidates in USA. Penn Medicine, University of Pennsylvania Health System, is an academic medical center dedicated to patient care, innovative research, and medical education. The Senior Data Engineer will design scalable data products, analytical datasets, and measurement frameworks to evaluate the real-world impact of AI-enabled clinical technologies. The role also develops healthcare data pipelines, supports outcome-focused metrics and models, and collaborates with clinical, operational, analytics, and informatics stakeholders.
Responsibilities
- Data Integration and Processing: Design and architect scalable and reliable data pipelines to ingest, process, and transform large volumes of healthcare data from diverse sources, including electronic health records (EHR), clinical systems, research databases, and external data feeds
- ETL/ELT Development: Build and optimize ETL/ELT processes and work within Cloud technology such as Azure and Databricks to ensure efficient data extraction, transformation, and loading while maintaining data quality, consistency, and integrity. Collaborate with a variety of stakeholders across the organization to understand data requirements and translate them into effective ETL/ELT solutions that meet organizational goals
- Cloud Infrastructure and Technologies: Implement and maintain cloud-based data platforms and services, leveraging technologies such as AWS, Azure, or Databricks. Design and deploy data solutions using cloud-native services, such as Azure SQL Database, to support advanced analytics, machine learning, and data visualization initiatives
- Data Governance and Security: Enforce data governance policies, standards, and procedures to ensure compliance with regulatory requirements (e.g., HIPAA, GDPR) and organizational data security policies. Participate in implementation of metric standards, access controls, encryption, and auditing mechanisms to protect sensitive healthcare data and ensure data privacy and confidentiality
- Performance Monitoring: Monitor performance of data pipelines ETL/ELT processes, databases and data warehouses, troubleshoot issues, and implement optimizations to improve efficiency, reliability, and scalability
- Collaboration: Collaborate with cross-functional teams to define project requirements and develop solutions that meet organizational needs. Provide technical leadership and mentorship to junior data engineers and associate data engineers, fostering a culture of continuous learning and innovation within the data engineering team
- Continuous Improvement: Demonstrate a commitment to continuous learning and professional development. Stay current with industry trends, best practices, and emerging technologies in data engineering, ELT/ETL processes and data transformation. Look for opportunities to optimize the team’s processes and workflows
- Performs duties in accordance with Penn Medicine and entity values, policies, and procedures
- Other duties as assigned to support the unit, department, entity, and health system organization
Skills
- * Epic Clarity Data Model (must be completed within 6 months of start date
- * Bachelor's degree in Computer Science, Information Systems, or related field is required
- * 3+ years of experience in data engineering, database management, or related roles, with significant experience managing work is required
- * Proven track record of leading and executing moderately complex projects with minimal oversight is required
Benefits
- One of the finest prepaid tuition assistance programs in the region
Company Overview