Note: The job is a remote job and is open to candidates in USA. Optum delivers technology-enabled care and health services that help millions of people live healthier lives. The Senior Data Engineer will design, develop, and maintain scalable data pipelines and AI-powered solutions while supporting data platforms, KTLO activities, cloud modernization, security, and healthcare data privacy requirements.
Responsibilities
- Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
- Design, develop, and maintain scalable data pipelines using Python, PySpark, SQL, and Databricks
- Build and support batch and streaming data solutions using Kafka and Azure Data Factory
- Support KTLO activities including production support, incident resolution, vulnerability remediation, platform upgrades, and system reliability
- Implement automation and AI-enabled solutions to improve engineering efficiency and operational processes
- Optimize data models, queries, and large-scale data processing workloads
- Collaborate with business and technology partners to deliver high-quality data solutions
- Ensure compliance with security, governance, and healthcare data privacy requirements
- Contribute to CI/CD, monitoring, and cloud modernization initiatives
- Apply and promote data warehousing, data modeling, and database design best practices
- Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
Skills
- 5+ years of experience in Data Engineering, Software Engineering, or a related field
- 3+ years of experience with Python, SQL, Spark/PySpark, and Databricks
- 3+ years of experience with data warehousing, dimensional modeling, and database design
- 2+ years of experience with Azure Data Factory, Azure Data Lake, or related cloud data services
- 2+ years of experience with Apache Kafka or streaming technologies
- 2+ years of production support and KTLO experience, including troubleshooting and platform maintenance
- 1+ years of experience building data pipelines using Databricks Medallion Architecture
- 1+ years of Experience with CI/CD, and automation practices
- Bachelor's degree in Computer Science, Information Systems, or related field
- Experience with Azure cloud technologies
- Experience with Airflow for workflow orchestration
- Experience with Docker, Kubernetes, Terraform, or Infrastructure as Code
- Experience with Power BI, Tableau, or Looker
- Experience working with healthcare data and HIPAA-regulated environments
- Experience with relational and NoSQL databases such as PostgreSQL, Cosmos DB, MongoDB, or Snowflake
- Strong analytical, problem-solving, and communication skills
Benefits
- Flexibility to telecommute from anywhere within the U.S.
- Comprehensive benefits package
- Incentive and recognition programs
- Equity stock purchase
- 401k contribution
- Career development opportunities
- Development for other roles you may be interested in
Company Overview
Company H1B Sponsorship