Note: The job is a remote job and is open to candidates in USA. Optum is a global organization that delivers healthcare supported by technology, helping people live healthier lives and improving health equity. The Senior Data Engineer will design, develop, and maintain scalable data pipelines and AI-powered solutions while supporting healthcare data platforms, KTLO operations, cloud services, security, and system reliability.
Responsibilities
- Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
- Design, develop, and maintain scalable data pipelines using Python, PySpark, SQL, and Databricks
- Build and support batch and streaming data solutions using Kafka and Azure Data Factory
- Support KTLO activities including production support, incident resolution, vulnerability remediation, platform upgrades, and system reliability
- Implement automation and AI-enabled solutions to improve engineering efficiency and operational processes
- Optimize data models, queries, and large-scale data processing workloads
- Collaborate with business and technology partners to deliver high-quality data solutions
- Ensure compliance with security, governance, and healthcare data privacy requirements
- Contribute to CI/CD, monitoring, and cloud modernization initiatives
- Apply and promote data warehousing, data modeling, and database design best practices
- Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
Skills
- 5+ years of experience in Data Engineering, Software Engineering, or a related field
- 3+ years of experience with Python, SQL, Spark/PySpark, and Databricks
- 3+ years of experience with data warehousing, dimensional modeling, and database design
- 2+ years of experience with Azure Data Factory, Azure Data Lake, or related cloud data services
- 2+ years of experience with Apache Kafka or streaming technologies
- 2+ years of production support and KTLO experience, including troubleshooting and platform maintenance
- 1+ years of experience building data pipelines using Databricks Medallion Architecture
- 1+ years of experience with CI/CD, and automation practices
- Bachelor's degree in Computer Science, Information Systems, or related field
- Experience with Azure cloud technologies
- Experience with Airflow for workflow orchestration
- Experience with Docker, Kubernetes, Terraform, or Infrastructure as Code
- Experience with Power BI, Tableau, or Looker
- Experience working with healthcare data and HIPAA-regulated environments
- Experience with relational and NoSQL databases such as PostgreSQL, Cosmos DB, MongoDB, or Snowflake
- Strong analytical, problem-solving, and communication skills
Benefits
- Flexibility to telecommute from anywhere within the U.S.
- Comprehensive benefits package
- Incentive and recognition programs
- Equity stock purchase
- 401k contribution
- Career development opportunities
Company Overview
Company H1B Sponsorship