Note: The job is a remote job and is open to candidates in USA. Optum is a global healthcare organization that uses technology to help people live healthier lives and improve health outcomes. The Senior Data Engineer will design and maintain scalable data pipelines, AI-powered solutions, and cloud data platforms while supporting KTLO activities, platform stability, security, automation, and healthcare data compliance.
Responsibilities
- Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
- Design, develop, and maintain scalable data pipelines using Python, PySpark, SQL, and Databricks
- Build and support batch and streaming data solutions using Kafka and Azure Data Factory
- Support KTLO activities including production support, incident resolution, vulnerability remediation, platform upgrades, and system reliability
- Implement automation and AI-enabled solutions to improve engineering efficiency and operational processes
- Optimize data models, queries, and large-scale data processing workloads
- Collaborate with business and technology partners to deliver high-quality data solutions
- Ensure compliance with security, governance, and healthcare data privacy requirements
- Contribute to CI/CD, monitoring, and cloud modernization initiatives
- Apply and promote data warehousing, data modeling, and database design best practices
- Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
Skills
- 5+ years of experience in Data Engineering, Software Engineering, or a related field
- 3+ years of experience with Python, SQL, Spark/PySpark, and Databricks
- 3+ years of experience with data warehousing, dimensional modeling, and database design
- 2+ years of experience with Azure Data Factory, Azure Data Lake, or related cloud data services
- 2+ years of experience with Apache Kafka or streaming technologies
- 2+ years of production support and KTLO experience, including troubleshooting and platform maintenance
- 1+ years of experience building data pipelines using Databricks Medallion Architecture
- 1+ years of Experience with CI/CD, and automation practices
- Bachelor's degree in Computer Science, Information Systems, or related field
- Experience with Azure cloud technologies
- Experience with Airflow for workflow orchestration
- Experience with Docker, Kubernetes, Terraform, or Infrastructure as Code
- Experience with Power BI, Tableau, or Looker
- Experience working with healthcare data and HIPAA-regulated environments
- Experience with relational and NoSQL databases such as PostgreSQL, Cosmos DB, MongoDB, or Snowflake
- Strong analytical, problem-solving, and communication skills
Benefits
- Comprehensive benefits package
- Incentive and recognition programs
- Equity stock purchase
- 401k contribution
- Career development opportunities
- The flexibility to telecommute from anywhere within the U.S.
Company Overview
Company H1B Sponsorship