Note: The job is a remote job and is open to candidates in USA. CVS Health is focused on creating a more connected, convenient, compassionate, and human-centric health care experience. The Principal Engineer, Data Platforms will serve as the senior technical authority for the architecture, engineering, governance, and evolution of a unified ingestion platform and federated data lake across multiple cloud environments. The role will lead enterprise Databricks strategy, platform modernization, security, governance, automation, optimization, and enablement of analytics and AI/ML workloads.
Responsibilities
- Define and own the architecture, strategy, and multi-year roadmap for the Unified Ingestion Platform and Federated Data Lake supporting observability, security, and operational telemetry data across the enterprise
- Architect and scale high-volume ingestion and processing capabilities supporting 250+ TB per day across logs, metrics, traces, security events, and operational datasets while driving platform modernization and convergence initiatives
- Establish and govern enterprise Databricks architecture, including multi-cloud account structures, workspace strategies, environment isolation, metadata management, data governance, lineage, and secure access models
- Lead implementation of Infrastructure-as-Code, Policy-as-Code, automated provisioning, and enterprise-grade CI/CD pipelines to enable reliable, standardized, and scalable platform operations
- Define enterprise security, governance, observability, reliability, and operational excellence practices while aligning platform standards with OpenTelemetry (OTEL), Open Cybersecurity Schema Framework (OCSF), and enterprise compliance requirements
- Serve as the highest-level technical escalation point and provide architectural leadership across engineering, security, infrastructure, and platform teams
- Establish FinOps strategies, cost allocation frameworks, resource optimization practices, and capacity planning models to ensure efficient and cost-effective platform operations
- Mentor engineers and architects while driving adoption of cloud-native engineering principles, automation frameworks, governance standards, and platform best practices
- Evaluate emerging technologies and develop strategic roadmaps that improve platform scalability, reliability, governance, developer productivity, and operational efficiency
- Enable advanced analytics, security analytics, observability intelligence, and AI/ML workloads through trusted, governed, and reusable enterprise data platform capabilities
Skills
- 10+ years of experience architecting, building, and operating enterprise-scale cloud data platforms, data lakes, distributed systems, and large-scale data ingestion ecosystems supporting mission-critical workloads
- 8+ years of experience designing and administering Databricks platforms, including Apache Spark, Delta Lake, Unity Catalog, secure data access patterns, metadata management, lineage, and enterprise governance frameworks
- 8+ years of experience implementing Infrastructure-as-Code, platform automation, CI/CD pipelines, and Policy-as-Code controls using technologies such as Terraform, GitHub Actions, or comparable cloud-native automation platforms
- 7+ years of experience designing and operating high-scale streaming and telemetry ingestion architectures processing more than 100 TB per day using technologies such as Kafka, Event Hub, Kinesis, Pub/Sub, NiFi, Cribl, or similar platforms
- 5+ years of experience serving as a Principal Engineer, Lead Architect, or equivalent technical leadership role driving enterprise platform strategy, multi-cloud architecture across Azure, AWS, and Google Cloud Platform, engineering standards, security governance, and large-scale transformation initiatives resulting in measurable improvements in scalability, reliability, operational efficiency, governance maturity, and platform adoption
- Bachelor's degree from accredited university or equivalent work experience (HS diploma + 4 years relevant experience)
- Extensive experience building and evolving enterprise-scale data platforms, analytics ecosystems, observability platforms, or cloud-native engineering platforms within large and highly regulated environments
- Hands-on expertise with Unity Catalog, Delta Sharing, metadata services, lineage frameworks, information stewardship, retention controls, and federated operating models
- Proven success driving Splunk rationalization efforts, security analytics modernization, SIEM ecosystems, telemetry consolidation, or monitoring transformation programs
- Strong background designing secure serverless computing environments, multi-tenant architectures, workload isolation strategies, and Databricks deployments spanning Azure, AWS, and Google Cloud Platform
- Demonstrated success establishing FinOps disciplines, consumption governance, chargeback methodologies, provisioning automation, and resource optimization programs that improve efficiency and operational simplicity
- Databricks certifications (Data Engineer, Data Architect, Platform Architect, or equivalent) coupled with knowledge of AI/ML enablement, advanced analytical workloads, OpenTelemetry (OTEL), and Open Cybersecurity Schema Framework (OCSF) standards
Benefits
- CVS Health bonus, commission or short-term incentive program in addition to the base pay range
- An award target in the company's equity award program
- Medical coverage
- Dental coverage
- Vision coverage
- Paid time off
- Retirement savings options
- Wellness programs
- Other resources, based on eligibility
Company Overview
Company H1B Sponsorship