Note: The job is a remote job and is open to candidates in USA. Dice is hiring an L3 Cloudera Public Cloud Platform Engineer to support and operate large-scale Cloudera public cloud environments. The role focuses on complex troubleshooting, incident response, platform lifecycle management, NiFi data flow support, and collaboration with Cloudera support and infrastructure teams.
Responsibilities
- Leading P1/P2 incident response, triage, and resolution
- Managing platform upgrades, patching, and lifecycle events
- Supporting large-scale environments (TB/PB scale, high concurrency workloads)
- Lead complex troubleshooting and drive root cause resolution across platform layers
- Mentor and guide L2 engineers
- Coordinate with Cloudera support and infrastructure teams for critical issues
- Flow design and configuration
- Processor-level debugging and performance tuning
- Handling backpressure, throughput optimization, and failure recovery
- Platform operations and administration
- Job execution and service management (CDE/CDW/CDL)
- Automation of routine operational tasks8
Skills
- 12+ years of experience in Big Data Platform Engineering / Cloud Platform Operations / Infrastructure roles
- 6+ years of hands-on experience with Cloudera ecosystem (CDH/CDP/ Cloudera Public Cloud)
- Demonstrated ability to quickly learn and adapt to new technologies and evolving platform capabilities, beyond the currently defined CDP stack
- Strong expertise in:
- End-to-end CDP platform operations (CDE, CDW, CDF, CDL, CAI)
- Advanced troubleshooting across multi-cluster, multi-environment deployments
- Kubernetes-based runtime environments (troubleshooting and diagnostics)
- Observability frameworks, including SLIs/SLOs, alerting, and performance tuning
- Proven experience in:
- Leading P1/P2 incident response, triage, and resolution
- Managing platform upgrades, patching, and lifecycle events
- Supporting large-scale environments (TB/PB scale, high concurrency workloads)
- Strong understanding of:
- Cloud infrastructure (IAM, VPC, networking, storage)
- Security and governance (Ranger, Kerberos, TLS/SSL, SDX)
- Hands-on experience in developing and troubleshooting NiFi (CDF) data flows, including:
- Flow design and configuration
- Processor-level debugging and performance tuning
- Handling backpressure, throughput optimization, and failure recovery
- Strong experience with Cloudera CDP Public Cloud
- Expertise in:
- Cloud platforms (AWS/Azure/Google Cloud Platform)
- Kubernetes concepts (troubleshooting-focused)
- Hands-on with:
- CDE, CDW, CDF (NiFi), CAI
- Knowledge of:
- IAM, networking, observability tools
- Platforms operating at multi-terabyte to petabyte scale with high concurrency workloads
- Hands-on experience with:
- Kafka (or similar streaming platforms) including monitoring, troubleshooting, and performance tuning
- Experience with Cloudera CDP CLI (Command Line Interface) for:
- Platform operations and administration
- Job execution and service management (CDE/CDW/CDL)
- Automation of routine operational tasks8
- Strong working knowledge of:
- Cloud IAM (AWS IAM / Azure AD) including roles, policies, and cross-service access
- User and group mapping across CDP, cloud IAM, and Ranger policies
- Troubleshooting access issues across storage (S3/ADLS), CDP services, and data access layers
Benefits
- Remote work accepted from anywhere in US
Company Overview
Company H1B Sponsorship