Note: The job is a remote job and is open to candidates in USA. United Software Group Inc is seeking an L3 Cloudera Public Cloud Platform Engineer. The role is responsible for leading complex troubleshooting, incident response, platform operations, lifecycle management, and root cause resolution across Cloudera CDP environments. It also involves mentoring L2 engineers, coordinating with support and infrastructure teams, and developing and troubleshooting NiFi data flows.
Responsibilities
- Lead complex troubleshooting and drive root cause resolution across platform layers
- Mentor and guide L2 engineers
- Coordinate with Cloudera support and infrastructure teams for critical issues
- Flow design and configuration
- Processor-level debugging and performance tuning
- Handling backpressure, throughput optimization, and failure recovery
Skills
- 12+ years of experience in Big Data Platform Engineering / Cloud Platform Operations / Infrastructure roles
- 6+ years of hands-on experience with Cloudera ecosystem (CDH/CDP/ Cloudera Public Cloud)
- Demonstrated ability to quickly learn and adapt to new technologies and evolving platform capabilities, beyond the currently defined CDP stack
- Strong expertise in:
- End-to-end CDP platform operations (CDE, CDW, CDF, CDL, CAI)
- Advanced troubleshooting across multi-cluster, multi-environment deployments
- Kubernetes-based runtime environments (troubleshooting and diagnostics)
- Observability frameworks, including SLIs/SLOs, alerting, and performance tuning
- Proven experience in:
- Leading P1/P2 incident response, triage, and resolution
- Managing platform upgrades, patching, and lifecycle events
- Supporting large-scale environments (TB/PB scale, high concurrency workloads)
- Strong understanding of:
- Cloud infrastructure (IAM, VPC, networking, storage)
- Security and governance (Ranger, Kerberos, TLS/SSL, SDX)
- Hands-on experience in developing and troubleshooting NiFi (CDF) data flows, including:
- Flow design and configuration
- Processor-level debugging and performance tuning
- Handling backpressure, throughput optimization, and failure recovery
- Strong experience with Cloudera CDP Public Cloud
- Expertise in:
- Cloud platforms (AWS/Azure/GCP)
- Kubernetes concepts (troubleshooting-focused)
- Hands-on with:
- CDE, CDW, CDF (NiFi), CAI
- Knowledge of:
- IAM, networking, observability tools
- Platforms operating at multi-terabyte to petabyte scale with high concurrency workloads
- Hands-on experience with:
- Kafka (or similar streaming platforms) including monitoring, troubleshooting, and performance tuning
- Experience with Cloudera CDP CLI (Command Line Interface) for:
- Platform operations and administration
- Job execution and service management (CDE/CDW/CDL)
- Automation of routine operational tasks
- Strong working knowledge of:
- Cloud IAM (AWS IAM / Azure AD) including roles, policies, and cross-service access
- User and group mapping across CDP, cloud IAM, and Ranger policies
- Troubleshooting access issues across storage (S3/ADLS), CDP services, and data access layers
- Experience with:
- Modernization of legacy data platforms/applications to Cloudera CDP Public Cloud
- Migration and onboarding of workloads to CDE, CDW, and CAI environments
- Supporting hybrid or multi-environment transitions (on-prem → cloud)
- Familiarity with:
- Cloud platforms (AWS, Azure, GCP) including storage, IAM, and networking concepts
- Kubernetes-based runtime environments (troubleshooting-focused)
- Strong scripting and automation skills (Python, Shell, Terraform) for platform operations
Benefits
- Remote work accepted from anywhere in US
Company Overview
Company H1B Sponsorship