Note: The job is a remote job and is open to candidates in USA. Adroit Innovative Solutions Inc is seeking a Senior/Lead Cloudera/Hadoop Migration Engineer to lead migration projects from on-premises Hadoop/Cloudera environments to AWS. The role involves designing AWS Big Data solutions, leading data migration and application re-platforming, ensuring platform performance and security, troubleshooting issues, collaborating with cross-functional teams, and mentoring engineers.
Responsibilities
- Analyze existing Cloudera/Hadoop architecture and data pipelines
- Develop and execute Hadoop-to-AWS migration strategies
- Design AWS solutions using EMR, Glue, Airflow, Lambda, etc
- Lead data migration, application re-platforming, testing, and validation
- Ensure performance, scalability, security, and reliability
- Troubleshoot platform, software, and data-pipeline issues
- Work with Engineering, Infrastructure, DevOps, QA, Product, Content, and Business teams
- Prepare migration plans, documentation, and operational runbooks
- Mentor engineers on AWS Big Data and engineering best practices
Skills
- 10+ years of experience with Hadoop/Big Data and enterprise application design
- Strong hands-on experience with Cloudera Hadoop
- Strong knowledge of HDFS, Hive, Spark, Oozie, and Python
- Strong AWS Big Data experience
- Experience migrating on-premises Cloudera/Hadoop to AWS
- Experience with AWS EMR, Glue, Airflow, and Lambda
- Strong Bash/Shell scripting
- Experience with Terraform / Infrastructure as Code
- Experience with data migration, application re-platforming, testing, and validation
- Knowledge of cloud security, governance, compliance, scalability, and performance
- 5+ years of experience with tools such as Bitbucket, Gradle, Octopus, and Artifactory
- Knowledge of XML/JSON
- Monitoring and logging experience
- Strong communication and stakeholder management skills
- Experience creating migration plans, technical documentation, and runbooks
- Ability to mentor engineers and provide technical leadership
- Healthcare / claims data experience
- AWS certifications
Benefits
- 100% Remote
Company Overview
Company H1B Sponsorship