Note: The job is a remote job and is open to candidates in USA. Citizens Financial Group, Inc. is seeking a Principal Data Engineer for its technology organization. The role leads the design and improvement of scalable data architectures, pipelines, ETL processes, and data platforms while mentoring engineers and managing software development lifecycle activities.
Responsibilities
- Design scalable and reliable data architecture, leading complex technical design decisions for data pipelines and ETL processes, review implementations developed by team members and contract resources, mentor team members on best practices, and drive improvements to enhance performance, scalability, and reliability of data platforms
- Perform analysis and study of existing systems
- Create high level design documents to extract, transform, validate, and load ETL process data dictionaries, metadata descriptions, file layouts, and flow diagrams
- Gather business and application requirements, provide feedback on missing or contradictory requirements, plans and executes sprints
- Organize and manage all phases of the software development life cycle, including development, testing, and deployment of code into production
- Write technical documentation covering design and execution of parallel jobs, batch jobs, and sequencers for data migration
- Participate in code and design reviews with network, infrastructure and solutions engineering teams to ensure that solutions meet current enterprise standards
- Serve as a technical lead, mentoring and supervising more junior engineers
Skills
- Requires a Bachelor's degree, or foreign equivalent, in Computer Science, Electronic Engineering, or related field followed by 7 years of progressive experience as Senior Data Engineer, IT Consultant, or a related position
- Must have 7 years of experience with:
- Building data pipelines, datawarehouse solutions, and frameworks for accommodating end user reporting needs
- Collecting requirements, creating software designs, and developing efficient implementations using Agile Software Development Life Cycle
- Implementing data pipelines with using sources that include flat files, databases, APIs, and streaming applications
- Building ETL and data warehousing applications using IBM Datastage, Talend, and ODI
- Designing data enrichment frameworks and processing large amounts of data using Spark, Python, Talend, Datastage, ODI, Unix, PL-SQL, Teradata, AWS, and Java
- Designing, developing, and automating ETL processes to validate and perform reconciliations among multiple source systems using ETL tools, including Spark, Python, Talend, Datastage, ODI, Unix, PL-SQL, Teradata, AWS, and Java
- Utilizing programming languages including, Python, Unix, Java, JavaScript , C, and C++ to fetch data from rest APIs and retrieve security keys
- Utilizing AWS cloud services, including S3, Glue, Athena, Lake Formation, Lambda, EC2, RDS, EMR, Redshift, and IAM to migrate data to AWS Cloud
- Utilizing Cloud technologies, including AWS, AZURE, and GCP, to fetch data from AWS Cloud environments for processing in downstream systems
- Developing and integrating APIs using REST webservices
- Utilizing CICD tools, including Bitbucket, Github, and Jenkins
Benefits
- 100% remote work permitted from any US location.
Company Overview
Company H1B Sponsorship