Applications Developer - ETL/Pyspark - Assistant Vice President

We are seeking an enthusiastic, detail-oriented ETL Developer to join our data engineering team. In this role, you will be designing, developing, and maintaining scalable data pipelines using PySpark, Talend, and Ab Initio. You will work closely with senior developers to transform raw data into valuable business insights, ensuring optimal data quality and performance

• ETL Pipeline Development:Building and maintaining Extraction, Transformation, and Loading (ETL) workflows
• Big Data Processing:Utilize PySpark for data processing, manipulation, and analysis within big data ecosystems.
• Data Extraction & Ingestion:Extract data from multiple sources including relational databases (SQL), flat files etc.
• Data Transformation:Create mapping documents and apply business logic to transform large datasets.
• Performance Tuning:Assist in analyzing and optimizing existing ETL jobs and Spark scripts for better scalability and execution speed.
• Testing & Documentation:Perform unit testing, validate data accuracy, and maintain technical documentation for all ETL processes.
• Production Support:Help monitor scheduled daily/weekly jobs and troubleshoot data integration or quality issues

Recommended Qualifications:

• 8-10 years of relevant experience
• Experience in systems analysis and programming of software applications
• Programming Languages:Proficiency inPysparkandSQL.
• Big Data Frameworks:Hands-on experience or strong conceptual understanding ofPySpark.
• ETL Tools:Familiarity with Data Integration/Big Data tools andAb Initiocomponents.
• Scripting:Basic to intermediate knowledge ofUnix/Linux Shell Scripting.
• Databases:Understanding of Big Data (Hadoop) & RDBMS like Oracle, or PostgreSQL
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

Education:

• Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Job Family Group:

Technology

Job Family:

Applications Development

Time Type:

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity reviewAccessibility at Citi.

View Citi’sEEO Policy Statementand theKnow Your Rightsposter.

Originally posted on