Note: The job is a remote job and is open to candidates in USA. Kforce Inc.'s client is seeking a senior data engineer to design, develop, test, and support enterprise data ingestion pipelines. The role focuses on data integration across Kafka, relational databases, mainframe systems, AWS, and Snowflake, while collaborating with technical and business stakeholders and supporting downstream AI and analytics initiatives.
Responsibilities
- Design, develop, test, and maintain data ingestion pipelines from a variety of source systems
- Analyze source systems, schemas, and DDL to develop accurate and scalable source-to-target mappings
- Build ingestion solutions for technologies including Kafka, relational databases, mainframe systems, and flat files
- Implement data pipelines that replicate and integrate data into AWS and Snowflake environments
- Perform QA/QC throughout the development lifecycle, including source-to-target data validation and testing
- Develop and maintain data integration processes using enterprise ETL and replication tools
- Work with business users, technical teams, and leadership to gather requirements and translate them into effective data solutions
- Follow established Git, CI/CD, and collaborative development practices
- Support data initiatives that contribute to downstream AI, analytics, and strategic data projects
- Troubleshoot and support data pipelines while ensuring data quality, reliability, and integrity
Skills
- • Strong software development and data engineering fundamentals
- • Experience designing and developing data ingestion pipelines
- • Strong understanding of data integration and enterprise ETL tools
- • Kafka experience is required
- • Hands-on experience with AWS, particularly AWS Lambda
- • Strong Python development experience, including Python frameworks used for data engineering
- • Experience with Snowflake, including stored procedures and user-defined functions
- • Experience with Qlik Replicate or a comparable data replication/integration platform
- • Experience with Git and CI/CD pipelines
- • Strong understanding of data modeling, schemas, DDL, and source-to-target mappings
- • Ability to work independently with minimal supervision and navigate ambiguous requirements
- • Strong communication skills and the ability to work effectively with technical teams, business users, and leadership
- Qlik Replicate is required, although strong experience with a comparable ETL or data replication tool may be considered, as the manager believes transferable experience can translate quickly to the Qlik platform
- • Additional experience with AWS services such as S3
- • Experience working with data from mainframe systems and flat files
- • Experience supporting data engineering initiatives related to AI and advanced analytics
- • Experience in large, complex enterprise environments
Benefits
- Remote work arrangement
- Medical, dental, and vision insurance for eligible employees
- Health Savings Account (HSA) for eligible employees
- Flexible Spending Account (FSA) for eligible employees
- 401(k) for eligible employees
- Life, disability, and ADD insurance for eligible employees
- Paid time off for salaried personnel
- Paid sick leave for hourly employees on a Service Contract Act project
Company Overview
Company H1B Sponsorship