Note: The job is a remote job and is open to candidates in USA. CTG delivers IT and business solutions that enhance clients’ digital agility. The Senior Data Engineer will design, implement, and maintain scalable cloud data platforms, pipelines, architectures, and integration solutions using big data technologies, while ensuring data security, governance, quality, and reliability.
Responsibilities
- Design and implement scalable data solutions using big data and cloud technologies, including Python, PySpark, and Kafka
- Develop real-time data ingestion and processing solutions
- Build and maintain ETL/ELT pipelines for analytics and reporting
- Develop data integration and migration strategies for transitioning legacy systems to the cloud
- Design and maintain scalable data architectures, data models, and data warehouse solutions
- Ensure data security, integrity, governance, and quality
- Monitor and troubleshoot data platform performance, availability, reliability, and scalability
- Manage data security, access controls, roles, permissions, encryption, and regulatory requirements
- Collaborate with cross-functional teams to understand data requirements and deliver effective solutions
Skills
- Python, PySpark, Kafka, and strong SQL
- GCP cloud data engineering technologies
- Data warehousing, data modeling, data governance, data quality, and data architecture
- ETL/ELT, real-time data processing, and large-scale structured/unstructured data
- CI/CD tools, including GitHub
- Scalable data architecture, cloud migration, and data integration
- 5–9 years of professional data engineering experience
- Experience implementing databases and data warehouses
- Strong SQL skills, including writing and optimizing complex queries
- Hands-on experience with Python, PySpark, Kafka, and GCP
- Experience handling large-scale data from internal and third-party sources
- Experience designing, implementing, and maintaining scalable data platforms and architectures
- Bachelor's degree in Engineering or Master's degree in Computer Science, Information Systems, or a related field
- Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group
- Snowflake and PostgreSQL preferred
Benefits
- Remote work arrangement
- A competitive benefit package
- A workplace where you are encouraged to grow, supported in your ambitions, and empowered to shape your own career journey
Company Overview
Company H1B Sponsorship