Note: The job is a remote job and is open to candidates in USA. Cleartelligence is seeking a Senior Data Engineer to support a large-scale data migration initiative. The role builds and maintains Python-based ingestion and ETL pipelines, moves data from legacy and enterprise systems into SQL databases, and supports reliable downstream reporting and analytics.
Responsibilities
- Design, develop, and maintain Python-based data ingestion and ETL pipelines
- Extract data from legacy/homegrown securities platforms, REST APIs, MySQL, PostgreSQL, Microsoft System Center, MDM tools, and similar enterprise systems
- Develop Python scripts to transform, validate, and load data into MySQL and PostgreSQL databases
- Support migration of existing data feeds into a new environment while ensuring data quality and reliability
- Monitor, troubleshoot, and optimize data pipelines
- Collaborate with engineering and business stakeholders to implement scalable data solutions
- Document data flows, processes, and technical solutions
Skills
- 7+ years of Data Engineering and Python development experience
- Expert-level Python programming
- Experience working with Fabric
- Strong ETL/data ingestion pipeline experience
- Experience with APIs, MySQL, and PostgreSQL
- Strong SQL skills
- Experience using Git/GitHub
- Securities and vulnerability type of data analysis/management experience
- Ability to work independently with minimal oversight
- Strong analytical and troubleshooting skills
Company Overview