Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking a Data Engineer to build and maintain scalable data infrastructure. The role focuses on ETL pipelines, data preparation, exploratory analysis, data modeling, database solutions, and SQL optimization for AI and machine-learning initiatives.
Responsibilities
- Design, develop, and maintain scalable ETL pipelines
- Collect, clean, transform, and organize structured and unstructured data
- Conduct exploratory data analysis to identify trends, patterns, anomalies, and data-quality issues
- Collaborate with researchers, data scientists, and engineering teams to prepare datasets for AI and machine-learning initiatives
- Develop and maintain data models, database schemas, and data-storage solutions
- Write and optimize SQL queries for data extraction, transformation, and analysis
Skills
- Strong proficiency in Python and SQL
- Hands-on experience designing and maintaining ETL pipelines
- Experience conducting exploratory data analysis
- Proficiency with Python data-processing libraries such as Pandas and NumPy
- Experience working with relational databases, particularly PostgreSQL and MySQL
Company Overview