Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking a Big Data Engineer for an hourly contract role. The engineer will design, build, and maintain scalable data pipelines and architectures, develop data integration and processing solutions, optimize distributed databases, and ensure data systems meet quality, security, governance, availability, and performance standards.
Responsibilities
- Design, build, and maintain scalable big data pipelines and architectures
- Collaborate with cross-functional teams to understand data requirements and business objectives
- Implement data integration, transformation, and processing solutions using Python and big data technologies
- Develop, manage, and optimize distributed databases and storage systems
- Monitor, troubleshoot, and improve data systems for high availability and performance
- Enforce data quality, security, and governance standards across data solutions
- Document technical solutions and communicate complex data concepts clearly
Skills
- Strong experience building and maintaining large-scale data pipelines and big data solutions
- Advanced proficiency in Python for data processing, automation, and integration
- Strong knowledge of relational and NoSQL databases, including optimization and management
- Experience with distributed data processing frameworks such as Hadoop, Spark, or Flink
- Strong understanding of data modeling, ETL processes, and data warehousing principles
- Excellent written and verbal communication skills for technical and non-technical audiences
- Ability to work independently with strong attention to detail, initiative, and reliability
Benefits
- Remote work
Company Overview