Note: The job is a remote job and is open to candidates in USA. OpenTrain AI engages part-time independent contractors to create and evaluate data engineering tasks for AI systems. The role involves developing expert solutions and explaining shortcomings in AI-generated work involving data pipelines, processing, databases, and data quality.
Responsibilities
- Create realistic data engineering tasks involving large-scale pipelines and data integration
- Review AI-generated solutions for Python processing and distributed data systems
- Write the expert solution for database optimization and data warehousing
- Explain where and why the AI falls short on reliability and data quality
Skills
- Hands-on experience with large-scale data pipelines, including their development and upkeep
- Advanced proficiency in Python for automating and integrating data processing
- Professional fluency in English, plus strong knowledge of relational and NoSQL databases and frameworks for distributed processing, including Hadoop, Spark or Flink
Benefits
- 100% remote; fully remote, United States
- Fully flexible schedule, with no fixed shifts
- Work directly with frontier AI tools and see how they are built, tested and improved
- Training on the tools
Company Overview