Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking a Senior Software Engineer specializing in Python and TypeScript for a part-time contractor assignment. The role focuses on building AI data generation and evaluation infrastructure, developing preference-data rubrics, reviewing labeled data, and translating technical findings into scalable processes and recommendations.
Responsibilities
- Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows
- Design, refine, and iterate on rubrics and evaluation criteria for preference data
- Review and label preference data while identifying subtle quality issues
- Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes
- Synthesize technical findings into clear, actionable write-ups, updates, and recommendations
Skills
- 5+ years of experience with Python, TypeScript, Golang, or JavaScript, particularly building and maintaining pipelines or infrastructure
- Hands-on experience with preference data collection and/or rubric creation
- Experience navigating or contributing to large codebases
- Experience with codebases such as VSCode is a plus
- Experience with AI/LLM evaluation or related engineering workflows
Benefits
- Remote work arrangement
Company Overview