Position: iOS / Swift Developer (AI Model Evaluation & Code Quality) | Remote
Position: Software Engineering, Data Science, and Systems Design Experts, Swift (5+ YOE)
Type: Hourly contract
Compensation: $60–$100/hour
Location: Remote
Commitment: Full-time or part-time, flexible based on project work
Role Responsibilities
• Evaluate AI-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness
• Perform fact-checking using reliable public sources and references
• Execute code to validate correctness and test outputs
• Annotate responses by identifying strengths, issues, and inaccuracies
• Assess code quality, readability, and algorithmic soundness
• Ensure responses align with best practices and expected system behavior
• Follow structured evaluation guidelines, benchmarks, and taxonomies
Requirements
• Strong experience in software engineering or related technical roles
• Strong expertise in Swift
• Ability to solve medium to hard coding problems independently
• Strong experience contributing to open-source projects
• Strong experience using LLMs for coding and understanding their limitations
• Strong attention to detail in evaluating technical reasoning and identifying issues
• Strong written communication skills for clear technical feedback
• Degree in Computer Science or related field
#J-18808-Ljbffr