We are sharing a specialised consulting opportunity for experienced Senior Software Engineers with strong expertise in system design, code review, debugging, algorithms, data structures, and software architecture to contribute to an advanced AI training and software engineering evaluation project.
Selected professionals will evaluate AI-generated code, create challenging engineering problems and reference solutions, assess reasoning across architecture and debugging scenarios, and provide detailed technical feedback grounded in real-world software engineering practice. The work requires strong technical judgement, rigorous problem-solving ability, and the ability to explain complex engineering decisions clearly in writing.
Key Responsibilities
AI-Generated Code Evaluation
Review AI-generated code for correctness, quality, maintainability, and design
Identify bugs, logical errors, poor abstractions, and implementation weaknesses
Assess whether solutions handle relevant edge cases and constraints
Evaluate code quality against professional software engineering standards
Distinguish functionally correct solutions from implementations with architectural or maintainability issues
Coding Problems & Reference Solutions
Create challenging software engineering and coding problems
Develop high-quality reference solutions demonstrating robust engineering practice
Design comprehensive test cases covering expected behaviour, edge cases, and failure conditions
Apply algorithms and data structures appropriately to problem requirements
Ensure tasks meaningfully test advanced engineering capability rather than superficial syntax knowledge
System Design & Architecture Review
Evaluate model reasoning involving system design and software architecture
Assess scalability, reliability, maintainability, and technical trade-offs
Identify architectural weaknesses, unrealistic assumptions, or missing system constraints
Compare alternative designs and explain relevant engineering compromises
Apply practical judgement grounded in production software environments
Debugging & Technical Reasoning
Review AI reasoning across debugging and troubleshooting scenarios
Identify incorrect diagnoses, incomplete root-cause analysis, and unsupported conclusions
Analyse complex software failures and recommend robust corrective approaches
Evaluate whether proposed fixes introduce regressions or long-term maintenance risks
Provide clear explanations of technical decisions and debugging methodology
Expert Feedback & Model Improvement
Deliver detailed technical feedback on AI-generated solutions and reasoning
Explain strengths, weaknesses, and potential improvements precisely
Identify recurring patterns of technical failure or weak reasoning
Contribute high-quality evaluation material that improves model performance
Maintain consistent review standards across diverse engineering scenarios
Ideal Profile
At least 1 year of professional experience as a software engineer at a top-tier or highly regarded technology company
At least part of the relevant engineering experience should have been gained within approximately the past 7 years
Strong expertise in system design and software architecture
Excellent code-review and debugging skills
Deep understanding of algorithms and data structures
Strong ability to reason about correctness, scalability, maintainability, and performance
Experience developing or reviewing production-grade software systems
Ability to create rigorous coding problems, reference solutions, and test cases
Excellent written communication and ability to explain technical decisions clearly
Undergraduate degree from a highly ranked university is preferred
Candidates based in English-speaking countries are preferred
Engagement Details
Independent contractor engagement
Fully remote
Compensation: $245–$280/hour
Work will involve AI-generated code evaluation, engineering problem creation, reference-solution development, system-design review, debugging, and technical feedback
Strong professional software engineering experience and written technical communication are central to this engagement
Assignments may involve algorithms, data structures, architecture, debugging, code quality, and production engineering scenarios
Project scope, workload, technical focus, and evaluation standards may evolve depending on project requirements
Work must be completed without using confidential or proprietary information belonging to any employer, client, technology company, institution, or other third party
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy