We are sharing a specialised remote consulting opportunity for experienced Software Engineers and Open Source Contributors with strong expertise in backend development, algorithms, software debugging, codebase refactoring, automated testing, and performance optimisation to contribute their technical knowledge to advanced AI training and evaluation initiatives.
Selected professionals will develop realistic coding challenges, build reproducible reinforcement learning environments, implement deterministic verification systems, and produce high-quality reference solutions. The work combines practical software engineering expertise with complex codebase analysis, feature development, debugging, and structured technical evaluation to improve the coding and problem-solving capabilities of advanced AI systems. Prior experience with AI training projects is not required.
Key Responsibilities
Software Engineering & Coding Challenge Development
Develop realistic, technically challenging software engineering problems based on practical development scenarios
Create self-contained coding tasks involving feature implementation, bug fixing, refactoring, and performance optimisation
Apply professional expertise in Python, Java, Go, Rust, C++, TypeScript, or comparable programming languages
Analyse existing codebases and translate technical requirements into clear, implementable engineering objectives
Design coding challenges that reflect authentic software development workflows and engineering constraints
Reinforcement Learning Environments & Automated Verification
Build reproducible reinforcement learning environments designed to evaluate advanced AI coding capabilities
Develop deterministic verification systems that distinguish valid solutions from incorrect implementations
Create accurate golden reference solutions for assigned software engineering challenges
Implement automated tests and objective acceptance criteria to assess solution correctness
Ensure evaluation environments are reproducible, technically rigorous, and suitable for assessing different valid implementation approaches
Backend Development & Feature Implementation
Develop and evaluate backend services, APIs, and supporting application components
Implement robust software features while maintaining scalability, reliability, and code quality
Apply appropriate data structures, algorithms, and software design principles to complex engineering problems
Assess application architecture, system behaviour, and implementation decisions against technical requirements
Contribute practical software development insights to realistic programming and feature delivery scenarios
Debugging, Refactoring & Performance Optimisation
Analyse unfamiliar codebases to identify software defects, technical inconsistencies, and performance bottlenecks
Develop effective debugging strategies and implement appropriate software corrections
Refactor existing or legacy code to improve readability, maintainability, and long-term reliability
Evaluate computational efficiency, runtime behaviour, and relevant software performance characteristics
Validate engineering improvements through automated testing, reproducible execution, and technical analysis
Code Review, Documentation & Quality Assurance
Review submitted code and technical solutions for correctness, clarity, efficiency, and adherence to engineering standards
Evaluate peer-contributed implementations and provide structured, actionable technical feedback
Document programming decisions, debugging approaches, verification methods, and reference solutions
Communicate complex software engineering concepts clearly through technical explanations and written evaluations
Maintain high standards of reproducibility, implementation quality, and technical documentation across assigned deliverables
Ideal Profile
Significant hands-on software engineering experience, particularly in backend development and complex application systems
Demonstrated expertise in at least one of the following: Python 3, Java, Rust, Go, C++, or TypeScript
Strong understanding of algorithms, data structures, and foundational computer science principles
Proven experience developing scalable backend services, APIs, or production software applications
Practical expertise in software debugging, automated testing, code review, and technical problem-solving
Experience identifying and resolving complex software defects and performance bottlenecks
Demonstrated ability to implement substantial features within existing applications or large codebases
Strong understanding of codebase refactoring, software maintainability, and legacy system improvement
Experience developing reproducible tests and validating software implementations against technical requirements
Ability to design objective verification criteria and explain why a software solution satisfies specified constraints
Demonstrable open-source contributions through GitHub or a comparable public development profile are preferred; candidates without a sufficiently representative profile may complete a technical assessment
Experience collaborating on open-source software projects or reviewing external code contributions is highly relevant
Strong analytical reasoning, logical thinking, computational problem-solving, and independent engineering judgement
Ability to navigate unfamiliar codebases and understand complex software requirements efficiently
Excellent technical documentation skills, including the ability to explain algorithms, code changes, and implementation decisions clearly
Strong written communication and constructive code review capabilities
Experience working independently on technical assignments and producing reproducible software deliverables
Familiarity with reinforcement learning environments, AI coding benchmarks, or software engineering evaluation systems is advantageous
Interest in advanced AI technologies and automated software engineering is beneficial
Prior experience with AI training or model evaluation projects is not required
Engagement Details
Freelance / contract engagement
Fully remote — open worldwide
Compensation: $50–$100/hour advertised rate range
Payment Structure: Output-based compensation, with payment made per completed task that meets project specifications
Estimated Task Duration: Approximately 15 hours per task/run
Minimum weekly task submission requirements apply
100 available openings
Specialised software engineering consulting role spanning backend development, open-source software, reinforcement learning environments, and AI coding evaluation
Technical Focus: Python 3, Java, Rust, Go, C++, TypeScript, debugging, feature implementation, refactoring, and performance optimisation
Portfolio Requirement: Demonstrable open-source contributions through GitHub or a comparable profile; an alternative technical assessment may be used
Work will involve developing realistic coding challenges, building reproducible evaluation environments, implementing deterministic verifiers, and producing golden reference solutions
Assignments will require technically accurate implementations, automated validation, and clear documentation of engineering decisions
Selection may include screening questions, an approximately 20-minute AI interview, a technical assessment where applicable, and a hiring manager review
Assessment Requirement: Interview and assessment stages must be completed independently, without AI assistants or help from other individuals
Selected professionals should be prepared to begin initial assignments within 24–48 hours of completing onboarding
Prior experience with AI training projects is not required
Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy