Note: The job is a remote job and is open to candidates in USA. 24-MAG is offering a specialized part-time consulting opportunity for experienced machine learning engineers focused on AI coding agents. The role involves evaluating coding models, reviewing implementations, and conducting technical assessments within realistic ML engineering workflows.
Responsibilities
- Review complex machine learning and AI engineering tasks completed with frontier coding agents
- Evaluate implementations involving model training, inference systems, MLOps, and LLM applications
- Assess technical correctness, architecture choices, implementation quality, and engineering trade-offs
- Apply professional ML engineering judgment to realistic production-oriented scenarios
- Use AI coding agents as part of hands-on technical workflows
- Evaluate how effectively coding models interpret requirements and implement solutions
- Identify bugs, incomplete implementations, edge cases, and unexpected behaviour
- Assess where models require additional prompting, correction, or manual engineering intervention
- Identify performance issues, reliability problems, and model failure modes
- Review generated code for maintainability, correctness, and practical usability
- Evaluate whether implementations would function appropriately in realistic ML environments
- Document technical strengths, weaknesses, and important implementation risks
- Compare outputs produced by multiple frontier coding models
- Assess differences in implementation strategy, code quality, technical reasoning, and reliability
- Determine which approaches best satisfy task requirements
- Provide clear written assessments explaining relevant engineering trade-offs
Skills
- At least 2 years of professional machine learning engineering experience
- Experience building production ML systems, AI-powered applications, or model-serving infrastructure
- Hands-on experience with model training, inference, deployment, or MLOps
- Experience developing LLM applications or integrating foundation models into production systems
- Regular use of AI coding agents within software or machine learning development workflows
- Strong ability to evaluate model-generated code and technical implementation decisions
- Excellent debugging, analytical reasoning, and written communication skills
- Ability to work efficiently within short, intensive project sprints
- A degree in computer science, machine learning, artificial intelligence, software engineering, or a related technical discipline may be helpful
- Advanced study in machine learning or computer science may strengthen an application
- Equivalent professional experience building and deploying production ML systems may also be considered
- Practical engineering depth is particularly important for this engagement
- Experience with Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or comparable AI coding tools
- Production experience deploying machine learning models
- Familiarity with model-serving architectures and inference optimisation
- Experience building LLM-powered applications or agentic systems
- Knowledge of MLOps, deployment pipelines, monitoring, or model infrastructure
- Experience evaluating generated code across multiple AI coding systems
- Previous exposure to AI evaluation, benchmark development, or structured technical review
Benefits
- Fully remote with flexible scheduling
- Weekly payments via Stripe or Wise
Company Overview