Note: The job is a remote job and is open to candidates in USA. The Ai Training Company is seeking experienced machine learning and AI engineering professionals to evaluate and improve frontier AI coding agents. The role involves completing and reviewing realistic machine learning workflows, debugging AI-generated code, evaluating production ML systems, and assessing technical correctness, scalability, reliability, and performance.
Responsibilities
- Use frontier AI coding agents to complete complex machine learning engineering tasks
- Review AI-generated implementations for correctness, scalability, reliability, and performance
- Evaluate model training, inference, deployment, and production ML workflows
- Identify bugs, edge cases, architectural weaknesses, performance bottlenecks, and failure modes
- Compare outputs from multiple AI coding models
- Assess technical tradeoffs and determine which implementation is stronger
- Debug AI-generated Python, ML, data, and infrastructure code
- Apply real-world engineering judgment to production-style AI and ML scenarios
- Provide structured technical evaluations and clear written reasoning
- Test whether generated solutions actually work in realistic environments
Skills
- Machine Learning Engineers, Senior Machine Learning Engineers, ML Engineers, AI Engineers, Artificial Intelligence Engineers, Applied AI Engineers, LLM Engineers, Generative AI Engineers, Deep Learning Engineers, Applied Machine Learning Engineers, and AI Software Engineers
- MLOps Engineers, ML Platform Engineers, Machine Learning Infrastructure Engineers, AI Infrastructure Engineers, Model Deployment Engineers, Model Serving Engineers, ML Systems Engineers, ML Reliability Engineers, ML Production Engineers, AI Platform Engineers, and Model Operations Engineers
- LLM Application Engineers, LLMOps Engineers, AI Agent Engineers, Agentic AI Engineers, RAG Engineers, Prompt Engineers with strong coding experience, AI Product Engineers, AI Backend Engineers, Conversational AI Engineers, NLP Engineers, and Foundation Model Engineers
- Data Scientists, Applied Scientists, Research Engineers, Research Scientists, Computer Vision Engineers, NLP Engineers, Speech ML Engineers, Recommendation Engineers, Ranking Engineers, Search Engineers, Data Engineers, Backend Engineers, Software Engineers, Platform Engineers, and Distributed Systems Engineers with strong production machine learning experience
- Experience with one or more of the following is valuable: • Model training and fine-tuning
- • Deep learning
- • Supervised and unsupervised learning
- • Transformer architectures
- • Large language models
- • Retrieval-augmented generation
- • AI agents and tool use
- • Model inference and serving
- • Batch and real-time prediction systems
- • Feature engineering and feature stores
- • Model evaluation and benchmarking
- • Experiment tracking
- • Hyperparameter optimization
- • Data preprocessing and training pipelines
- • Distributed training
- • GPU-based workloads
- • Model monitoring and observability
- • Model versioning
- • Production ML pipelines
- • ML API development
- • Scalability and latency optimization
- • Failure analysis and debugging
- • AI safety and model evaluation
- • 2+ years of professional machine learning engineering or closely related experience
- • Hands-on experience building real ML, AI, or data-driven software systems
- • Experience with model training, production inference, ML infrastructure, LLM applications, or AI-powered products
- • Strong Python programming skills
- • Ability to understand and debug unfamiliar machine learning codebases
- • Familiarity with modern AI coding agents
- • Ability to evaluate AI-generated implementations and technical tradeoffs
- • Strong understanding of software engineering fundamentals
- • Strong debugging, analytical, and technical reasoning skills
- • Clear written communication and attention to detail
- Experience deploying machine learning systems to production
- Experience operating high-scale or latency-sensitive inference systems
- Experience with MLOps and ML platform infrastructure
- Experience building LLM, RAG, or AI agent applications
- Experience with distributed training or GPU workloads
- Experience reviewing code written by other ML engineers
- Experience designing ML benchmarks or evaluation frameworks
- Experience with model observability, monitoring, and production debugging
- Prior work evaluating AI-generated code or frontier coding agents
- Experience with research-to-production machine learning workflows
- Regular use of AI coding tools is strongly preferred, including: Cursor, Claude Code, Codex, Windsurf, Gemini CLI, GitHub Copilot, Cline, Roo Code, Aider, Replit, or similar AI coding agents
Company Overview