About the Company
AfterQuery is an AI research lab that explores the capabilities and limitations of artificial intelligence through experimentation and specialized datasets. The company works with leading AI labs and focuses on high-quality, expert-generated data to improve AI systems.
About the Role
AfterQuery is seeking experienced ML Research Engineers specializing in inference systems and GPU kernel engineering to evaluate advanced AI models on complex technical problems. This is a remote, contract-based research and evaluation role focused on defining technical standards, developing reference solutions, and assessing AI-generated responses rather than building production software.
The role is designed for senior professionals with deep expertise in machine learning inference, inference serving systems, kernel optimization, or large-model deployment infrastructure.
Key Responsibilities
Design realistic, challenging technical scenarios and problem sets within your area of expertise.
Develop expert-level reference solutions and detailed grading rubrics for evaluating AI-generated responses.
Assess AI outputs for technical correctness, depth, reasoning quality, and sound domain judgment.
Write clear technical explanations and structured feedback to help evaluate model capabilities.
Apply hands-on experience in ML inference, GPU kernels, or large-model deployment to establish standards for excellent technical work.
Work independently in an asynchronous remote environment to complete research and evaluation tasks.
Required Qualifications
6–10 years of relevant professional or research experience.
A PhD or doctorate, or a master's degree supported by a strong research record.
Current or recent hands-on experience in the relevant technical field, rather than purely academic-adjacent involvement.
Strong written communication skills, including the ability to produce technical explanations and structured evaluations.
Ability to work independently in a flexible, asynchronous, remote setting.
Preferred Qualifications
Research publications, open-source contributions, or recognized work demonstrating expertise in the relevant domain.
Experience evaluating or reviewing technical work through peer review, code review, grading, or editing.
Experience with ML inference and serving technologies such as SGLang, vLLM, Mamba/Mamba2, or TensorRT-LLM.
Practical experience in GPU kernel engineering and optimization.
Salary & Benefits
Hourly compensation: $100–$170, depending on experience. The listing highlights a rate of $135 per hour.
Fully remote work with flexible, asynchronous scheduling.
Opportunity to contribute to frontier AI research and evaluate advanced AI models.
Flexible work arrangements that can accommodate existing professional commitments.
Work Location
Remote. The role is listed in Draper, Utah, and is structured as a contract opportunity.
Additional Information
Candidates who meet the stated qualifications and submit the requested materials may receive priority consideration. The hiring process includes thorough background checks.