Note: The job is a remote job and is open to candidates in USA. Constructor is an AI-first ecommerce search and discovery platform that helps shoppers find products and enables global ecommerce brands to improve revenue and conversions. The Senior Machine Learning Engineer will improve search relevance by developing LLM-based relevance evaluations, real-time production models, and automated quality monitoring and insight systems.
Responsibilities
- LLM-based evaluation. We fine-tune our own models to assess relevance. This involves teaching the model to understand query intent, represent items from messy catalog data, and align model judgments with real user behavior
- Real-time quality in production. Reranking, filtering, signal computation. Latency is a strict requirement, so quality vs speed tradeoff is constant
- Automated quality monitoring and agentic insights. Pipelines to detect degradations and find underperforming patterns. Agent-based systems that generate actionable recommendations for the product data and search configurations
Skills
- 4+ years shipping production ML systems
- Experience with search, information retrieval, or recommendation systems
- Hands-on experience with fine-tuning, evaluation frameworks, and scaling LLM deployments
- Strong Python and PyTorch. Fluency in SQL and data orchestration tools (Spark, Airflow)
- Experience designing and running A/B tests to validate model impact
- Excellent English communication skills
- Experience collaborating in cross-functional teams (ranking, product, data engineering)
Benefits
- Work with smart and empathetic people who will help you grow and make a meaningful impact.
- Regular team offsite events to connect and collaborate.
- Fully remote team - choose where you live.
- Unlimited vacation time - we strongly encourage all of our employees take at least 3 weeks per year.
- Work from home stipend! We want you to have the resources you need to set up your home office.
- Apple laptops provided for new employees.
- Training and development budget for every employee, refreshed each year.
- Maternity & Paternity leave for qualified employees.
- Stock options - offered in addition to the base salary
Company Overview
Company H1B Sponsorship