Note: The job is a remote job and is open to candidates in USA. Cohere is a security-first enterprise AI company that builds foundation AI models and end-to-end products for real-world business problems. The Member of Technical Staff will ensure the quality, reliability, and performance of large language models by designing data collection tasks, evaluating datasets, analysing model robustness, and collaborating with cross-functional teams. The role also involves training and fine-tuning LLMs and conducting experiments to improve model performance.
Responsibilities
- Design and oversee data collection tasks, including supporting human annotators and ensuring data quality
- Develop and apply statistical methods to evaluate the quality and reliability of datasets
- Analyse and assess the generalisability and robustness of ML systems across diverse use cases
- Collaborate with teams to improve dataset quality and model performance
- Train and fine-tune large language models (LLMs) on distributed training infrastructures
- Conduct experiments to evaluate model performance and identify areas for improvement
Skills
- Extremely strong software engineering skills
- Strong expertise in designing and conducting data collection tasks, including working with human annotators
- Strong statistical skills and experience evaluating scientific experiments related to data collection and model performance
- Experience analysing datasets with respect to their quality, biases, and suitability for training ML models
- Hands-on experience training large language models (LLMs) on distributed training infrastructures
- Familiarity with evaluating and improving the generalisability and robustness of ML systems
- Proficiency in programming languages such as Python and ML frameworks (e.g., PyTorch, TensorFlow, JAX)
- Excellent communication skills to collaborate effectively with cross-functional teams and present findings
- One or more papers at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)
- This role can be based remotely or from one of our office locations listed on the job description - there is no minimum in-office qualification requirement
Benefits
- A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
- Full health and dental benefits, including a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months, for either parent.
- Annual enrichment benefits: arts and culture, fitness/wellness, quality time, and a workspace improvement credit.
- Education and learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days).
- Budget for traveling to other offices if you are remote, plus an annual company offsite.
- A daily lunch program, plenty of snacks, and regular community and social events for those in the office.
- A co-working benefit for those not near an office.
- Everyone receives a $500 home office stipend to set up their workspace properly.
- Remote-friendly work arrangement.
Company Overview
Company H1B Sponsorship