Note: The job is a remote job and is open to candidates in USA. Innodata is a global data engineering company focused on enabling the responsible advancement of artificial intelligence through data, evaluation frameworks, and human expertise. The Research Data Scientist – GenAI/LLM will conduct research-driven AI/ML initiatives, design experiments and evaluation methodologies, analyze complex datasets, build research prototypes, and translate findings into practical solutions. The role also involves developing LLM evaluation frameworks and datasets, statistical research, and collaboration with technical and client-facing teams.
Responsibilities
- Conduct independent and collaborative research in Generative AI, LLMs, NLP, multimodal AI, machine learning, model evaluation, and AI data
- Formulate research questions and translate complex AI/ML problems into structured research methodologies and experiments
- Design, execute, and analyze experiments to evaluate and improve AI/ML models and solutions
- Build analytical models, prototypes, and research pipelines using Python and relevant ML frameworks
- Stay current with emerging research, methodologies, papers, and developments in GenAI, LLMs, NLP, multimodal models, and AI evaluation
- Develop and implement LLM evaluation frameworks, benchmarks, datasets, and evaluation criteria
- Evaluate models for accuracy, robustness, bias, hallucination, reasoning, relevance, response quality, and other performance dimensions
- Conduct model benchmarking, error analysis, comparative analysis, and performance evaluation
- Work on areas such as RAG, SFT, RLHF/DPO, prompt engineering, fine-tuning, embeddings, and LLM optimization, as applicable
- Identify model and data gaps and recommend improvements to enhance model performance and reliability
- Collect, clean, analyze, and interpret large and complex structured and unstructured datasets
- Perform EDA, statistical analysis, hypothesis testing, significance testing, correlation analysis, sampling, and error analysis
- Develop data-driven insights and identify patterns, trends, and relationships relevant to AI/ML research
- Apply appropriate statistical and quantitative methodologies to validate research findings
- Develop and evaluate datasets, sampling methodologies, taxonomies, annotation frameworks, data quality frameworks, and evaluation criteria for AI/ML models
- Analyze data quality and identify issues affecting model performance
- Collaborate with annotation, data engineering, and AI/ML teams to improve AI training and evaluation data
- Translate data and research findings into actionable recommendations for improving AI system
- Contribute to research papers, technical reports, whitepapers, patents, benchmarks, internal publications, and other research outputs, where applicable
- Identify opportunities to apply emerging research and technologies to real-world AI and data challenges
- Explore new methodologies, models, datasets, and evaluation approaches to improve AI capabilities
- Contribute to capability building and innovation within the AI/LLM practice
- Work closely with researchers, data scientists, AI/ML engineers, data/annotation teams, domain experts, and delivery teams
- Present research findings, analytical insights, and technical recommendations to senior technical stakeholders
- Translate complex research and technical concepts into clear, actionable recommendations
- Where required, participate in client-facing technical discussions and presentations and help translate business requirements into AI/ML solutions
Skills
- Master's or PhD in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Statistics, Mathematics, Computational Science, or a related discipline
- 4–7 years of hands-on research experience in AI/ML, Data Science, NLP, Generative AI, LLMs, or related areas
- Strong demonstrated research experience with the ability to independently formulate research questions, design experiments, analyze results, and communicate findings
- Demonstrated research track record through research publications, patents, conference presentations, open-source contributions, or significant AI/ML research projects
- Strong proficiency in Python and SQL
- Strong hands-on experience with NumPy, Pandas, Scikit-learn, and preferably PyTorch/TensorFlow
- Strong understanding of:
- Machine learning algorithms
- Statistics and experimentation
- Data analysis and feature engineering
- Model evaluation and performance metrics
- Hypothesis testing and statistical inference
- Hands-on exposure to LLMs, NLP, Generative AI, and multimodal AI
- Experience with one or more of RAG, LLM evaluation, prompt engineering, fine-tuning, SFT, RLHF/DPO, embeddings, or model benchmarking
- Experience working with large-scale structured and unstructured datasets
- Familiarity with Git and cloud platforms such as AWS, Azure, or GCP is desirable
- Bachelor's/Master's degree from IITs, NITs, or other premier engineering/research institutions is strongly preferred
- Candidates with publications in reputed conferences/journals and a strong academic/research profile will be preferred
Company Overview
Company H1B Sponsorship