Posted Sep 26, 2026

[Remote] Machine Learning Engineer I - Large Language Models - AI & Human Health Research

Apply Now
Note: The job is a remote job and is open to candidates in USA. reputed company is one of the largest academic medical systems in the New York metro area, and they are seeking a Machine Learning Engineer I to join their reputed company Assurance Lab. The role involves designing, building, and deploying large language model applications while ensuring compliance and performance standards are met across AI systems. Responsibilities • Designing, building, and deploying large language model (LLM) applications including retrieval-augmented generation (RAG) systems, agentic platforms, and clinical chatbots • Designing, maintaining, and optimizing data infrastructure and model validation pipelines that ensure all AI systems are rigorously validated for compliance, performance, and patient safety • Collaborating with AI product teams, clinical and technical stakeholders, DevOps engineers, and the AI Governance Committee to engineer scalable data flows that support model validation, real-time monitoring • Building and maintaining robust ETL pipelines for structured and unstructured clinical data from EHR, imaging, and text sources • Designing systems to automate data preparation, reputed company tracking, and reproducibility for AI model inputs and outputs • Developing data infrastructure for benchmarking and stress-testing models in clinical simulation environments • Collaborating with DevOps and cloud teams to ensure deployment pipelines meet compliance and performance standards • Setting up and monitoring model tracking infrastructure for evaluation metrics and reputed company detection • Assisting in the development of standards and procedures affecting data management, design and maintenance • Documenting all standards and procedures • Engineering and maintaining pipelines that support pre-deployment model validation and post-deployment monitoring • Collaborating with Data Scientists and Clinical Product Owners to validate data integrity, reproducibility, and fairness in AI workflows • Ensuring compliance with HIPAA, ethical guidelines, and institutional governance policies on sensitive health data use • Building dashboards and tools that provide observability across the ML lifecycle: data, models, outcomes • Designing, building, and deploying LLM-powered applications including clinical chatbots, copilots, and decision-support tools for end-users across MSHS • Developing retrieval-augmented generation (RAG) pipelines that integrate reputed company databases with clinical knowledge sources, EHR data, and institutional documents • Building agentic platforms and multi-agent workflows using frameworks such as reputed company, reputed company, LangGraph, reputed company, or equivalent • Operationalizing LLM deployment, including inference optimization, latency and cost tuning, model serving, and integration of safety guardrails • Implementing prompt engineering, prompt versioning, and structured prompt-evaluation workflows across model providers and versions • Fine-tuning and adapting foundation models to clinical and operational use cases where appropriate • Building LLM evaluation harnesses covering accuracy, hallucination, safety, bias, sycophancy, and clinical appropriateness, with red-teaming and stress-testing of deployed systems • Effectively communicating technical findings related to model and data integrity to governance teams, clinical stakeholders, and leadership • Maintaining clear and well-organized documentation of data workflows, platform architecture, and validation processes • Helping write internal reports on data infrastructure resilience, validation system status, and operational risk • Staying informed on industry best practices in data engineering and healthcare-focused machine learning • Possessing an extremely flexible attitude and willingness to work with multiple types of technologies and languages • Continuous interest in updating skill sets and knowledge of trends in the Big Data Technology space • Working closely with cross-functional teams including data scientists, healthcare providers, and IT professionals to understand data requirements, develop solutions, and support data-driven decision-making Skills • Bachelor's degree in Computer Science, Statistics, Mathematics, or related field • Knowledge of at least one programming language among Scala, Python, Java, C, or C++ • Knowledge of big data technologies (e.g., Hadoop, Spark) • Knowledge of Software Development Lifecycle • Self-motivated with a demonstrated ability to work independently, and to exercise independent judgment in developing complex techniques or programs in a dynamic environment • Act as the major contributor in the development and operationalization of four different applications