Job Description A rapidly growing AI and data platform organization is seeking a Lead MLOps Engineer / Software Platform Engineer to help build and scale the infrastructure powering next-generation machine learning and generative AI applications. This fully remote opportunity is open to professionals residing in Massachusetts who want to play a key role in designing cloud-native AI systems used in highly regulated environments.
In this position, you will lead the architecture, deployment, and operational strategy for production-grade AI services, machine learning platforms, and large language model (LLM) solutions. You will work closely with AI engineers, data teams, and platform engineers to create scalable, secure, and resilient infrastructure that supports both customer-facing and internal AI workloads.
This role is ideal for someone who has successfully built and operated AI/ML platforms serving external users, understands the challenges of distributed systems at scale, and enjoys driving technical direction across engineering organizations. Required Skills & Experience 10+ years of professional software engineering and infrastructure engineering experience
Proven expertise designing and scaling cloud-native distributed systems in production environments
Strong background leading technical architecture decisions for large-scale platforms
Extensive experience building and operating AI/ML infrastructure as a customer-facing product
Hands-on experience deploying and supporting LLM-based applications in production
Deep knowledge of Retrieval-Augmented Generation (RAG), prompts, embeddings, and model lifecycle management
Advanced programming skills in Python and TypeScript
Experience with model deployment, versioning, and model-serving platforms
Strong understanding of API architecture, REST services, and OpenAPI specifications
AWS expertise and experience working with containerized environments such as Docker
Experience with Infrastructure as Code tools, including CloudFormation or CDK
Knowledge of observability, monitoring, alerting, tracing, and SLI/SLO/SLA practices
Experience implementing security controls for multi-tenant environments, including PII and PHI protection
Ability to mentor engineers and influence architecture across multiple teams
Desired Skills & Experience Familiarity with modern LLM orchestration frameworks
Experience supporting agent-based AI systems in production
Knowledge of model serving optimization, inference tuning, and cost management
Experience with multimodal AI solutions involving image or scientific datasets
Background in model optimization techniques such as quantization or distillation
Experience working in regulated industries with compliance requirements
Exposure to life sciences, healthcare, laboratory systems, or scientific data platforms
Understanding of AI governance, evaluation frameworks, and quality monitoring
What You Will Be Doing Daily Responsibilities Lead the design and evolution of the organization's AI and machine learning platform
Define architecture standards for model serving, agent execution, and scalable AI workloads
Manage model lifecycle processes including deployment, versioning, promotion, rollback, and governance
Build infrastructure supporting both real-time and batch AI processing
Design secure, multi-tenant AI environments with strong data isolation controls
Develop evaluation frameworks, testing pipelines, and release gates for AI systems
Establish observability, monitoring, and operational excellence standards
Drive platform reliability, scalability, and cost-efficiency initiatives
Partner with engineering, security, and data teams to deliver enterprise-grade AI solutions
Lead design reviews and provide technical mentorship to engineering teams
Evaluate emerging AI technologies and make strategic build-versus-buy recommendations
Contribute to infrastructure automation, CI/CD improvements, and deployment practices
The Offer Competitive base salary plus potential bonus eligibility
Fully remote opportunity for candidates located in Massachusetts
Opportunity to influence the architecture of a high-impact AI platform
Leadership role with significant technical ownership and decision-making authority
You will receive the following benefits Medical Insurance
Dental Benefits
Vision Benefits
Unlimited Paid Time Off (PTO)
401(k)
Life Insurance
Long-Term Disability Coverage
Short-Term Disability Coverage
Applicants must be currently authorized to work in the US on a full-time basis now and in the future. Sponsorship is not available for this position.