Note: The job is a remote job and is open to candidates in USA. Thomson Reuters is seeking a Senior Inference Engineer, AI. This role will focus on enhancing capacity forecasting for AI workloads, collaborating with various teams to onboard new research models into production and optimize AI and LLM workloads across multiple cloud platforms.
Responsibilities
- Within Platform Engineering and Enterprise AI Services, an AI Inference Engineer is responsible for productionizing, optimizing, and scaling AI and LLM workloads that power TR’s AI driven products
- This role ensures that our trained models—from classical ML to generative AI—run efficiently across TR’s multi cloud footprint (AWS, Azure, GCP, OCI), meet strict enterprise reliability requirements, and integrate seamlessly with our data backbone (Snowflake, OpenSearch vector search, API managed model routing)
- The successful candidate will help build the next generation of TR’s AI infrastructure, working alongside cloud engineering, data engineering, product teams, and AI Services
- Optimize LLMs and ML models for high-performance inference using techniques such as quantization, pruning, distillation, and hardware specific tuning
- Deploy and scale inference workloads on GPUs across AWS, Azure, GCP and internal Kubernetes clusters, ensuring predictable performance during peak traffic hours, especially during business hours
- Implement routing and failover strategies for OpenAI/Anthropic/Vertex AI traffic
- Integrate models into production grade APIs supporting TR products and enterprise workflows
- Develop highly optimized environment and eliminate performance bottlenecks to reduce latency
- Collaborate with Platform Engineering teams (Landing Zones, Network, Storage, Compute, AI) to ensure inference workloads align with TR’s cloud native patterns (AWS, Azure, GCP, OCI)
- Build and optimize containerized inference pipelines using Kubernetes for large-scale distributed workloads
- Ensure compliance with TR’s AI standards for deployment, monitoring, governance, and drift detection
- Profile inference performance, identify GPU/CPU bottlenecks, and optimize compute utilization across heterogeneous hardware
- Implement observability and health monitoring for inference pipelines, ensuring reliability of enterprise AI services
- Collaborates closely with AI engineers to invent new quantization techniques, improve numerical precision, and explore non‑standard architectures, and support the scale out of AI infrastructure during critical releases and global product rollouts
- Partner with Cloud Engineers (Azure, AWS, GCP) to develop guardrails and automation that support inference workloads
Skills
- 5+ years of relevant experience
- Strong understanding of ML/LLM fundamentals and inference optimization techniques
- Hands-on experience with GPU programming (CUDA preferred), inference runtimes (TensorRT, ONNX Runtime), and deep learning frameworks (PyTorch/TensorFlow)
- Proficiency in Python and at least one systems language (C++ strongly preferred for performance critical inference paths)
- Experience deploying AI workloads to AWS/GCP/Azure and Kubernetes
- Familiarity with vector search systems (OpenSearch vectors) and retrieval augmented generation pipelines
- Knowledge of distributed systems, microservices, CI/CD, and cloud native architecture
Benefits
- Hybrid Work Model: We’ve adopted a flexible hybrid working environment (2-3 days a week in the office depending on the role) for our office-based roles while delivering a seamless experience that is digitally and physically connected.
- Flexibility & Work-Life Balance: Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, including work from anywhere for up to 8 weeks per year, empowering employees to achieve a better work-life balance.
- Career Development and Growth: By fostering a culture of continuous learning and skill development, we prepare our talent to tackle tomorrow’s challenges and deliver real-world solutions. Our Grow My Way programming and skills-first approach ensures you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future.
- Industry Competitive Benefits: We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing.
- Culture: Globally recognized, award-winning reputation for inclusion and belonging, flexibility, work-life balance, and more. We live by our values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together.
- Social Impact: Make an impact in your community with our Social Impact Institute. We offer employees two paid volunteer days off annually and opportunities to get involved with pro-bono consulting projects and Environmental, Social, and Governance (ESG) initiatives.
- In the United States, Thomson Reuters offers a comprehensive benefits package to our employees. Our benefit package includes market competitive health, dental, vision, disability, and life insurance programs, as well as a competitive 401k plan with company match.
- Thomson Reuters offers market leading work life benefits with competitive vacation, sick and safe paid time off, paid holidays (including two company mental health days off), parental leave, sabbatical leave.
- Optional hospital, accident and sickness insurance paid 100% by the employee; optional life and AD&D insurance paid 100% by the employee; Flexible Spending and Health Savings Accounts; fitness reimbursement; access to Employee Assistance Program; Group Legal Identity Theft Protection benefit paid 100% by employee; access to 529 Plan; commuter benefits; Adoption & Surrogacy Assistance; Tuition Reimbursement; and access to Employee Stock Purchase Plan.
- This role may also be eligible for an Annual Bonus based on a combination of enterprise and individual performance.
Company Overview
Company H1B Sponsorship