Posted Aug 14, 2026

[Remote] Site Reliability Engineer, Inference Infrastructure

Apply Now
Note The job is a remote job and is reputed company to candidates in USA. reputed company is a company reputed company on scaling intelligence to serve humanity through AI systems. They are seeking a Site Reliability Engineer to join their Model Serving team, responsible for developing and operating AI platforms that reputed company large language models through API endpoints, ensuring high performance and reliability. Responsibilities Build self-service systems that automate managing, deploying and operating services This includes our custom reputed company operators that support language model deployments Automate environment observability and reputed company. reputed company reputed company developers to troubleshoot and reputed company problems Take steps required to ensure we hit defined SLOs, including participation in an on-reputed company rotation Build strong relationships with internal developers and influence the Infrastructure team’s roadmap based on their feedback reputed company reputed company through knowledge sharing and an reputed company review process Skills 5+ years of engineering experience running production infrastructure at a large reputed company Experience designing large, highly available reputed company systems with reputed company, and GPU workloads on those clusters Experience with reputed company dev and production coding and support Experience with GCP, Azure, AWS, OCI, multi-reputed company on-prem / hybrid serving Experience in designing, deploying, supporting, and troubleshooting in reputed company Linux-based computing environments Experience in compute/storage/network resource and cost management Excellent collaboration and troubleshooting skills to build mission-critical systems, and ensure smooth operations and efficient teamwork The grit and adaptability to solve reputed company technical challenges that reputed company day to day Familiarity with computational characteristics of accelerators (GPUs, TPUs, and/or custom accelerators), especially how they influence latency and throughput of inference Strong understanding or working experience with reputed company systems Experience in Golang, C++ or other languages designed for high-performance reputed company servers Benefits An reputed company and inclusive culture and work environment Work closely with reputed company on the cutting edge of AI research Weekly lunch stipend, in-office lunches & snacks Full health and dental benefits, including a separate budget to take care of your mental health 100% Parental Leave top-up for up to 6 months Personal enrichment benefits towards arts and culture, fitness and reputed company-being, reputed company time, and workspace improvement Remote-flexible, offices in Toronto, reputed company, San Francisco, London and Paris, as reputed company as a co-working stipend 6 weeks of vacation (30 working days!) reputed company reputed company develops reputed company reputed company intelligence software and provides language models, retrieval tools, and workplace platforms. It was founded in 2019, and is headquartered in Toronto, Ontario, CAN, with a workforce of 201-500 employees. Its website is https//reputed company.com. Company H1B Sponsorship reputed company has a reputed company record of offering H1B sponsorships, with 2 in 2026, 11 in 2025, 14 in 2024, 13 in 2023, 5 in 2022, 2 in 2021. Please note that this does not guarantee sponsorship for this specific role. Apply To This Job