Note: The job is a remote job and is open to candidates in USA. reputed company is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure for reputed company, machine learning, and data-intensive applications. They are seeking a commercially driven, deeply technical Product Manager to own AI inference and model serving for k0rdent AI, responsible for defining product strategy and solution development across various environments.
Responsibilities
• Own product strategy, roadmap, and lifecycle for inference and model serving, including serverless inference, dedicated endpoints, autoscaling, routing, KV cache management, and the related observability
• Lead deep technical discovery with NeoClouds, sovereign clouds, and enterprise platform teams, and translate findings into prioritized requirements and architecture direction
• Partner with engineering on system design trade-offs across runtime integration, GPU scheduling, network, storage, and serving topology, including disaggregated serving and multi-model serving
• Define positioning grounded in measurable outcomes: latency distributions, throughput per GPU, utilization, tail reliability, and cost per tokens
• Drive go-to-market execution: pricing and packaging, reference architectures, sizing guides, PoC playbooks, and direct engagement with customers, analysts, and ecosystem partners
Skills
• 7+ years in product management, technical product management, or a senior technical role owning AI/ML and inference product(s)
• Strong understanding of production AI inference, including model serving, serverless execution, dedicated endpoints, autoscaling, routing, workload placement, observability, and reliability
• Proven capability to reason about performance trade-offs across GPU, network, storage, orchestration, and runtime layers, and to translate low-level technical capability into business value such as TTFT, throughput per GPU, and TCO
• Working knowledge of modern inference runtimes (vLLM, SGLang, TensorRT-LLM, Dynamo, Triton) and the optimization patterns that matter in production: continuous batching, KV cache management, cold starts, prefill versus decode, disaggregated serving, and multi-model serving
• Credibility with engineering leaders and infrastructure operators, including comfort in production architecture reviews and technical commercial conversations with platform engineering buyers
Benefits
• Professional development and training.
• Attend conferences and working groups.
• Customized workstation (macOS, Windows).
• A competitive compensation package with strong benefits plan and stock options.
Company Overview
• reputed company develops cloud infrastructure and container management software for organizations to build, operate, and scale applications. It is a sub-organization of reputed company. It was founded in 1999, and is headquartered in Campbell, California, USA, with a reputed company of 501-1000 employees. Its website is http://www.reputed company.com.
Company H1B Sponsorship
• reputed company has a track record of offering H1B sponsorships, with 1 in 2026, 3 in 2025, 4 in 2024, 8 in 2023, 6 in 2022, 7 in 2021, 8 in 2020. reputed company note that this does not guarantee sponsorship for this specific role.
Apply To This Job