Note: The job is a remote job and is open to candidates in USA. Kforce Inc is seeking a Staff AI/ML Infrastructure Engineer to design and maintain GPU and bare metal infrastructure. The role involves building scalable GPU clusters, developing automated testing systems, and collaborating with hardware vendors while leading technical direction and mentoring engineers.
Responsibilities
- Design and maintain GPU and bare metal infrastructure in containerized and physical environments
- Build scalable GPU clusters in partnership with networking and provisioning teams
- Ensure reliable, high-performance provisioning of GPU infrastructure
- Develop automated testing systems for GPU-based platforms
- Implement infrastructure solutions for diverse AI/ML workloads
- Benchmark, test, and troubleshoot GPU performance at scale
- Collaborate with hardware vendors on drivers, firmware, and support
- Resolve hardware, software, and performance issues across environments
- Optimize rail and cluster performance across architectures
- Lead technical direction and mentor engineers on infrastructure best practices
Skills
- 5+ years experience working with bare metal infrastructure and hardware automation
- Hands-on experience with modern NVIDIA/AMD GPU platforms and high-performance networking (RoCE, InfiniBand)
- Deep knowledge of BIOS, BMC, firmware, NICs, Redfish/IPMI, and PCIe systems
- Strong Linux systems experience including device drivers and package management
- Experience building infrastructure automation using Python and Bash
- Familiarity with GPU drivers, firmware ecosystems, and vendor collaboration
- Experience designing and delivering complex infrastructure products
- Proven ability to lead projects and mentor engineers
- Experience optimizing multi-cluster GPU environments
- Exposure to Machine Learning software stacks and GPU workloads
Benefits
- Medical/dental/vision insurance
- HSA
- FSA
- 401(k)
- Life, disability & ADD insurance to eligible employees
- Salaried personnel receive paid time off
- Hourly employees are not eligible for paid time off unless required by law
- Hourly employees on a Service Contract Act project are eligible for paid sick leave
Company Overview
Company H1B Sponsorship