Note: The job is a remote job and is open to candidates in USA. NVIDIA is a technology company focused on accelerated computing, artificial intelligence, and GPU platforms. The Senior HPC AI Cluster Engineer will design, implement, maintain, and optimize large-scale HPC and AI clusters, including their monitoring, orchestration, automation, and infrastructure management. The role also involves troubleshooting systems across hardware and software layers, developing standard methodologies, and supporting research and development initiatives.
Responsibilities
- Design, implement and maintain large scale HPC/AI clusters with monitoring, logging and alerting
- Manage Linux job/workload schedules and orchestration tools
- Develop and maintain continuous integration and delivery pipelines
- Develop tooling to automate deployment and management of large-scale infrastructure environments, to automate operational monitoring and alerting, and to enable self-service consumption of resources
- Deploy monitoring solutions for the servers, network and storage
- Perform troubleshooting bottom up from bare metal, operating system, software stack and application level
- Being a technical resource, develop, re-define and document standard methodologies to share with internal teams
- Support Research & Development activities and engage in POCs/POVs for future improvements
Skills
- A degree in Computer Science, Engineering, or a related field (or equivalent experience) and 8+ years of experience
- Knowledge of HPC and AI solution technologies from CPU's and GPU's to high speed interconnects and supporting software
- Experience with job scheduling workloads and orchestration tools such as Slurm, K8s
- Excellent knowledge of Windows and Linux (Redhat/CentOS and Ubuntu) networking (sockets, firewalld, iptables, wireshark, etc.) and internals, ACLs and OS level security protection and common protocols e.g. TCP, DHCP, DNS, etc
- Experience with multiple storage solutions such as Lustre, GPFS, Weka.io. Familiarity with newer and emerging storage technologies
- Python programming and bash scripting experience
- Comfortable with automation and configuration management tools such as Jenkins, Ansible, Puppet/chef
- Deep knowledge of Networking Protocols like InfiniBand, Ethernet
- Deep understanding and experience with virtual systems (for example VMware, Hyper-V, KVM, or Citrix)
- Familiarity with cloud computing platforms (e.g. AWS, Azure, Google Cloud)
- Knowledge of CPU and/or GPU architecture
- Knowledge of Kubernetes, container related microservice technologies
- Experience with GPU-focused hardware/software (DGX, Cuda)
- Experience with RDMA (InfiniBand or RoCE) fabrics
Benefits
- You will also be eligible for equity
- A generous benefits package
Company Overview
Company H1B Sponsorship