Note: The job is a remote job and is open to candidates in USA. Insight Global is searching for a Network Design Engineer to support a client’s infrastructure team. The role owns the network design lifecycle for AI training and inference, developing validated architectures, data center fabrics, physical infrastructure plans, and technical design documentation across multi-vendor GPU platforms.
Responsibilities
- Produce topology designs, IP/addressing schemes, routing policy, and fabric configuration specs across front-end, back-end (GPU-to-GPU training fabric), and storage networks
- Adapt architectures to different GPU platforms (NVIDIA, AMD, custom accelerators), form factors, and workload profiles, each with its own rack layout, power envelope, and cabling approach
- Translate logical designs into physical reality: rack elevations, power constraints, structured cabling and fiber budgets, pathway routing, and airflow that affect equipment placement
- Design lossless Ethernet fabrics for RDMA (RoCEv2): PFC, ECN tuning, traffic classes, and congestion management, reasoning about ECMP and collective-communication patterns in distributed training
- Produce HLDs, LLDs, cutsheets, BOMs, cabling matrices, and design decision records, and lead design reviews and reusable reference architectures
Skills
- You've designed data center network fabrics from requirements through deployment, not just configured them, and can explain the tradeoffs behind every decision
- You have deep L1 to L3 expertise: CLOS/fat-tree topologies, BGP, EVPN/VXLAN, and the fundamentals underneath them
- You design lossless RDMA (RoCEv2) fabrics and understand congestion management at training scale
- You reason from first principles through novel design challenges rather than pattern-matching to one reference architecture
- You partner across Hardware, DC Operations, ICT, Software, and Validation so designs are buildable and operationally sound
- Source-of-truth-driven design generation
- Multi-vendor GPU platform integration
- Large-cluster (100k+ accelerator) experience
Benefits
- Remote work arrangement
Company Overview
Company H1B Sponsorship