Note: The job is a remote job and is open to candidates in USA. fal is a generative media ecosystem providing infrastructure, tools, and model access for production-scale AI products. The Senior/Staff Network Infrastructure Engineer will build and operate public and private network infrastructure connecting fal’s data centers and cloud environments, including routing, private connectivity, overlay networks, DNS, IP address management, and Linux networking. The role also focuses on automation, performance, reliability, security, observability, and customer connectivity design.
Responsibilities
- Design, build, validate, and operate public and private networks across the public platform and private compute clusters
- Use AI aggressively to automate and accelerate network provisioning, configuration, validation, monitoring, and recovery
- Manage ASNs, public IP prefixes, and private address space (allocation, registration, announcement, lifecycle)
- Build and operate BGP routing: route policies, communities, filtering, traffic engineering, and failover
- Announce customer and company IP ranges from physical infrastructure and cloud providers, including BYOIP integrations
- Establish private peering with customers, partners, data centers, internet exchanges, and cloud providers
- Build private and overlay networks using VXLAN, IPsec, WireGuard, and Tailscale
- Operate DNS networking patterns including anycast DNS and mDNS
- Tune the Linux networking stack for high throughput, low latency, and large connection counts
- Build network observability and diagnostics using metrics, logs, flow data, active probes, and packet captures
- Develop reusable tooling, standards, documentation, and runbooks
- Collaborate with customers and internal teams to translate connectivity, security, isolation, and performance requirements into sound network designs
Skills
- • 5+ years building and operating production network infrastructure
- • Strong Linux networking: routing tables, policy routing, network namespaces, bonding, VLANs, bridges, firewalling, NAT, conntrack
- • Deep BGP knowledge: route selection, communities, filtering, convergence, multipath, troubleshooting
- • Experience managing ASNs, public IP space, BGP announcements, IPAM, RPKI/ROAs, IRR records
- • Experience designing private IPv4/IPv6 address plans and preventing cross-customer/region conflicts
- • Production VXLAN overlay network experience
- • Production IPsec, WireGuard, or Tailscale experience
- • Experience with anycast DNS and mDNS
- • Experience with private peering and cloud provider interconnects
- • Linux networking performance tuning: congestion control, queue disciplines, socket buffers, MTU, NIC offloads, RSS/RPS/XPS, IRQ affinity
- • Packet-level troubleshooting: iproute2, tc, ethtool, tcpdump, Wireshark, mtr
- • Ansible or equivalent network configuration automation
- • EVPN as a VXLAN control plane
- • FRRouting, BIRD, or similar software-routing platforms
- • AWS Direct Connect, Google Cloud Interconnect, Azure ExpressRoute
- • Internet exchanges, cross-connects, route servers, colocation networking
- • DDoS detection, mitigation, scrubbing, BGP-based traffic diversion
- • eBPF, XDP, DPDK
- • NetBox, Nautobot, Nornir
- • Authoritative or recursive DNS infrastructure at scale
- • Network hardware: Arista, Juniper, Cisco
- • Kubernetes networking, service load balancing, CNI
- • Python or Go
Benefits
- Remote work
Company Overview