Note: The job is a remote job and is open to candidates in USA. Vanta helps businesses earn and prove trust through continuous security monitoring and verification. The Staff Software Engineer will lead the re-platforming of the data layer beneath Vanta’s compliance product, ensuring correctness, compatibility, reliability, and scalability across distributed data systems. The role also drives cross-team architecture, mentors engineers, and advances streaming, storage, query, and data infrastructure capabilities.
Responsibilities
- Lead the migration of Vanta’s resource data model from a Mongo-centric solution to a schema-aware Postgres-backed solution and running both generations in parallel without breaking a customer integration
- Drive solutions across teams that you do not own but are dependent on the platform built by your team
- Design for correctness under eventual consistency with idempotent session handling, conditional writes that survive out-of-order delivery, reconciliation rather than strict cross-service validation, and explicitly backpressure instead of implicit database limits
- Design and evolve Vanta's data ingestion and pipeline architecture, ensuring reliable, high-throughput processing of terabyte-scale data streams across distributed systems
- Take our Query API from internal use to a production platform with schema versioning, joins and exports, per-tenant isolation, and predictable latency under load
- Build data infrastructure where correctness is externally auditable as the evidence Vanta produces has to hold up in front of an auditor
- Diagnose the failures that only appear at production data shapes and can include hot partitions, unbounded fan-out, and online rewrites of continuously-written tables
- Set architectural direction for streaming infrastructure (Kafka and event queuing), caching layers (Redis), and persistent storage (Postgres, MongoDB) across the Foundations stack
- Mentor senior engineers across the team, raising the technical bar through design reviews, architectural guidance, and hands-on contributions to the most complex systems challenges
- Champion engineering excellence in reliability, observability, and operational hygiene across the data infrastructure that powers Vanta's core product
- Leverage AI tools and systems to accelerate your own work and explore how they can improve the systems you build
Skills
- Proven track record leading platform migration initiatives (v1→v2 architecture transitions) while maintaining backward compatibility and system availability
- Strong command of streaming and queuing infrastructure (Kafka or equivalent), including partitioning strategy, consumer group semantics, redelivery, and idempotency
- Deep industry experience in distributed systems and data pipeline engineering, with demonstrated experience designing and operating systems at enterprise scale (terabyte-scale ingestion, high-throughput event processing)
- Fluency in both relational and document data modeling at scale (Postgres and MongoDB), including query planning, connection pooling, and online schema change on large, continuously written tables
- Experience collaborating with engineering leadership to define multi-quarter technical roadmaps and drive them through to delivery
- Solid AWS fundamentals and comfort operating in TypeScript and Node
- Able to articulate complex systems tradeoffs to both technical and non-technical audiences and bring cross-functional partners along on long-horizon technical decisions
- Open to using AI to amplify your skills and strengthen your work - demonstrating curiosity, a willingness to learn, and sound judgment in applying AI responsibly to improve efficiency and impact
Benefits
- Industry-competitive equity
- Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans
- 16 weeks of paid Parental Leave for all new parents
- Health & wellness stipend
- Remote workspace, internet, and cellphone stipend
- Commuter benefits for team members who report to the SF and NYC offices
- Family planning benefits
- Matching 401(k) contribution with immediate vesting
- Flexible PTO policy, plus 80 hours of Sick Time
- 11 company-paid holidays
- Virtual team-building activities, lunch-and-learns, and other company-wide events!
Company Overview
Company H1B Sponsorship