Note: The job is a remote job and is open to candidates in USA. Capital One is a financial services and technology company operating Capital One Shopping and its large-scale analytics platform. The Sr Manager IC will own production data, ingestion, and orchestration platforms while building cost attribution, forecast-driven autoscaling, and production Generative AI systems. The role is primarily hands-on engineering with technical coordination, production support, mentoring, and on-call responsibilities.
Responsibilities
- Own, support, and evolve three production platforms — ideation through implementation to production support — and you're the SME and mentor for the analysts, BAs, and engineers who use them:
- You own the technology choices and the strategic backlog and priorities for this surface — and you carry ongoing production support and an on-call rotation for these platforms and the models on them
- A cost-attribution pipeline that parses Trino query logs at production traffic and attributes real AWS dollars to every report, query, user, and dbt model — reconciled against a ~$750K/month cloud bill
- A forecast-driven autoscaling control loop for the shared Trino cluster and dbt worker pool — turning today's event-only Nomad autoscaler (Prime Day, Cyber Week) into steady-state, forecast-driven capacity. The single largest lever on the analytics AWS bill
- A production Gen AI system — natural-language-to-SQL or RAG over the data catalog — with real LLM tool-use, grounding, and cost guardrails, adopted by internal teams
- Roughly 70% building: writing the log-parsing and cost-attribution logic and its dbt models, building and tuning the forecast-driven autoscaler control loop, and building the RAG / natural-language-to-SQL system yourself
- The other ~30% is technical coordination — reconciling your cost numbers with Finance, the R&D memo, aligning report owners — not status decks or people-management
Skills
- 10+ years engineering experience owning and supporting mission-critical applications and platforms in production
- Deep experience with Kafka and streaming technologies and platforms
- Experience with enterprise data technologies and platforms
- A track record working with extremely large traffic and data volumes
- Fluency across a real stack: JavaScript, Java, HTML/CSS, TypeScript, SQL, Python, and Go, open-source RDBMS and NoSQL databases, container orchestration (Docker and Kubernetes), and a broad range of AWS tools and services
- Forecast- or workload-driven infrastructure scaling on a shared platform — you've scaled shared infra up and down against a forecast, not just event-driven bursts
- Production Gen AI — RAG design, vector/graph stores, LLM tool-use — on top of a *longer* ML/AI arc (ranking, recommendation, or comparable production ML predating the 2023 Gen AI boom)
- 0-to-1 delivery of a product that booked measurable revenue or adoption in its first weeks, plus a lead-engineer role modernizing an ingest pipeline off a legacy provider onto a cloud-native stack
- Experience directing a cross-team migration or deprecation at senior-executive scope to completion
- A broad background and a genuinely fast learner — the stack keeps moving
- Comfortable working with large teams on large-scale systems, and cross-functionally (weekly Finance/BizOps and Analytics cadences)
- Claude Code fluency — daily use, skill authoring, PR-level deliverables (hard requirement)
- Bachelor's Degree
- At least 6 years of experience in software engineering (Internship experience does not apply)
- At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
- Master's Degree
- 9+ years of experience in at least one of the following: JavaScript, Java, TypeScript, SQL, Python, or Go
- 4+ years of experience with AWS, GCP, Microsoft Azure, or another cloud service
- 4+ years of experience in open source frameworks
- 1+ years of people management experience
- 2+ years of experience in Agile practices
Benefits
- This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
- Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
Company Overview
Company H1B Sponsorship