Note: The job is a remote job and is open to candidates in USA. Capital One is a financial services company offering consumer banking and shopping products, including Capital One Shopping. The Senior Manager IC will own and build the merchant and advertiser data mart platform, establishing architecture, cataloging, access governance, privacy controls, and production operations while delivering new lakehouse systems and coordinating with Sales, BizOps, and Analytics.
Responsibilities
- A data mart catalog + query-pattern analysis — a single source of truth covering every production mart (owner, SLO, lineage, PII classification, audit trail), plus a Trino-log analysis that shows which raw tables need a mart next. Extends the existing Dataset Registration Scanner, doesn't fork it
- Iceberg standardization on a revenue-attached mart — finish the Hive → Iceberg pattern on one high-value merchant/advertiser mart, with PII-masking parity, GDPR deletion-propagation, and schema-change audit baked into a reusable playbook other teams can follow. Bounded standardization, not an open-ended migration
- A marts-first access policy, enforced — draft and land a policy that steers consumers off raw event tables when a mart exists, enforced on three high-traffic raw schemas via Trino permissions + CloudSentry, with a full auditable exception log
- Writing the Hive → Iceberg migration and its parity tests
- Coding catalog lineage / PII-classification / audit capture
- Authoring dbt models and Airflow DAGs
- Implementing access enforcement as Trino + CloudSentry policy-as-code
- The weekly Sales / BizOps / Analytics cadence and the PII/access decisions
- Ongoing production support and an on-call rotation for the existing and future marts on this surface
Skills
- 10+ years engineering experience, 5+ years building shared data platforms / lakehouse infrastructure
- Hands-on experience leading a Hive → Iceberg (or analogous lakehouse) migration at scale on a revenue-attached system
- A track record of setting standards that multiple product teams actually adopted (≥3 teams)
- Experience building or extending a data catalog used across teams
- Data-access governance under a regulated framework — GDPR/CCPA, SOX, or equivalent — with specific PII-classification, deletion-propagation, or audit-trail work you owned end-to-end
- A track record of shifting consumers off raw event tables onto curated marts
- At least one prior role in a regulated data environment (financial services, healthcare, or equivalent)
- Prior merchant, advertiser, or retail-media data experience (or an analogous B2B customer-facing data product) — strong plus
- Cross-functional fluency — a hard requirement; weekly cadence with Sales, BizOps, and Analytics, translating business needs into platform work and back
- Claude Code fluency — daily use, skill authoring, PR-level deliverables (hard requirement)
- Bachelor's Degree
- At least 6 years of experience in software engineering (Internship experience does not apply)
- At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
- Master's Degree
- 9+ years of experience in at least one of the following: JavaScript, Java, TypeScript, SQL, Python, or Go
- 4+ years of experience with AWS, GCP, Microsoft Azure, or another cloud service
- 4+ years of experience in open source frameworks
- 1+ years of people management experience
- 2+ years of experience in Agile practices
Benefits
- This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
Company Overview
Company H1B Sponsorship