About the role
Step into the foundation of Shopify's data platform. Imagine owning the systems that move every byte of operational data — every order, every event, every change — from Shopify's source-of-truth databases and Kafka streams into the analytics layer that powers dashboards, ML, and AI across the company. We're seeking a Staff Engineer to architect, operate, and evolve the ingestion platform that millions of merchants depend on, even if they never see it. Your work will be the substrate beneath critical analytics products at Shopify, shaping how quickly and reliably we can answer questions about our business and our merchants. Join a remote-first, AI-native team of seasoned data infrastructure engineers, ship continuously, and see your code raise the ceiling on what's possible downstream.
Responsibilities
Architect, optimize, and own Shopify's production ingestion platform — ingestion of data from operational databases and Kafka topics into Shopify’s analytics data store — designed for high throughput and continuous reliability at very large scale.
Leverage technologies like Kafka, BigQuery, GCP, Dataflow, Terraform, and Kubernetes to deliver state-of-the-art performance and efficiency across both database and stream ingestion pipelines.
Partner with database platform, streaming platform, governance, and downstream analytics teams to seamlessly land, validate, and scale data products powering our platform.
Drive cost optimization and system efficiency — reducing cloud spend, source-system load, and pipeline complexity without sacrificing freshness or completeness.
Lead deep technical investigations across upstream and downstream data-store internals (indexing, replication, load patterns) to apply rigorous solutions.
Contribute to technical strategy and culture for the ingestion team, represent the team across Shopify, champion projects, mentor engineers across all levels, and collaborate with senior engineers across Data Platform.
Participate in the team's on-call rotation, supporting production reliability for ingestion systems.
Qualifications
Proven, hands-on expertise in building and operating large-scale data infrastructure, with measurable wins in reliability, throughput, or cost.
Deep experience close to data stores — CDC, replication, indexing, partitioning, and the behavior of operational databases under load.
Strong software engineering skills (Python, Java, and/or other relevant languages) with a robust systems and distributed computing mindset.
Demonstrated leadership in architecting or operating reliable data pipelines at scale.
Track record of cross-functional impact: working closely with database teams, streaming platform engineers, infra, and downstream data consumers to deliver production results.
Advanced understanding of streaming systems and the trade-offs between latency, throughput, and cost.
Nice to Haves
Experience with ingestion / streaming frameworks (Kafka Connect, Debezium, Beam, Flink, etc.) as part of a broader data infrastructure practice — not a single-product specialty.
Experience optimizing pipelines across a variety of source systems (MySQL, distributed SQL like Yugabyte/Spanner/CockroachDB).
Experience with modern data warehouse and lakehouse patterns (BigQuery, Snowflake, Iceberg).
Prior experience in e-commerce, large-scale product infrastructure, or globally distributed data workloads.
Experience maintaining Scala services.
Fluency with AI coding tools (Claude Code, Cursor, etc.) as part of your daily workflow.
At Shopify, we pride ourselves on moving quickly—not just in shipping, but in our hiring process as well. If you're ready to apply, please be prepared to interview with us within the week. Our goal is to complete the entire interview loop within 30 days. You will be expected to complete a live pair programming session, come prepared with your own IDE.
About Shopify
Opportunity is not evenly distributed. Shopify puts independence within reach for anyone with a dream to start a business. We propel entrepreneurs and enterprises to scale the heights of their potential. Since 2006, we’ve grown to over 8,300 employees and generated over $1 trillion in sales for millions of merchants in 175 countries.
This is life-defining work that directly impacts people’s lives as much as it transforms your own. This is putting the power of the few in the hands of the many, is a future with more voices rather than fewer, and is creating more choices instead of an elite option.
About you
Moving at our pace brings a lot of change, complexity, and ambiguity—and a little bit of chaos. Shopifolk thrive on that and are comfortable being uncomfortable. That means Shopify is not the right place for everyone.
Before you apply, consider if you can:
- Care deeply about what you do and about making commerce better for everyone
- Excel by seeking professional and personal hypergrowth
- Keep up with an unrelenting pace (the week, not the quarter)
- Be resilient and resourceful in face of ambiguity and thrive on (rather than endure) change
- Bring critical thought and opinion
- Put AI agents and tools to work on the tasks they're built for, and focus on the work only humans can do
- Embrace differences and disagreement to get shit done and move forward
- Work digital-first for your daily work
We may use AI-enabled tools to screen, select, and assess applications. All AI outputs are reviewed and validated by our recruitment team.
We hire people, not resumes. If you think you’re right for the role, apply now.
Proven hands-on expertise in large-scale data infrastructure; deep experience with data stores, CDC, replication, indexing; strong software engineering in Python/Java; leadership in reliable data pipelines; cross-functional impact; advanced streaming systems understanding.
Key Responsibilities
- architecting ingestion platform
- optimizing data pipelines
- mentoring engineers
Skills & Tools
Kafka, BigQuery, GCP, Dataflow, Terraform, Kubernetes, Python, Java, Kafka Connect, Debezium, Beam, Flink, MySQL, Yugabyte, Spanner, CockroachDB, Snowflake, Iceberg, Scala, Claude Code, Cursor
Job Details
- Category: Software Development
- Seniority: Senior Level
- Commitment: Full Time
- Workplace: Remote — North America
- Languages: English
About Shopify
A global commerce platform that empowers entrepreneurs and enterprises to start, grow, and scale their businesses. — Industry: Information Technology