Note: The job is a remote job and is open to candidates in USA. Progress Partners is a fast-growing technology company building and scaling next-generation SaaS and mobile platforms, including AI-powered tools, productivity platforms, and workflow software. The Senior Data Engineer will build the company’s data platform from scratch, designing ingestion pipelines and Lakehouse infrastructure across AWS and GCP while owning dbt transformations, Airflow orchestration, lineage, and infrastructure as code.
Responsibilities
- Design and build ingestion pipelines for high-volume payment data (Stripe, PayPal, Solidgate), marketing analytics (GA4, GTM, Google Ads, Amplitude), and operational databases (MongoDB, PostgreSQL)
- Build the data infrastructure for a Lakehouse using AWS and GCP
- Build medallion-layer transformation models (Bronze → Silver → Gold) in dbt, with payments and marketing data on BigQuery
- Own orchestration end-to-end in Airflow, lineage, sensors, backfills, retries, and alerting across the full asset graph
- Implement infrastructure as code best practices, cost controls etc
Skills
- 3+ years building production data platforms and pipelines from the ground up
- Deep expertise in Airflow, including lineage, backfill, and retry strategies
- Hands-on experience with dbt, version-controlled transformations
- Strong AWS and GCP skills, with Terraform for infrastructure as code and a cost-conscious (FinOps) approach
- Strong written communication and the ability to work autonomously in a remote, async environment
- Familiarity with data mesh principles, domain ownership, or data product design
- Experience with Lakehouse architecture and Starburst Galaxy
Benefits
- Remote-first: work from anywhere in the world, no relocation required.
- Flexible hours: we measure outcomes, not time at a desk.
- Unlimited PTO: take the time you need to rest, recharge, and do your best work.
- Learning & development budget: courses, books, conferences, certifications, whatever helps you grow.
- Home office & wellness allowance: a dedicated budget to set up your workspace and support your health.
- A small, senior, collaborative team where your work is visible and your decisions matter.
- The chance to build products used by millions of people across 160+ countries.
Company Overview