Senior Data Engineer – GCP
Location: Denver, CO (Remote)
Employment Type: W2 / Full-Time
Job Summary
Senior Data Engineer with strong expertise in Google Cloud Platform (GCP) and Java-based Cloud Dataflow development. The ideal candidate will have hands-on experience building high-performance batch and streaming data pipelines using Apache Beam with Java, along with expertise in BigQuery, GCS, Cloud Composer, and modern data architecture.
This role requires a strong background in designing scalable enterprise data platforms, implementing Medallion Architecture, optimizing large-scale data processing, and delivering reliable ETL/ELT solutions on GCP.
Key Responsibilities
Design, develop, and maintain scalable batch and streaming data pipelines using Google Cloud Dataflow with Java (Apache Beam).
Build reusable, high-performance data processing frameworks using Java.
Develop enterprise-grade ETL/ELT pipelines on Google Cloud Platform.
Design and implement Medallion Architecture (Bronze, Silver, Gold) for modern data lake solutions.
Develop and optimize analytical datasets using BigQuery.
Write efficient SQL queries and optimize query performance for large datasets.
Orchestrate workflows using Cloud Composer (Apache Airflow).
Manage data storage and lifecycle using Google Cloud Storage (GCS).
Implement CI/CD pipelines using Git and modern DevOps practices.
Apply GCP IAM best practices for security and governance.
Monitor, troubleshoot, and optimize Dataflow jobs for performance, scalability, and cost efficiency.
Required Skills & Experience
Mandatory Skills
Strong hands-on experience with Java-based Google Cloud Dataflow (Apache Beam) – Must Have
Strong programming experience in Java
Hands-on experience with Apache Beam SDK
Extensive experience with Google Cloud Platform (GCP)
Strong expertise in BigQuery
Experience building enterprise ETL/ELT pipelines
Advanced SQL skills including query optimization
Experience implementing Medallion Architecture
Experience with Google Cloud Storage (GCS)
Experience with Cloud Composer (Apache Airflow)
Knowledge of CI/CD pipelines and Git
Strong understanding of GCP IAM and cloud security