Note: The job is a remote job and is open to candidates in USA. HMG AMERICA LLC is seeking a Lead GCP Data Engineer to design, architect, and scale enterprise data infrastructure on Google Cloud Platform. The role leads data pipeline architecture and engineering standards, mentors engineers, and collaborates across teams to deliver business intelligence and AI-ready data products.
Responsibilities
- Data Architecture: Design, build, and optimize scalable, reliable, and cost-efficient data pipelines and data warehouse structures on Google Cloud Platform
- Team Governance & Standards: Define standards and best practices for code quality, data modeling, CI/CD, testing, monitoring, and security across the data engineering workflow
- Mentorship: Provide technical direction, lead design reviews, and mentor mid-level and senior data engineers
- Pipeline Development: Build robust batch and real-time streaming data ingestion pipelines using Google BigQuery, Dataflow (Apache Beam), Pub/Sub, and Dataproc
- Orchestration: Implement automated workflow orchestration using Cloud Composer (Apache Airflow) or dbt
- Data Modeling: Create scalable data models (Kimball, Star/Snowflake schemas, Data Vault) optimized for analytical query performance and cost governance in BigQuery
- Quality & Monitoring: Implement automated data quality checks, data lineage tracking, alert frameworks, and proactive system health monitoring
- Cross-Functional Strategy: Partner with Analytics, Data Science, and DevOps teams to deliver self-service data solutions and support advanced analytics/ML models
- Security & Compliance: Ensure adherence to data governance policies, IAM best practices, encryption at rest/in transit, and compliance frameworks (GDPR, HIPAA, SOC 2)
Skills
- 8+ years of total data engineering experience, with 4+ years of hands-on expertise leading GCP data implementations at enterprise scale
- Advanced proficiency in BigQuery , Cloud Composer , Dataflow , Pub/Sub , Cloud Storage , and Dataproc
- Expert-level mastery of Python and Advanced SQL (window functions, query tuning, partitioning, clustering)
- Hands-on experience with dbt , Terraform (IaC) , and modern CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins)
- Proven track record of leading technical projects, mentoring engineers, and setting data architecture strategy
Benefits
- 100% Remote
Company Overview