[Remote] Senior Data Engineer – GCP

Note: The job is a remote job and is open to candidates in USA. Apolis is seeking an experienced Senior Data Engineer to design and develop scalable data pipelines and cloud data infrastructure on GCP. The role involves optimizing data processing and GCP resources, implementing data quality and governance practices, mentoring engineers, and supporting advanced analytics and machine learning initiatives.

Responsibilities

• Design, develop, and optimize ETL/ELT data pipelines using Dataflow, Apache Beam, Dataproc, Spark, Pub/Sub, and Cloud Functions
• Build and manage data infrastructure using BigQuery, Cloud Storage, and Data Fusion
• Develop scalable batch and real-time data processing solutions
• Optimize BigQuery queries, data pipelines, partitioning, and GCP resource utilization
• Implement CI/CD, monitoring, logging, and infrastructure automation
• Mentor junior data engineers and conduct code reviews
• Establish data engineering standards and best practices
• Collaborate with data architects, data scientists, analysts, and business teams
• Implement data quality, validation, lineage, and metadata management
• Support self-service data platforms and advanced analytics/ML use cases
• Help optimize cloud performance and GCP cost management

Skills

• Strong experience with **SQL and Python**
• Proficiency in **Java and/or Scala**
• Strong knowledge of distributed processing frameworks such as **Apache Spark and Apache Beam**
• Hands-on experience with:
• + **Google BigQuery**
• + **Google Dataflow**
• + **Google Dataproc**
• + **Google Pub/Sub**
• + **Cloud Composer / Apache Airflow**
• + **Terraform**
• + **Cloud Storage**
• + **Data Fusion**
• Experience developing scalable **ETL/ELT pipelines**
• Strong understanding of **CI/CD, Git, and Infrastructure as Code (IaC)**
• Experience with data quality, governance, metadata, and lineage
• Strong troubleshooting, performance optimization, and problem-solving skills
• **GCP Professional Data Engineer Certification**
• Experience with real-time data processing
• Experience with **Vertex AI** or machine learning platforms
• Multi-cloud experience
• Experience with **dbt** and Data Catalog
• Experience with GCP monitoring, logging, and cost optimization

Benefits

• Remote work arrangement

Company Overview

Apolis is a IT consultancy that offers provides ERP solutions, hosting, assessment, web and mobile, IT staffing and IT workforce solutions. It was founded in 1996, and is headquartered in El Segundo, California, USA, with a workforce of 501-1000 employees. Its website is https://apolisrises.com/.

Company H1B Sponsorship

Apolis has a track record of offering H1B sponsorships, with 15 in 2023, 15 in 2022, 12 in 2021, 122 in 2020. Please note that this does not guarantee sponsorship for this specific role.