Note: The job is a remote job and is open to candidates in USA. VOLTO Consulting is hiring a Senior Data Engineer to support GCP-based data engineering initiatives. The role focuses on designing, building, governing, and optimizing scalable data platforms, ETL/ELT pipelines, integrations, and workflows for analytics, reporting, AI/ML, and business operations.
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines
- Automate data ingestion from multiple data sources
- Ensure reliable, high-performance, and scalable data movement
- Develop and optimize PySpark-based data processing frameworks
- Build and manage Airflow workflows and orchestration pipelines
- Work with Hive and Kafka-based batch and streaming data solutions
- Implement data quality, monitoring, governance, and operational controls
- Support production incidents, performance tuning, and continuous improvement initiatives
- The Data Engineer will be responsible for designing, building, governing, and optimizing data platforms, pipelines, and integrations to ensure secure, reliable, and scalable data availability for analytics, reporting, AI/ML, and business operations
Skills
- Google Cloud Platform (GCP)
- PySpark
- Python
- Airflow
- Hive
- Kafka
- Strong Functional Knowledge in Retail (Search & Personalization)
- Strong experience with large-scale GCP Data Engineering solutions
- Hands-on experience with Airflow DAG development and support
- Experience building and optimizing Spark/PySpark data pipelines
- Exposure to Hive-based data processing and Kafka-driven ingestion frameworks
- Experience supporting analytics, personalization, recommendation, or search platforms
Benefits
- Remote work arrangement
Company Overview