Note: The job is a remote job and is open to candidates in USA. Grainger is a leading broad line distributor serving millions of customers worldwide with innovative technology and deep customer relationships. They are seeking a Data Engineer to design and maintain scalable ETL workflows, automate data transformations, and manage cloud-native data pipelines, all while ensuring high availability and scalability.
Responsibilities
- Design and maintain scalable ETL workflows and automate data transformations and orchestration using Airflow, DBT, Wherescape, and scripting languages including Python, SQL, and shell scripting, leveraging cloud services like AWS Lambda and S3
- Architect and manage cloud-native data pipelines and containerized applications to ensure high availability and scalability, using AWS and Kubernetes and FastAPI for building lightweight data-focused applications and microservices
- Automate infrastructure provisioning and streamline DevOps processes using infrastructure-as-code and CI/CD tools, using Terraform, GitHub Actions, and Bitbucket
- Extract and process enterprise data from SAP systems using ABAP variants, custom logic, and file-based integrations, enabling downstream analytics in platforms like Snowflake and Databricks and work closely with SAP functional teams to align data extraction with business requirements
- Build high-performance data ingestion and transformation pipelines for large-scale analytics and real-time data using kafka and Apache Spark on Databricks
Skills
- Master's degree in Computer Science, Engineering, or related field plus 6 years of related experience
- Design and maintain scalable ETL workflows and automate data transformations and orchestration using Airflow, DBT, Wherescape, and scripting languages including Python, SQL, and shell scripting, leveraging cloud services like AWS Lambda and S3
- Architect and manage cloud-native data pipelines and containerized applications to ensure high availability and scalability, using AWS and Kubernetes and FastAPI for building lightweight data-focused applications and microservices
- Automate infrastructure provisioning and streamline DevOps processes using infrastructure-as-code and CI/CD tools, using Terraform, GitHub Actions, and Bitbucket
- Extract and process enterprise data from SAP systems using ABAP variants, custom logic, and file-based integrations, enabling downstream analytics in platforms like Snowflake and Databricks and work closely with SAP functional teams to align data extraction with business requirements
- Build high-performance data ingestion and transformation pipelines for large-scale analytics and real-time data using kafka and Apache Spark on Databricks
Benefits
- 100% remote work allowed from anywhere in the U.S.
- Rewards and Benefits: To learn about Grainger’s benefits, please visit:
Company Overview
Company H1B Sponsorship