Note: The job is a remote job and is open to candidates in USA. RIT Solutions, Inc. is seeking a skilled Data Engineer to join their PUMA project for the PBM underwriting team, focusing on data forecasting modeling. The role involves building data transformation and processing solutions while handling large data volume sets primarily using GCP and Azure.
Responsibilities
- Professional experience in building data transformation and processing solutions using SQL, Python or similar programming language
- Experience on handling large volume of data using Spark, on any cloud platform like GCP, Azure, AWS, Snowflake
- Experience in multiple tools and programming languages to analyze and manipulate data sets from disparate data sources
- Hands-on experience in programming using Python, SQL, and/or shell scripting
- Experience with Google Cloud Platform (GCP) using tools like BigQuery, Cloud Composer, Dataproc and Dataflow
- Experience with Azure ,Data Bricks, Azure Data Factory and Delta Lake
- Experience building APIs in Python
- Experience building large-scale applications and high-volume data pipelines
- Working knowledge of orchestration tools, such as Apache Airflow, Azure Data Factory, Databricks Workflow
- Ability to understand complex systems and solve challenging analytical problems
- Excellent problem-solving skills and critical thinking ability
- Strong collaboration and communication skills within and across teams
Skills
- GCP/ Azure (not AWS)
- SQL
- Python
- Backend API development
- Spark
- At least 5-7 years of experience
- At minimum 2-3 years of experience outside of their masters
- Professional experience in building data transformation and processing solutions using SQL, Python or similar programming language
- Experience on handling large volume of data using Spark, on any cloud platform like GCP, Azure, AWS, Snowflake
- Experience in multiple tools and programming languages to analyze and manipulate data sets from disparate data sources
- Hands-on experience in programming using Python, SQL, and/or shell scripting
- Experience with Google Cloud Platform (GCP) using tools like BigQuery, Cloud Composer, Dataproc and Dataflow
- Experience with Azure, Data Bricks, Azure Data Factory and Delta Lake
- Experience building APIs in Python
- Experience building large-scale applications and high-volume data pipelines
- Working knowledge of orchestration tools, such as Apache Airflow, Azure Data Factory, Databricks Workflow
- Ability to understand complex systems and solve challenging analytical problems
- Excellent problem-solving skills and critical thinking ability
- Strong collaboration and communication skills within and across teams
- Data engineer with API integration Expertise
- DE with UI Development experience
- A combination of different skillsets
Company Overview
Company H1B Sponsorship