Note: The job is a remote job and is open to candidates in USA. SoftStandard Solutions is seeking a Data Engineer to design and optimize data pipelines. The role involves developing and maintaining data systems while ensuring data quality and collaborating with various teams to deliver reliable data solutions.
Responsibilities
- Design, build, and optimize scalable ETL/ELT data pipelines
- Develop and maintain data warehouses, data lakes, and data marts
- Integrate data from multiple sources, including APIs, databases, and cloud platforms
- Ensure data quality, integrity, and security across data systems
- Optimize SQL queries and improve database performance
- Collaborate with Data Scientists, Analysts, and Software Engineers to deliver reliable data solutions
- Automate data workflows using orchestration tools
- Monitor and troubleshoot data pipeline issues
- Implement data governance and best practices
- Create technical documentation and maintain data architecture
Skills
- Strong proficiency in Python and SQL
- Experience with Apache Spark, Kafka, and Airflow
- Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP)
- Knowledge of data warehousing concepts and dimensional modeling
- Experience with Snowflake, Databricks, Redshift, or BigQuery
- Familiarity with relational and NoSQL databases
- Experience with version control tools like Git
- Understanding of Linux/Unix environments
- Strong analytical and problem-solving skills
Company Overview
Company H1B Sponsorship