Note: The job is a remote job and is open to candidates in USA. Syren is engaging a Data Engineer to support its on-premises Data Warehouse and contribute to Cloud Data Warehouse development. The role focuses on monitoring and troubleshooting SSIS and T-SQL pipelines, resolving production issues, and developing cloud data models and pipelines with Azure Data Factory while supporting governance, documentation, and collaboration.
Responsibilities
- Monitor and re-run failed data pipelines and workflows to ensure seamless operations on **SSIS & T-SQL**
- Troubleshoot and resolve production issues, focusing exclusively on bug fixes
- Maintain data accuracy and integrity across all pipelines
- Conduct root cause analysis for recurring failures and document resolutions
- Provide daily status reports on pipeline execution, highlighting failures, root causes, and applied fixes
- Collaborate with onshore teams to address critical production incidents
- Implement temporary workarounds to minimize downtime while working toward permanent solutions
- Gather and analyze business requirements for business datasets in the cloud
- Design, develop, and test data pipelines to support Cloud Data Warehouse initiatives
- Build and optimize **batch processing** and **streaming jobs** to ensure timely data refresh
- Implement **Medallion Architecture** and design models for structured data processing across different layers
- Collaborate with onshore teams to establish best practices and reduce technical debt
- Define data models and ETL strategies in alignment with stakeholder requirements
- Participate in regular stand-ups and discussions with onshore and offshore teams to ensure seamless collaboration
- Ensure compliance with data governance policies, security standards, and best practices
- Develop and maintain comprehensive runbooks to document cloud operations, ensuring clear, step-by-step guidance for troubleshooting and maintenance
- Standardize and optimize cloud workflows by creating detailed documentation that enhances efficiency, reduces downtime, and supports seamless knowledge transfer across teams
Skills
- 6 - 9 years of experience in Data Engineering
- Experience with monitoring, troubleshooting, and resolving production issues in on-premises environments
- Proficiency in SSIS & T-SQL
- Ability to maintain data accuracy and integrity across all pipelines
- Experience conducting root cause analysis for recurring failures
- Experience providing daily status reports on pipeline execution
- Ability to collaborate with onshore teams to address critical production incidents
- Experience implementing temporary workarounds to minimize downtime
- Experience gathering and analyzing business requirements for datasets in the cloud
- Experience designing, developing, and testing data pipelines for Cloud Data Warehouse initiatives
- Experience building and optimizing batch processing and streaming jobs
- Knowledge of Medallion Architecture and structured data processing
- Ability to define data models and ETL strategies
- Experience participating in regular stand-ups and discussions with teams
- Knowledge of data governance policies and security standards
- Experience developing and maintaining comprehensive runbooks for cloud operations
- Ability to standardize and optimize cloud workflows through detailed documentation
Company Overview
Company H1B Sponsorship