Note: The job is a remote job and is open to candidates in USA. Vialto is seeking a Manager, Enterprise Data Engineer to help organizations design and implement data pipelines and architectures. The role involves optimizing ETL processes, ensuring data quality, and utilizing big data and cloud solutions to support enterprise data initiatives.
Responsibilities
- Help organizations to design, develop and implement data pipelines and architectures to support enterprise data initiatives
- Support the development and optimization of ETL/ELT processes for data integration from diverse structured and unstructured sources
- Ensure data quality, consistency, and governance across the data platform in accordance with organizational standards and compliance requirements
- Utilize big data and cloud to build and manage enterprise-grade data solutions
- Collaborate with team to support analytics, reporting, and machine learning initiatives with reliable and timely data delivery
- Supervise and Coach team
Skills
- Must have a Bachelor's degree or foreign equivalent in Management Information Systems, Engineering, Business Administration, or a related field, plus 5 years of progressive, post-bachelor's related work experience
- In the alternative, the employer will accept a Master's degree or foreign equivalent in Management Information Systems, Engineering, Business Administration, or a related field, plus 3 years of related work experience
- Must have at least one year of experience with designing and implementing the architecture for the Enterprise Data Platform, focusing on CI/CD pipelines for applications and integrating Azure Data Factory pipelines to enable seamless data movement between enterprise systems like ADLS and Snowflake
- Must have at least one year of experience with utilizing Python / Power-shell skills to script jobs to automate the routine tasks such as scheduled maintenance and dynamic scale up of resources by using Azure Server less services to optimize the cost of running such utilities
- Must have at least one year of experience with ensuring that all the automated build and deploy pipelines (CI/CD) are working without any issues and remediating issues immediately with minimal impact to services
- Must have at least one year of experience with deploying GPT based artificial intelligence models in Azure Open AI service and monitoring the parameters such as token count, cost of operation, also working with other Azure AI tools such as Search Service, Document Intelligence, Text analytics etc
Benefits
- 100% telecommuting permitted.
Company Overview
Company H1B Sponsorship