Position Summary
We are seeking a Lead ETL Developer to support the VISION CWIS FACS Conversion Initiative, focused on migrating data from Google Cloud Platform (Google Cloud Platform) BigQuery into enterprise SQL-based data warehouse environments.
The Lead ETL Developer will design, develop, test, and deploy scalable ETL and data ingestion pipelines while providing technical leadership, architecture guidance, mentoring, and oversight to a team of 4+ ETL developers. The ideal candidate will have strong expertise in Google Cloud Dataform, BigQuery, Medallion Architecture, enterprise data modeling, and modern ETL practices.
Key Responsibilities
Lead the design and development of ETL and data ingestion pipelines supporting Google Cloud Platform BigQuery to SQL data warehouse migration.
Architect and implement scalable pipelines using modern ETL tools and cloud-native data processing technologies.
Lead, mentor, and train a team of 4+ ETL developers on coding standards, development patterns, and best practices.
Develop data transformation and standardization processes for data from flat files, relational databases, and other disparate sources.
Apply Medallion Architecture principles to build reliable and maintainable data pipelines.
Work with business and technical stakeholders to define and validate data requirements.
Design and execute testing strategies to ensure data accuracy, completeness, integrity, and consistency.
Optimize ETL pipelines for performance, scalability, reliability, and maintainability.
Validate transactional and analytical data models to ensure all required data elements are available for downstream applications and BI solutions.
Troubleshoot data pipeline and migration issues and provide technical solutions.
Create technical documentation, architecture guidance, and development standards.
Present technical concepts and project updates to both technical and non-technical stakeholders.
Required Skills
7+ years of hands-on ETL development experience
7+ years of experience with modern ETL and BI/reporting tools
Strong knowledge of enterprise data modeling and ETL architecture
Proven experience as a Technical Lead managing or mentoring 4+ developers
Strong hands-on experience with Google Cloud Dataform
Strong hands-on experience with Google BigQuery
Strong understanding and implementation experience with Medallion Architecture
Excellent communication, presentation, and stakeholder management skills