Requisition ID 176841 - Posted
Job Summary
- Building and maintaining dbt transformation models across multiple pipeline layers — from raw ingestion through to governed, consumer-ready datasets
- Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation
- Developing and debugging Apache Airflow DAGs on AWS ECS
- Contributing to AWS Lambda-based ingestion( Python) — file validation, control file generation, S3 event handling
- Maintaining source-to-target mapping documentation and aligning models to business requirements and data specs
- Supporting onboarding of downstream consumers via data sharing mechanisms and event-driven notifications
- Participating in code reviews, writing YAML-based data quality tests, and owning tickets from design through to production
Tech stack required
- Strong SQL
- Proficiency with dbt Core
- Apache Iceberg Table format (Nice to have)
- Apache Airflow
- AWS - Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge
- Experience with fixed-format or structured financial data files
- CICD with Github Actions.
Key Responsibilities
- Building and maintaining dbt transformation models across multiple pipeline layers — from raw ingestion through to governed, consumer-ready datasets
- Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation
- Developing and debugging Apache Airflow DAGs on AWS ECS
- Contributing to AWS Lambda-based ingestion( Python) — file validation, control file generation, S3 event handling
- Maintaining source-to-target mapping documentation and aligning models to business requirements and data specs
- Supporting onboarding of downstream consumers via data sharing mechanisms and event-driven notifications
- Participating in code reviews, writing YAML-based data quality tests, and owning tickets from design through to production
Tech stack required
- Strong SQL
- Proficiency with dbt Core
- Apache Iceberg Table format (Nice to have)
- Apache Airflow
- AWS - Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge
- Experience with fixed-format or structured financial data files
- CICD with Github Actions.
Skill Requirements
- Building and maintaining dbt transformation models across multiple pipeline layers — from raw ingestion through to governed, consumer-ready datasets
- Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation
- Developing and debugging Apache Airflow DAGs on AWS ECS
- Contributing to AWS Lambda-based ingestion( Python) — file validation, control file generation, S3 event handling
- Maintaining source-to-target mapping documentation and aligning models to business requirements and data specs
- Supporting onboarding of downstream consumers via data sharing mechanisms and event-driven notifications
- Participating in code reviews, writing YAML-based data quality tests, and owning tickets from design through to production
Tech stack required
- Strong SQL
- Proficiency with dbt Core
- Apache Iceberg Table format (Nice to have)
- Apache Airflow
- AWS - Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge
- Experience with fixed-format or structured financial data files
- CICD with Github Actions.
Other Requirements
Strong SQL, dbt Core, Apache Airflow, AWS (S3, Lambda, MWAA, ECS, Glue, Lake Formation, SQS, EventBridge), Python, GitHub Actions, experience with financial data files.
Key Responsibilities
- building dbt models
- writing SQL transformations
- developing Airflow DAGs
Skills & Tools
SQL, dbt Core, Apache Iceberg, Apache Airflow, AWS S3, AWS Lambda, AWS MWAA, AWS ECS, AWS Glue, AWS Lake Formation, AWS SQS, AWS EventBridge, Python, GitHub Actions
Job Details
- Category: Software Development
- Seniority: Senior Level
- Commitment: Full Time
- Workplace: Remote — United States
- Languages: English
About HCLTech
A global IT services and technology company delivering AI, engineering, and cloud solutions. — Industry: Information Technology