Note: The job is a remote job and is open to candidates in USA. Vertex Agility is partnering with an innovative technology company to hire an experienced Data Engineer for an exciting long-term contract opportunity. The role involves building and scaling modern cloud-based data infrastructure, developing robust data pipelines, and collaborating with various teams to support analytics and machine learning workloads.
Responsibilities
- Design, build, and maintain scalable, reliable data pipelines from ingestion through analytics and ML layers
- Develop and deliver new data infrastructure projects from concept through production
- Build and optimize ELT workflows using DBT and Airflow
- Work closely with Data Scientists, ML Engineers, Analytics teams, and Product stakeholders
- Ensure high data quality through testing, monitoring, and automated validation
- Optimize Snowflake performance, storage, and query costs
- Implement pipeline monitoring, alerting, and observability across the data platform
- Develop data solutions using Python and SQL
- Work within AWS cloud services including S3, Lambda, ECS, RDS, and MWAA
- Support CI/CD pipelines, Infrastructure-as-Code, and version-controlled development
- Investigate and resolve data quality issues, pipeline failures, and stakeholder data requests
Skills
- Strong experience as a Data Engineer building production-grade data platforms
- Advanced SQL skills with extensive hands-on experience in Snowflake
- Strong Python programming experience
- Hands-on experience with DBT for data transformation and data quality monitoring
- Experience orchestrating workflows using Apache Airflow
- Strong AWS experience (S3, Lambda, ECS, RDS, MWAA)
- Experience designing scalable ELT/ETL pipelines
- Familiarity with Git, CI/CD pipelines, and Infrastructure-as-Code
- Strong troubleshooting and problem-solving skills
- Experience working in Agile engineering teams
- Experience independently delivering greenfield data platform projects
- Deep expertise in Snowflake performance tuning and cost optimization
- Experience supporting analytics or machine learning data pipelines
- Previous experience working within startup or small engineering teams
- Familiarity with OpenSearch for log analytics or search-based data platforms
Benefits
- Long-term contract with an innovative, data-driven technology company
- Opportunity to build modern cloud-native data infrastructure from the ground up
- Work with cutting-edge technologies including Snowflake, AWS, DBT, Airflow, and Python
- Collaborative environment working alongside Data Engineers, ML Engineers, and Data Scientists
- High-impact role with ownership across the full data engineering lifecycle
- Flexible remote working within an international engineering team
Company Overview