Note: The job is a remote job and is open to candidates in USA. CBTS is seeking an experienced Director of Data Engineering to provide technical leadership for the architecture and delivery of its data platform. The role oversees data ingestion, storage, transformation, quality, security, and availability while managing a team and supporting analytics, reporting, AI, and machine learning initiatives.
Responsibilities
- Define and maintain the architecture for the company’s data lake and data warehouse
- Own the technical direction and standards for data ingestion, transformation, and storage
- Ensure data quality, reliability, security, and governance across the data platform
- Manage, mentor, and develop a team of data analysts and data engineers
- Set technical expectations, development standards, and operational practices
- Review designs, implementations, and analytics deliverables
- Work with an external partner to design and implement the initial data infrastructure
- Oversee knowledge transfer and transition to internal ownership
- Collaborate with application engineering, DevOps, and business teams to align data solutions with organizational needs
- Design and manage data pipelines that ingest data from multiple internal and external data sources in various formats
- Integrate and consume data from external platforms, including Databricks-based systems
- Support analytics and reporting use cases through curated datasets and data models
- Enable self-service analytics and reporting using Amazon QuickSight
- Build and operate data infrastructure on AWS, including S3, Glue, Athena, and Redshift or PostgreSQL
- Implement and maintain infrastructure as code using AWS CloudFormation
- Ensure deployments, monitoring, and operational processes are automated and repeatable
- Support AI and machine learning initiatives through data preparation and feature engineering
- Evaluate future technologies and platforms, including Databricks, as potential components of the data ecosystem
Skills
- • Bachelor's degree in Computer Science, Engineering, Data Science, or equivalent experience
- • 8+ years of relevant professional experience
- • 3+ years of people leadership experience
- • Strong experience in data engineering and data warehousing architecture
- • Experience ingesting, transforming, and modeling data from multiple data sources and formats
- • Hands-on experience with AWS data services (S3, Glue, Athena)
- • Experience with data warehouses such as Amazon Redshift and/or PostgreSQL
- • Experience implementing infrastructure as code using AWS CloudFormation
- • Proficiency in SQL
- • Experience leading technical teams
- • Experience integrating with external data platforms or vendor-managed data systems (e.g., Databricks)
- • Python for data processing, automation, or analytics
- • Familiarity with .NET-based application environments
- • Knowledge of AI/ML concepts and model development workflows
- • Experience with CI/CD pipelines and cloud security best practices
Company Overview
Company H1B Sponsorship