Note: The job is a remote job and is open to candidates in USA. ScolerTec Inc is seeking multiple Lead Data Engineers to support a large-scale cloud data modernization and governance program. The role leads the design, development, testing, and maintenance of secure, scalable cloud data engineering components and platform services for operational data, reporting, analytics, and AI/ML use cases, while collaborating with architecture, governance, migration, and DevSecOps teams.
Responsibilities
- Lead development of scalable cloud-based data platforms supporting data lake, lakehouse, and data warehouse architectures
- Design and develop enterprise ETL/ELT and ingestion pipelines for batch and near-real-time workloads
- Implement secure and auditable integrations across legacy, cloud, and external systems
- Lead implementation of operational databases, document storage, schemas, APIs, and data services
- Provide technical direction and oversight to Data Engineers, including design and code reviews
- Implement Infrastructure as Code for database and platform provisioning and configuration
- Implement data quality checks, validation, error handling, metadata, and governance-aligned structures
- Optimize pipeline performance, scalability, query performance, and cloud cost
- Integrate pipelines with Government-provided CI/CD processes
- Support incident resolution, RCA, migration, archival, failover testing, and DR activities
- Maintain technical documentation, architecture artifacts, runbooks, and audit-ready deliverables
Skills
- 7+ years of specialized data engineering experience, with experience leading enterprise-scale engineering efforts
- Strong hands-on experience with AWS data and compute services
- Strong proficiency in SQL, Python, ETL/ELT, and data transformation
- Hands-on experience building enterprise-scale data pipelines
- Experience with cloud-based data platforms such as Databricks, AWS Redshift, or similar
- Experience with orchestration tools and streaming/near-real-time ingestion
- Experience with CI/CD, secure software engineering, and Infrastructure as Code
- Experience with data governance, metadata, data quality, and classification standards
- Experience leading and mentoring Data Engineers
- AWS Certified Data Engineer
- AWS Certified Solutions Architect – Professional
- AWS Certified Data Analytics – Specialty
- Databricks Certified Data Professional
- CDMP
- Snowflake SnowPro Core
- Federal or regulated-environment experience preferred
Benefits
- Fully remote
Company Overview
Company H1B Sponsorship