Basic Qualifications
Minimum 8+ years of overall Data Engineering / Software Engineering experience delivering enterprise-scale data solutions.
Minimum 5+ years of strong hands-on Data Engineering experience
, including design, development, optimization, and support of production data pipelines.
Minimum 3+ years of hands-on Databricks experience
, including production experience with:
Delta Lake
Medallion Architecture – Bronze / Silver / Gold
Unity Catalog
Minimum 5+ years of hands-on Spark experience
, with strong expertise in
PySpark specifically
, rather than Scala-only Spark development.
Minimum 3+ years of AWS data-platform experience
, using services such as S3, Glue, Lambda, EMR, Redshift, Kinesis, or related AWS technologies.
Minimum 2+ years of experience leading complex data-engineering initiatives, technical workstreams, or engineering teams while remaining hands-on technically.
Proven experience combining data engineering and software-engineering practices
, including modular development, testing, source control, CI/CD, observability, and production support.
Demonstrated daily hands-on use of
GitHub Copilot and/or Claude Code CLI
, with the ability to describe concrete examples of how these tools are used to accelerate engineering work.
Demonstrated ability to build
POCs and MVPs rapidly using AI-assisted development
.
Strong understanding of distributed data-processing principles, large-scale pipeline design, performance optimization, data quality, and production operations.
Strong SQL skills and experience working with large enterprise datasets.