Note: The job is a remote job and is open to candidates in USA. Harnham is partnering with an innovative, data-driven technology company seeking a Lead Data Engineer to help evolve its customer-facing data platform. The role provides hands-on technical leadership through scalable ELT pipeline development, architecture decisions, platform improvements, data modeling, issue resolution, engineering standards, and mentoring.
Responsibilities
- Design, build, and maintain scalable, reliable ELT pipelines supporting customer-facing analytics products
- Lead complex initiatives from architecture and planning through implementation, deployment, and ongoing support
- Drive improvements in platform scalability, reliability, observability, automation, and maintainability
- Own data modeling strategies, transformations, and onboarding of new customer data sources
- Partner closely with Product, Analytics, Customer Success, and Implementation teams to investigate and resolve customer-facing data issues
- Establish engineering standards, frameworks, and best practices across the data ecosystem
- Influence technical roadmap decisions and identify opportunities to enhance the overall data platform
- Mentor and coach fellow engineers while providing technical guidance and leadership
- Evaluate architectural options, communicate tradeoffs, and recommend solutions that balance scalability, performance, and maintainability
Skills
- • 7+ years of professional experience, including 5+ years in Data Engineering
- • Expert-level SQL skills
- • Strong Python experience focused on data engineering and ELT development
- • Deep experience designing and supporting large-scale data pipelines
- • Strong data modeling expertise
- • Experience working with orchestration tools such as Airflow or comparable frameworks
- • Experience managing large datasets with varying levels of data quality
- • Strong Linux proficiency
- • Demonstrated ability to troubleshoot and resolve complex data issues
- • Excellent communication skills with both technical and non-technical stakeholders
- • Has strong opinions about architecture and data modeling
- • Understands system-wide impacts rather than focusing solely on individual pipelines
- • Can clearly articulate technical tradeoffs and recommendations
- • Identifies opportunities for automation and operational efficiency
- • Has experience modernizing and improving existing data platforms
- • Thrives in ambiguous environments and takes ownership without extensive direction
- • Brings customer empathy and understands the importance of data quality in customer-facing products
- • Enjoys mentoring engineers and elevating technical standards across a team
- • 100% Remote (U.S.)
- • Full-time, 40 hours per week
- • Must be available during core collaboration hours of 10:00 AM - 4:00 PM Central Time
- • Minimal travel requirements
- • dbt
- • Airflow, Astronomer, Dagster, or similar orchestration platforms
- • PostgreSQL
- • MPP database architectures
- • Healthcare data environments
- • Experience across multiple database technologies
Benefits
- Remote (U.S.)
- Optional annual company gathering
- Opportunity to help shape the future of the data engineering organization
- May be considered for future people leadership opportunities as the team continues to grow
Company Overview
Company H1B Sponsorship