Note: The job is a remote job and is open to candidates in USA. Skillable is hiring a Lead, Data Engineering to turn enterprise data architecture into reliable, scalable data pipelines and products. The role manages a team of at least five, leads day-to-day engineering execution, and establishes practices across data ingestion, transformation, deployment, testing, and operational support.
Responsibilities
- Manage a team by hiring and onboarding talent, setting clear expectations, conducting formal performance reviews, and coaching accountability
- Lead the team to deliver on the enterprise data platform roadmap by translating architecture direction into sequenced execution plans, team backlogs, and measurable outcomes
- Create a strong engineering culture across the team by setting standards for maintainability, organization, and repeatability; growing engineers via regular 1:1s, timely feedback, development plans, and formal review cycles; and being responsible for overall team performance and cohesion
- Own day-to-day execution for the Data Engineering team by breaking work into tasks, driving sprint-level planning, delegating effectively to grow ownership, unblocking delivery, and ensuring high-quality outcomes through engineering reviews and feedback
- Drive implementation of the Medallion architecture (Bronze → Silver → Gold) with strong enforcement of layer responsibilities, ensuring repeatable and auditable pipeline behavior leveraging Boomi, Dbt, Azure Data Bricks, Boomi/Rivery, Delta tables, and Sql Server
- Partner closely with the Data Architect to bring the architecture to life through concrete implementation patterns, reference pipelines, and guardrails—ensuring the team can consistently execute the intended approach
- Reduce friction by driving crisp decisions and forward motion—using lightweight decision records, seeking the right input, and then executing accountability (while avoiding overly heavy process)
- Establish DataOps practices aligned with modern software development lifecycle (SDLC): CI/CD for data assets, consistent branching/release patterns, code review standards, and runbooks/operational readiness for pipelines
- Improve pipeline observability and operational reliability by implementing monitoring for freshness/staleness, failure modes, and quality signals, and ensuring the team responds predictably to incidents and support requests
- Drive stakeholder partnership and intake stream: collaborate with business partners to clarify requirements, reduce ad-hoc thrash, and shape requests into deliverable, well-scoped work that fits the platform strategy
- Develop future leaders and succession plans for key roles through assigning regularly occurring responsibilities, mentoring, and strategic delegation
- Support and promote the company values through positive interactions with both internal and external stakeholders on a regular basis
- Other strategic business initiatives or special cross-functional project involvement as required
Skills
- Bachelor's degree in Computer Science, Data Science, Engineering, or relevant professional experience
- 10+ years of relevant professional experience in software / data engineering, including building production data pipelines and data platforms
- 2+ years of experience in lead capacity (formal or informal) including team leadership, task breakdown, reviews, delivery ownership, and cross-functional coordination
- Experience directly managing a team, including hiring/interviewing and conducting formal performance reviews
- Deep hands-on experience with Databricks (Spark), Boomi/Rivery, and Delta Lake patterns for scalable lakehouse processing
- Strong experience with ETL/ELT design and implementation, including orchestration/ingestion into transformation workflows across curated layers
- Experience partnering with application and database teams to define efficient, non-disruptive data access patterns for upstream SQL Server systems (read replicas, CDC, snapshot isolation, batching strategies)
- Demonstrated expertise implementing Medallion architecture with clear separation of concerns across Bronze/Silver/Gold, including enforcing “no consumer reads from Bronze” style guardrails
- Strong understanding of ingestion/source variability (APIs, CDC-enabled databases, file drops) and the ability to select appropriate ingestion strategies per source contract
- Track record of improving team maturity from reactive delivery to repeatable engineering execution (standards, patterns, documentation, and predictable throughput)
- Interest and ability in mentoring and/or training other team members as applicable
- Experience working cross-functionally and promoting collaborative partnerships to drive results
- Proven ability to communicate effectively to various audiences/levels, both internal and external stakeholders, including leadership through various mediums
- Ability to present and convey material both formally and informally to all levels of an organization
- Proven organization skills with the ability to address short-term and long-term demands simultaneously
- Easily adaptable with the ability to pivot with changing business needs, keeping a professional demeanor and leading by example for other colleagues
- Demonstrated ability to prioritize and manage workload and meet project deadlines
- High level of confidence, integrity, and professional courtesy
- Naturally inquisitive with a desire to learn, solve problems, and dig into detailed analysis
- Thorough understanding (or willingness to learn expeditiously) of business operations and processes
- Strong Microsoft suite experience, including teams or similar web conferencing and internal communication software experience preferred
- Experience working in a fully remote team is preferred but not required
Benefits
- Fully remote with a monthly stipend to pay for office services and supplies
- Medical (2 plan options), dental (2 plan options), vision, health savings account with generous employer contributions, healthcare spending accounts, dependent care spending accounts, EAP, group paid life insurance, group paid STD and LTD and voluntary life/AD&D insurance, accident and critical illness options.
- 401(k) with company match
- Tuition reimbursement
- Healthy lifestyle reimbursements
- Unlimited PTO
- Paid holidays
- Bereavement leave
- Parental leave
- Caregiver leave
- Paid FMLA leave
- Privilege of logging off at 2:00 pm local time, every Friday for team members who are caught up on work and meeting deliverables
- Full company closure during the 4th of July holiday week
- Reimbursement for up to $750 annually to use towards lifestyle choices that impact their wellness such as gym memberships, fitness classes or healthy meal plans
- Stipend of $200 a month for office expenses
- Access to pet insurance
- Access for employees and dependents to Skillable learning opportunities through our product and more!
Company Overview