Note: The job is a remote job and is open to candidates in USA. WebstaurantStore is the premier source for restaurant equipment and supplies. They are seeking a Senior Data Platform Engineer to architect and own the next generation of their enterprise data integration and ingestion platform, leading the creation of a unified ingestion framework into Snowflake and mentoring engineers to deliver reliable cloud data solutions.
Responsibilities
- Lead the design, development, and implementation of a standardized cloud data ingestion framework into Snowflake
- Architect scalable, secure, and reusable ingestion patterns for diverse data sources, including APIs, databases, cloud storage, flat files, and SharePoint
- Build and maintain Fabric Pipelines to support enterprise-scale orchestration and workflow automation
- Develop Python-based ingestion utilities, automation scripts, and reusable components
- Establish best practices for ingestion performance, observability, resiliency, error handling, logging, and monitoring
- Analyze existing ingestion processes and drive modernization, consolidation, and data platform optimization initiatives
- Support and guide the organization through the transition from SQL Server to Snowflake
- Serve as the technical authority for data integration and ingestion architecture, providing direction, mentorship, and oversight to BI developers
- Delegate work effectively and coach team members on ingestion patterns, frameworks, and best practices
- Conduct code reviews, provide architectural guidance, and ensure adherence to data engineering standards and DevOps principles
- Collaborate with BI Managers to align resources, timelines, and priorities
- Promote a culture of knowledge sharing, continuous improvement, and engineering excellence
- Partner with analysts and business stakeholders to understand ingestion requirements and translate them into scalable cloud data solutions
- Lead the planning, design, and analysis of ingestion workflows and data engineering projects
- Evaluate new data sources and determine optimal ingestion strategies
- Contribute to long-term data platform roadmap and cloud architecture strategy
- Ensure solutions meet enterprise standards for data quality, governance, and security
Skills
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field; or equivalent professional experience
- 7–10 years of professional experience in data engineering
- 5+ years of hands-on experience with Snowflake, including ingestion, transformation, optimization, and platform performance tuning
- 4–6 years of experience building data pipelines using Microsoft Fabric Pipelines or equivalent orchestration tools
- 4–6 years of professional Python experience focused on automation, ingestion utilities, and framework development
- 5+ years of enterprise SQL experience, including advanced SQL Server work and hands-on Change Data Capture (CDC) implementation and support
- 5+ years of experience working in Agile/Scrum environments
- 3+ years of experience leading data engineering initiatives or serving as a technical lead on ingestion projects
- Experience working with event-driven architecture, streaming ingestion, or data contract–based integration models
- Experience using Qlik Replicate for data movement and replication
- Experience using dbt Cloud for ELT transformation and orchestration
- Microsoft Azure experience
- Deep expertise in building and maintaining cloud-based data integration pipelines across diverse platforms
- Strong proficiency with Snowflake architecture, Snowflake ingestion patterns, and SQL
- Advanced Python skills for automation, ingestion utilities, and framework development
- Hands-on experience with Microsoft Fabric Pipelines or similar orchestration tools
- Strong understanding of data modeling, data warehousing, and ETL/ELT best practices
- Ability to lead technical initiatives, mentor team members, and influence engineering direction
- Strong analytical and problem-solving skills with the ability to design scalable solutions
- Excellent communication skills, capable of translating complex technical concepts for nontechnical audiences
- Ability to manage multiple priorities in a fast-paced environment
- High degree of adaptability, emotional intelligence, and collaborative mindset
- Customer-focused approach with a commitment to delivering high-quality solutions
- Certifications in dbt Cloud, Snowflake, or Microsoft Fabric preferred but not required
Benefits
- Medical
- Vision
- Dental
- PTO
- Paid Maternity Leave
- Paid Parental Leave
- Life Insurance
- Disability
- Dependent Care FSA
- 401(k) matching
- Employee Assistance Program
- Wellness Incentives
- Company Discounts
- AT&T & Verizon Discount
- Bonus Opportunities
- Accident Insurance
- Critical Illness Insurance
- Adoption Assistance
- On-Site Fitness Centers
- Dog-friendly Offices
Company Overview