Note: The job is a remote job and is open to candidates in USA. Buyers Edge Platform, through its RealTime Solutions brand, provides data intelligence and analytics for the foodservice industry. The Senior Data Engineer will lead the core data platform by designing schemas, developing ETL/ELT pipelines, shaping data models, and partnering on governance, security, and long-term architecture. The role also supports disaster recovery, release management, documentation, continuous improvement, and technical mentorship.
Responsibilities
- Platform Ownership: Own the primary relational database platform, including schema design, performance tuning, stored procedures, and lifecycle management for Realtime Solution SQL Server databases and technologies
- Pipeline Development: Architect, build, and maintain ETL/ELT data pipelines that serve as the backbone of the organization's data infrastructure
- Data Modeling: Design data models and schemas that serve multiple application and reporting layers
- Data Contracts: Define and enforce data contracts between source systems and downstream consumers
- Security & Compliance: Implement solutions that follow data governance and security compliance best practices, including PII handling, role-based access controls, audit logging, and encryption at rest/in transit
- Disaster Recovery: Own or contribute to disaster recovery, backup strategy, and restore procedures for the data platform
- Release Management: Manage schema change deployments across environments (dev to staging to prod), including migration scripts and release coordination
- Documentation: Maintain comprehensive documentation, including data dictionaries, pipeline runbooks, architecture diagrams, and data flow maps
- Continuous Improvement: Evaluate and recommend tools, frameworks, and technologies to improve the data platform
- Technical Mentorship: Mentor and guide junior engineers and analysts on data engineering best practices, SQL proficiency, and pipeline design
- Growth & Development: Foster a growth environment by supporting skill development through code reviews, pair programming, and knowledge sharing
- Engineering Standards: Champion engineering standards and help elevate the team's overall technical capability
Skills
- We are unable to offer work sponsorship for this role
- Expert-level proficiency in relational databases, including complex stored procedures, query optimization, indexing strategies, and execution plan analysis
- Experience designing end-to-end data flows, orchestration, scheduling, error handling, and recovery patterns
- Strong experience in data modeling, documenting data lineage, and metadata management
- Proficiency in a scripting language (Python, JavaScript, or similar) for pipeline tooling and automation
- Ability to implement validation, reconciliation, and monitoring at pipeline boundaries
- Strong communication skills with the ability to translate data issues into business impact and partner with analysts and product teams
- Git-based workflows, PR-based development, versioned schema migrations
- Ability to work independently with minimal oversight, driving projects from requirements through delivery
- 5+ years of data engineering experience, including relational databases, APIs, batch/streaming patterns, and cloud data platforms
- 3+ years of experience in data modeling, documenting data lineage and metadata
- Demonstrated experience building and maintaining complex stored procedures in a production environment
- 3+ years of experience with pipeline orchestration or scheduling tools (SSIS, Airflow, Databricks, or similar)
- Bachelor's degree in Computer Science, Information Systems, or a related field, or 5+ years equivalent software engineering experience
- Knowledge of embeddings, vector databases, document chunking, semantic retrieval, and knowledge base creation
- Pipeline development, ontology building, and maintenance
Benefits
- Medical insurance from day one
- Dental insurance from day one
- Vision insurance from day one
- Flexible spending account (FSA) from day one
- Company-paid life insurance from day one
- 401(k) with company match
- Training and development opportunities
- Flexible PTO policy with no accrual required
- Remote work arrangement
Company Overview