Note: The job is a remote job and is open to candidates in USA. Horizon3.ai is a remote cybersecurity company that helps organizations proactively identify, fix, and verify exploitable attack vectors. The Senior Data Infrastructure Engineer will design, build, and own the data platform supporting business-critical pipelines, warehouse operations, orchestration, and BI reporting across multiple regions.
Responsibilities
- Design, build, and maintain business-critical data pipelines, including data ingestion and AWS Glue/Spark jobs feeding the warehouse and Tableau
- Build and operate core data infrastructure: the data warehouse, orchestration, and BI/reporting platform, deployed across multiple regions
- Help evaluate and shape our warehouse strategy, including lakehouse platforms such as Databricks
- Define and evolve event-driven contracts between producer and consumer teams, reasoning through batch vs. streaming, CDC, reprocessing, and multi-tenant/multi-region trade-offs
- Design and evolve warehouse schemas and data models
- Build observability into pipelines and platform components
- Drive work across producer and consumer teams, communicate clearly, and own outcomes end to end
Skills
- • Strong software engineering craft: clean, correct, maintainable code with solid data-structure and problem-solving fundamentals
- • Deep understanding of distributed systems and data architecture: pipeline and platform design, batch vs. streaming, CDC, event contracts, multi-tenant and multi-region trade-offs, reprocessing, and observability
- • Fluent SQL and strong data-modeling skills, including designing schemas for a warehouse your team owns
- • Experience owning production data infrastructure end to end
- • Strong collaboration and ownership across dependent teams
- • 7+ years of professional experience in data engineering, infrastructure engineering, or backend software engineering
- • Bachelor's degree in Computer Science or a related field, or equivalent practical experience
- • AWS data stack, including Glue and Spark
- • Cloud data warehouse or lakehouse platforms such as Amazon Redshift or Databricks
- • Tableau or a comparable BI platform
- • SQL and Python
- • Workflow orchestration tooling such as Apache Airflow or Dagster
Benefits
- Inclusive Team: We value diversity and promote an inclusive culture where everyone can thrive.
- Growth Opportunities: Be part of a dynamic and growing team with numerous career development opportunities.
- Innovative Culture: Work in a collaborative environment that encourages creativity and out-of-the-box thinking.
- Hybrid & Remote Work: We embrace a mix of remote and hybrid work models depending on role and location, including our Chicago office, where some roles require regular in-office presence.
- Health, vision & dental insurance for you and your family.
- A flexible vacation policy.
- Generous parental leave.
- All full-time roles are eligible for an equity package in the form of stock options.
Company Overview