Note: The job is a remote job and is open to candidates in USA. Space Executive is recruiting for a company that provides an AI-driven, agentic threat hunting platform that autonomously analyzes security telemetry across endpoint, identity, and cloud environments. The Senior Data Engineer will own and develop scalable data ingestion, transformation, correlation, and search systems that power threat-hunting workflows, while collaborating with security and product engineering teams to shape the platform's architecture.
Responsibilities
- Design, build, and maintain scalable data pipelines that ingest and process large volumes of security telemetry (terabytes/day)
- Own API and event stream integrations across a wide range of third-party data sources (EDR, IAM, Cloud, SaaS)
- Develop and maintain the transformation layer that turns disparate data into a normalized, enriched, queryable model
- Build an engine that correlates entities across disparate data sources
- Work on core search capabilities across large-scale datasets
- Collaborate with detection engineers, threat hunters, and product engineers to ensure the platform's data needs are met
- Set and promote data engineering best practices, including observability, monitoring, and automated testing
- Help shape the architecture and technical direction of the platform
Skills
- 4+ years building data pipelines supporting customer-facing products
- Experience with data warehousing technologies
- Proficiency in Python, Java, Go, Rust, or similar
- Hands-on experience with large-scale event streaming systems (e.g., Kafka)
- Experience with AWS or GCP
- Strong systems thinking and understanding of performance, cost, and complexity trade-offs
- Ability to adapt, iterate, and ship quickly
- Growth mindset and a preference for a low-ego, collaborative environment
- Experience with ClickHouse
- Experience building or working with search systems over large datasets
- DevOps or platform engineering experience
- Cybersecurity experience
- Startup experience
Company Overview