Lead Data Streaming: Own the engineering execution and team health for the Data Streaming sub-team. Drive sprint cadence, technical design reviews, and engineering quality for a team that processes pentest telemetry at scale.

Pipeline Reliability: Own SLOs for ingestion throughput, latency, and error rates. Build the on-call processes and runbooks that keep pipelines healthy in production.

Schema & Contract Ownership: Maintain stable ingestion schemas and data contracts between the NodeZero runner, Security Research, and the Database Platform. Evolve these contracts carefully as new pentest capabilities ship.

Scalability: Scale ingestion pipelines to handle NodeZero's growth — more customers, larger environments, new data types — without requiring proportional engineering effort to operate.

Partner cross-functionally: Work closely with Security Research (the source of new pentest data), Database Platform (the downstream consumer), and Asset Inventory (which depends on clean, normalized data) to align on data quality and pipeline design.

Team Building: Grow the sub-team to full capacity and build a culture of operational ownership: engineers who are proud of pipeline reliability, not just feature velocity.

What You'll Bring

Experience leading teams of 5-8 engineers building and operating data ingestion or ETL/ELT pipelines in production.

Deep understanding of streaming or event-driven data architectures — Kafka, Kinesis, Pub/Sub, or equivalent.

Experience designing data normalization and enrichment pipelines at scale, with strong attention to data quality, deduplication, and schema evolution.

Proven ability to define and own SLOs for pipeline systems: latency, throughput, error rate, and data completeness.

Experience operating data pipelines in cloud-native environments; understands the failure modes and operational patterns at scale.

Engineering Manager, Data Streaming

Responsibilities

Qualification

Preferred

Benefits

Company

horizon3ai

More roles at horizon3ai