Software Engineer, Big Data, Tech Enablement

Remotefull timeRemote

Apply on Employer Site

mid

$135k–$185k

H1B: yes

Ziprecruiter Software Engineer, Big Data, Tech Enablement at ZipRecruiter builds scalable data infrastructure and tools to enhance engineering efficiency. Focuses on data ingestion, big data processing, and MLOps to support ML development and product innovation.

Responsibilities

Design, build, deploy, and maintain data pipelines and systems for web events ingestion
Manage datalake and event streams for downstream applications
Tackle challenges with large, evolving datasets using batch and streaming techniques
Design, build, deploy, and maintain frameworks and systems to accelerate ML development

Qualification

Hands-on Apache Spark experienceSolid computer science fundamentalsWorking knowledge of AWS (S3Experience with a data lake stackStreaming experience

Required

2+ years of professional software development experience, including building and operating data pipelines that feed into a customer facing product
Hands-on Apache Spark experience: writing, tuning and debugging batch and/or streaming jobs at scale
Experience deploying and operating containerized services and batch jobs
Solid computer science fundamentals: data structures, algorithms, distributed systems, and testing
Professional software development experience, including building and operating data pipelines and infrastructure that feed into a customer facing product

Preferred

4+ years of professional software development experience with a focus on data-intensive systems
Working knowledge of AWS (S3, IAM, EC2, MSK or equivalents) and of instrumenting jobs with metrics, logs and alerts
Experience with a data lake stack: parquet on object storage, a data catalog such as AWS Glue, and an open table format such as Apache Iceberg or Delta Lake
Streaming experience: Kafka producers and consumers, Apache Flink, and/or Spark Structured Streaming
Experience with a workflow orchestrator such as Apache Airflow: authoring DAGs, backfills, dependency management and on-call for scheduled pipelines
Experience with open table format internals: schema evolution, partitioning, and compaction
Experience with deploying services on Kubernetes with Docker
Experience building and maintaining a data platform that powers a user-facing product including infrastructure and tools for streaming and batch data ingestion, building ETL pipelines, data permissions management, and data discovery.

Benefits

401(k)
PTO
Equity/RSU
Flexible Work

Company

Ziprecruiter

View company page

Source: greenhouse

Active within the past hour

Remote-friendly

More roles at Ziprecruiter

Sr. Director, Product Design

Remote

Sr. Manager, Enterprise Marketing

Remote

Decision Science Manager

Remote

Sr. Decision Scientist, Mobile

Remote