Software Engineer: ML Infra

Boston (Somerville)full timeOn Site

Apply on Employer Site

$260k–$350k

H1B: no

Generalist Software Engineer: ML Infra at Generalist owns GPU compute fleets and optimizes ML data loading and inference infrastructure for robot foundation models. The role requires expertise in distributed training, GPU hardware, and ML workload orchestration.

Responsibilities

Generalist trains very large robot foundation models. This requires utilizing very large numbers of the latest generation GPU hardware and infrastructure (currently Nvidia) to run distributed training jobs and researcher experiments. We have extreme requirements on storage and data loading infrastructure that requires maximizing cloud infrastructure and custom solutions.
You’ll be responsible for:
Owning our GPU compute fleets
Ensure our GPUs are easy for researchers to use and maximally utilized
Optimizing and improving ML data loading transport and storage in highly distributed fully utilized environments.
Orchestration of robot inference fleets
You might thrive in this role if you:
Have managed large fleets of GPUs doing large-scale, long-term, highly distributed training runs or inference
Deep experience in Slurm or Kubernetes for ML workload orchestration
Have build high-scale ML data loaders and preparation systems
Deeply understand every layer of the ML hardware, storage, and networking stacks
Have experience in the NVidia GPU ecosystem