Software Engineer: ML Optimization

Boston (Somerville)full time

Apply on Employer Site

On Site

$260k–$350k

H1B: no

Generalist Software Engineer: ML Optimization at Generalist manages GPU compute fleets and optimizes ML data loading and storage for large-scale robot foundation model training. The role includes orchestrating robot inference fleets with real-time latency constraints.

Responsibilities

Generalist trains very large robot foundation models. This requires utilizing very large numbers of the latest generation GPU hardware and infrastructure (currently Nvidia) to run distributed training jobs and researcher experiments. We have extreme requirements on storage and data loading infrastructure that requires maximizing cloud infrastructure and custom solutions.
You’ll be responsible for:
Owning our GPU compute fleets
Ensure our GPUs are easy for researchers to use and maximally utilized
Optimizing and improving ML data loading transport and storage in highly distributed fully utilized environments.
Orchestration of robot inference fleets
You might thrive in this role if you:
Have managed large fleets of GPUs doing large-scale, long-term, highly distributed training runs or inference
Deep experience in Slurm or Kubernetes for ML workload orchestration
Have build high-scale ML data loaders and preparation systems
Deeply understand every layer of the ML hardware, storage, and networking stacks
Have experience in the NVidia GPU ecosystem

Qualification

Deep understanding of ML hardwareExperience in the NVidia GPU ecosystem

Required

Experience managing large fleets of GPUs for large-scale, long-term, highly distributed training or inference
Deep experience in Slurm or Kubernetes for ML workload orchestration
Experience building high-scale ML data loaders and preparation systems
Deep understanding of ML hardware, storage, and networking stacks
Experience in the NVidia GPU ecosystem

Benefits

Vision

Company

Generalist

View company page

10000+ employees

Industrial

Founded 1892

Source: ashby

Active within the past hour

More roles at Generalist

Strategic Deals Lead

Boston (Somerville)

Software Engineer: Robotics Controls

Boston (Somerville)

Software Engineer: Product

Boston (Somerville)

Software Engineer: Infrastructure

Boston (Somerville)

Boost Your Interview Chances

Improve Resume Match Score

Free

Your Score

9.0

Strong Applicant

Must-Have Skills for This Role

NvidiaGPUSlurmKubernetesML data loadersML hardware

Optimize my Resume

Apply Faster with Autofill

Free

Save your profile once. LumiJobs pre-fills the employer's application form so you stop re-typing the same answers on every site.

Apply With Autofill

Or skip LumiJobs's tools and submit directly on the employer's career site.

Apply on Employer Site