Research Scientist: Pretraining

Boston (Somerville)full timeOn Site

Apply on Employer Site

$240k–$350k

H1B: no

Generalist Research Scientist: Pretraining at Generalist designs and executes large-scale pretraining runs for robot foundation models using multimodal robotic data. The role involves developing scalable data strategies and collaborating with ML infrastructure teams.

Responsibilities

If you have worked on pretraining large-scale ML systems or generative foundation models e.g. multimodal, language, audio, etc. (not only robotics), then this may be the role for you.
You’ll be responsible for:
Designing and executing large-scale pretraining runs for robot foundation models (transformer- and diffusion-based architectures)
Defining model architectures, objectives, and training curricula across multimodal robotic data (vision, action, state, language)
Developing scalable data mixtures and sampling strategies across petabyte-scale datasets
Guiding data collection operations towards new directions, as well as sourcing new datasets
Running ablations to understand scaling laws, data quality effects, and architecture tradeoffs
Collaborating closely with ML Infra and Systems to push cluster utilization, throughput, and reliability
Turning raw robotic interaction data into generalizable model capabilities
You might thrive in this role if you:
Have worked on large-scale ML systems with senior/staff (L6+) experience.
Have deep experience training large transformer or diffusion models at scale (for generative models e.g. including language models, audio models, or video models)

Qualification

Senior/staff (L6+) level experience

Required

Experience working on large-scale ML systems
Senior/staff (L6+) level experience
Deep experience training large transformer or diffusion models

Benefits

Vision

Company

Generalist

View company page

10000+ employees

Industrial

Founded 1892

Source: ashby

Active within the past hour

More roles at Generalist

Strategic Deals Lead

Boston (Somerville)

Software Engineer: Robotics Controls

Boston (Somerville)

Software Engineer: Product

Boston (Somerville)

Software Engineer: ML Optimization

Boston (Somerville)

Boost Your Interview Chances

Improve Resume Match Score

Free

Your Score

9.0

Strong Applicant

Must-Have Skills for This Role

transformerdiffusionmultimodal robotic datavisionactionstate

Optimize my Resume

Apply Faster with Autofill

Free

Save your profile once. LumiJobs pre-fills the employer's application form so you stop re-typing the same answers on every site.

Apply With Autofill

Or skip LumiJobs's tools and submit directly on the employer's career site.

Apply on Employer Site

Research Scientist: Pretraining at Generalist · LumiJobs