Research Scientist / Engineer – Training Infrastructure

Redwood City, CA · Remotefull time

Apply on Employer Site

Remote

$195k–$395k

H1B: yes

Luma AI Research Scientist / Engineer role focused on building and optimizing distributed training infrastructure for large-scale multimodal models across thousands of GPUs. Responsible for advanced parallelism, training stability, and resource utilization.

Responsibilities

Design, implement, and optimize efficient distributed training systems for models across thousands of GPUs
Research and implement advanced parallelization (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel)
Build monitoring, visualization, and debugging tools for large-scale training runs
Optimize training stability, convergence, and resource utilization across massive clusters

Qualification

Deep understanding of GPU clustersExperience with containerizationAbout Luma

Required

Extensive distributed PyTorch training and parallelisms in foundation-model training
Deep understanding of GPU clusters, networking, and storage systems
Familiarity with communication libraries (NCCL, MPI) and distributed-system optimization

Preferred

Strong Linux systems administration and scripting.
Experience managing training runs across 100+ GPUs.
Experience with containerization, orchestration, and cloud infrastructure.
About Luma: Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence — the next step beyond language models comes from vision. Luma is an equal opportunity employer.

Benefits

Vision

Company

Luma AI

View company page

Source: ashby

Active within the past hour

Remote-friendly

More roles at Luma AI

Editor + Motion Graphics

Los Angeles, CA · Remote

Software Engineer, Inference

Redwood City, CA · Remote

Research Scientist / Engineer – Performance Optimization

Redwood City, CA · Remote