Machine Learning Engineer — Pre-training (LLM)

Sunnyvale, CAfull timeOn Site$150k–$450kH1B: no

Ifm US Machine Learning Engineer to extend and scale distributed training systems for foundation models. Responsible for implementing distributed optimizers and improving training system reliability.

Responsibilities

We’re looking for a distributed ML infrastructure engineer to help extend and scale our training systems. You’ll work side-by-side with world-class researchers and engineers to:
Extend distributed training frameworks (e.g., DeepSpeed, FSDP, FairScale, Horovod)
Implement distributed optimizers from mathematical specs
Build robust config + launch systems across multi-node, multi-GPU clusters
Own experiment tracking, metrics logging, and job monitoring for external visibility
Improve training system reliability, maintainability, and performance
Much of the work will support large-scale pre-training, and pre-training experience is required. Strong infrastructure and systems experience is what we value most.