Nexttoken Member of Technical Staff - ML Systems building infrastructure for model improvement including training, evaluation, and deployment. Work spans data pipelines, distributed execution, and performance optimization.
Responsibilities
You'll build the systems that make model improvement reliable and repeatable, from generating data and running experiments to evaluating and deploying checkpoints. Researchers and customer teams should be able to understand a run, recover from failures, and use its results without rebuilding the process each time.
You'll work across data pipelines, distributed execution, training, and serving, with initial responsibility shaped around your strongest area. An important part of the job is deciding where existing tools fit and where the gaps lie.
Training and reinforcement learning
Develop the infrastructure for post-training experiments, from distributed rollout execution to training and checkpoint evaluation. Improve resource allocation, parallel execution, and recovery so researchers can run more experiments and spend less time managing them.
Inference and performance
Make model serving efficient for both agent workloads and training data generation. Investigate bottlenecks in batching, KV-cache use, scheduling, and memory movement, and evaluate changes against latency, throughput, cost, and model quality. Depending on your specialty, this can include kernel and runtime optimization with CUDA, Triton, or related tools.
Data generation and environments
Build scalable systems for collecting trajectories, coordinating teacher models, and running agent environments. Make data generation and evaluation reproducible, with reliable execution and clear connections between datasets and the experiments that use them.
Research tooling and deployment
Develop benchmarks, observability, and automated experiment workflows that help researchers test ideas and understand results. Work with researchers and customers to turn new methods into dependable training and deployment capabilities, and share useful systems work through technical writing and open-source contributions where appropriate.
Qualification
Technical depth in ML infrastructureKnowledge of how PyTorchStrong distributed systems fundamentalsTell us about a system you're proud of
Required
Technical depth in ML infrastructure, with experience in training systems, model serving, or distributed data and rollout pipelines. You can explain the architectural decisions and measurable improvements in work you've owned.
Knowledge of how PyTorch, JAX, or similar frameworks operate beneath their APIs, with the ability to follow execution through the code, profile workloads, and diagnose correctness or performance issues.
Strong distributed systems fundamentals, including resource scheduling, communication, storage, and recovery. You can reason about how these interact in demanding ML workloads.
Understanding of the execution demands of post-training: how sampling, reward evaluation, optimization, and checkpoint updates fit together, and where efficiency or reliability can break down.
Ability to evaluate systems changes through reproducible measurements and work with researchers and customers to decide which problems matter most.
Experience with distributed training frameworks, vLLM or SGLang, GPU profiling, container orchestration, or research platforms is particularly relevant. CUDA, Triton, and compiler or runtime expertise are useful specializations. We value depth in one area and the ability to work across the surrounding stack; kernel expertise is not required.
We welcome engineers from ML infrastructure teams, research groups, and startups, including earlier-career engineers with a substantial systems project. The depth of your contribution matters more than a particular title or tenure.
Tell us about a system you're proud of: what it needed to do, what you personally built, and a difficult reliability or performance problem you solved. Include a resume and any links to code or technical writing you'd like us to read. If your interests span systems and research, apply once and tell us where you'd most like to contribute.
Explore our published research for examples of the work these systems support.
