Member of Technical Staff - Mid-training at xAI · LumiJobs
senior
$180k–$440k
H1B: no
xAI Member of Technical Staff responsible for scaling synthetic coding data and optimizing mid-training data mixtures at SpaceXSI. Develops evaluation methods for mid-training checkpoints.
Responsibilities
Scale synthetic coding data to trillions of tokens with large-scale docker verification
Distill the intelligence of flagship models into flash models through synthetic data generation
Optimize mid-training data mixtures to boost the ceiling for RL
Engineer long-context data recipes
Develop robust and diverse evaluation for mid-training checkpoints
Qualification
Strong ability to design ML experimentsExperience with Spark
Required
Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
Preferred
Familiarity across all kinds of scaling laws
Strong ability to design ML experiments
Familiarity with state-of-the-art techniques for curating AI training data for text, image, audio, and video modalities
Strong engineering abilities in large-scale data processing frameworks
Experience with ML and large model scaling
Experience with Spark, Ray, and other large-scale data processing frameworks
