xAI Sr. Model Engineer at xAI responsible for scaling synthetic coding data and optimizing mid-training data mixtures to enhance reinforcement learning. Develops evaluation methods for mid-training checkpoints.
Responsibilities
Scale synthetic coding data to trillions of tokens with large-scale docker verification
Distill the intelligence of flagship models into flash models through synthetic data generation
Optimize mid-training data mixtures to boost the ceiling for RL
Engineer long-context data recipes
Develop robust and diverse evaluation for mid-training checkpoints
Qualification
Experience training large models (eStrong ability to design ML experimentsExperience with Spark
Required
Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
Experience training large models (e.g., pre-training, post-training, fine-tuning, or RL training of neural networks with 1B+ parameters)
Preferred
Familiarity across all kinds of scaling laws
Strong ability to design ML experiments
Familiarity with state-of-the-art techniques for curating AI training data for text, image, audio, and video modalities
Strong engineering abilities in large-scale data processing frameworks
Experience with ML and large model scaling
Experience with Spark, Ray, and other large-scale data processing frameworks
