As an AI Researcher in Pre-training (f/m/d), you will work on the technical levers that determine the success of our next-generation models: architecture, optimization, stability, and scaling.

Working at the intersection of research and engineering, you will learn to translate mathematical reasoning and empirical observations into principled training decisions, from small-scale proxy experiments to multi-thousand-GPU runs. You will start with well-scoped problems alongside senior researchers and progressively take ownership of larger parts of the training recipe.

We are looking for someone with strong fundamentals, sharp experimental instincts, exceptional skills, and the drive to go deep fast. You learn as much from a failed run as from a paper, you write code others can build on, and you want to become an expert in large-scale pre-training.

Your Responsibilities

Recipe & Architecture Experiments: Design and run ablations on core elements of the training recipe (optimizers, schedules, initialization), and implement PyTorch-based architectural changes. Evaluate their effect on convergence, stability, and training efficiency.

Scaling Experiments: Run and analyze small-scale proxy experiments, and contribute to the hyperparameter scaling laws and scale-up methods we use to predict behavior at multi-thousand-GPU scale.

Run Monitoring & Debugging: Help monitor large-scale training runs and investigate convergence issues such as loss spikes and divergence. Work with the team to track down distributed training failures.

Research to Practice: Follow the literature, reproduce promising results at small scale, and bring ideas worth testing to the team.

Cross-Team Collaboration: Work with the Compute Performance, Data, Evaluation, and Post-Training teams to understand how hardware constraints and the rest of the model lifecycle shape pre-training decisions.

Core Qualifications

You are proficient in Python and have hands-on experience with PyTorch.

AI Researcher - Pre-training (f/m/d)

Responsibilities

Qualification

Required

Preferred

Company

Alephalpha

More roles at Alephalpha