Pramaana Labs Research Scientist, Reinforcement Learning to scale foundation models' reasoning capabilities using RLVR and verified rewards from the Lean kernel. Innovate on RL algorithms, data, and evaluation for formal environments.
Responsibilities
We're training foundation models to natively interact with symbolic world models. As an RL Post-Training Researcher, you'll take foundation models and scale their reasoning capabilities: applying RLVR to new domains using verified rewards from the Lean kernel, pushing the frontier of autoformalization and proving, and innovating on RL algorithms, data, and evals. Your work will also define how our models leverage test-time compute to solve long-horizon logical tasks.
What you'll actually work on
Scale RLVR to new, real-world domains using the Lean kernel as a deterministic reward signal.
Design and implement novel RL algorithms and test-time compute optimizations tailored for formal environments and proof search.
Push the frontier of autoformalization, training models to map highly technical natural language into strict formal specifications.
Curate data and build evals that tightly correlate with verifiable downstream reasoning capabilities.
Own the whole loop: rollout sampling, reward design, the update, the eval.
Deep, hands-on research experience in reinforcement learning applied to reasoning models at scale.
Experience working with RLVR, test-time RL, or exact deterministic reward signals.
Strong algorithmic and systems intuition — comfortable writing custom RL loops, managing data pipelines, and building robust evals from scratch.
High autonomy: the ability to take a fuzzy problem area and independently drive it to state-of-the-art results without day-to-day direction.
Especially Strong Candidates May Also Have
Qualification
Experience with RLVRBackground in formal verification (Lean
Required
Deep hands-on research experience in reinforcement learning applied to reasoning models at scale
Experience with RLVR, test-time RL, or exact deterministic reward signals
Strong algorithmic and systems intuition
High autonomy to drive fuzzy problem areas to state-of-the-art results
Preferred
Background in formal verification (Lean, Coq, or Isabelle)
Strong publication record in top-tier venues (NeurIPS, ICML, ICLR)