Bespoke Labs RL Environments Engineer at Bespoke Labs building pipelines to mass-produce validated agentic coding tasks and RL environments. Responsible for scaling environment generation and maintaining quality at scale.
Responsibilities
This is a delivery role. We want an engineer who has built the machinery that turns environment ideas into hundreds or thousands of validated agentic coding tasks, and who can do it here, fast.
The thing we care about most is whether you have done this before. If you have stood up an environment-generation pipeline, scaled agentic task creation into the hundreds or thousands, and shipped it, we want to talk.
Build environment-generation pipelines. Own the systems that produce RL environments programmatically, including templating, automated grading, verification, and QA, so the team ships environments at scale instead of one at a time.
Create complex coding worlds. Build high-fidelity environments around real codebases, with the conventions, dependencies, tooling, and technical debt that real software actually has.
Scale agentic task creation to thousands. Take task generation from handfuls to hundreds and thousands of validated agentic coding tasks, with automation doing the heavy lifting.
Build tools that raise throughput. Find the bottlenecks in environment production and remove them. Build the internal tooling and infrastructure that makes everyone on the team faster.
Own the full task lifecycle. Prompt, environment, grader, running frontier models against the task, failure analysis, and iteration, until each task is rigorous, fair, and hard to game.
Defend quality at scale. Catch reward hacking and grader loopholes, and build the verification and standards that hold the bar as volume grows.
Direct coding agents heavily. Use frontier coding agents to build and validate environments faster, judging their output and catching the subtle failures.
Direct frontier coding agents heavily to build and validate environments, judging their output and catching the quiet failures they produce.
Qualification
A record of shipped volumeAn adversarial mindsetOwnershipYou May Be a Good Fit If You AlsoHave worked on RL training systemsCome from developer tooling
Required
A record of shipped volume. You have built agentic coding tasks or environments and can show us how many you personally drove and what they cost to produce.
Experience scaling that output through automation rather than through more people doing more manual work.
Strong software engineering fundamentals and fluency in several languages that holds up in production code.
Real experience with production software. Large codebases, build systems, testing, deployment, on-call, and root cause analysis. You know what real engineering work feels like because you have done it.
An adversarial mindset. You look at a grader and ask how a model would cheat it, and then you fix that.
A clear sense of what frontier coding agents can and cannot do, and where they cut corners.
Ownership. You build, debug, and ship without much supervision.
You May Be a Good Fit If You Also
Have worked on RL training systems, post-training, verifiers, or tool-use harnesses
Come from developer tooling, CI/CD, sandboxes, or code execution infrastructure
Have built large-scale automated test generation, fuzzing harnesses, or benchmark suites, which is close cousin work even if it was never called an RL environment
Have contributed to a public agentic benchmark such as Terminal-Bench