Technical Product Manager, Trust & Safety at Innodatainc · LumiJobs

Responsibilities

A core part of the job is building RL environments with deliberate traps. That includes misalignment traps that test for reward hacking, deception, sandbagging, oversight evasion, and power-seeking; cyber traps such as planted credentials, injected instructions, and poisoned tools; and other honeypots that reveal how a model behaves when it believes no one is watching.
You thrive in ambiguity, go deep on technical detail, and care about making powerful AI safe and beneficial.
What You’ll Own:
Define data products for frontier labs. Turn lab research goals into clear product specs for safety training data, RL environments, and evaluations.
Design trap-based RL environments. Build sandboxed environments that embed misalignment traps (reward hacking, specification gaming, deception, sandbagging, oversight subversion) and cyber traps (prompt injection, credential exfiltration, tool poisoning, unsafe file and network actions).
Build safety into agentic tasks by design. Specify safe-behavior rubrics, verifiers, and reward signals so that models learn to complete real work while refusing, escalating, or asking for confirmation at the right moments.
Own evals and metrics. Define what "safe and trustworthy" means for each product in measurable terms, including attack success rate, over-refusal, trap trigger rate, and task completion under adversarial pressure. Track blind spots and drive iteration.
Prioritize ruthlessly. Frame problems crisply, lay out options with their business and technical tradeoffs, and separate MVP from ideal state.
Partner across teams. Work with lab researchers, our ML and platform engineers, red-teamers, policy experts, and delivery leads running large expert annotator pools.
Track the threat landscape. Stay current on agentic risks, alignment research, and new attack techniques, and turn them into roadmap items before customers ask.
Communicate clearly. Write specs, customer briefs, and safety findings that land with researchers and executives alike.
These examples show the kind of work this role owns:

Technical Product Manager, Trust & Safety

Responsibilities

Company

Innodatainc