Member of Technical Staff, Deployment Engineer

San Franciscofull time

Apply on Employer Site

On Site

senior

H1B: no

Judgment Labs The Deployment Engineer at Judgment Labs owns the end-to-end customer process, from understanding pain points to building evals and monitoring in Judgment. This role involves deep technical execution, customer ownership, and translating customer feedback into product direction.

Responsibilities

You'll own the end-to-end customer process, from understanding their pain points, to building their evals and monitoring in Judgment, to turning what you learn into what we build next.
This role centers on deep technical execution, customer ownership, and product judgment. You will work directly with customer teams to reason about agent behavior and translate high-level goals into concrete ABM deployments. You'll partner with our AEs before customers sign and stay with them after. Then you'll take what you learn across customers and turn it into product direction: deciding what's worth building, prototyping it, and demoing it.
You'll ship PRs and prototypes, but your main job isn't owning large systems end to end. It's making sure we build the right things. The scope, judgment, and autonomy required in this role mirror a training ground for what it takes to found or lead a technical company.
Partner with AEs on technical sales: run discovery and demos, answer product questions, and show prospects how Judgment fits their agents.
Deploy and embed Judgment Labs' ABM platform and AI components into customer codebases and production AI systems, integrating monitoring and evaluation into real workflows.
Guide customers through technical decisions around agent monitoring, evaluation strategy, and integrating these capabilities into existing production systems.
Own multiple customer engagements end-to-end, from the first technical conversation through successful integration and sustained adoption, in Slack and on calls.
Turn feedback across customers into product direction: what to build, what to fix, and what not to build.
Prototype and demo new features with coding agents, ship PRs when it makes sense, and work with engineering to get the right changes shipped.

Qualification

Strong product senseStrong customer-facing skillsAgents can’t work without thisWe’re wired to winFast track to founding

Required

You identify with at least one of the following:
Experience deploying AI or LLM-based systems into real production environments.
Ability to quickly learn new tools and systems, and integrate AI infrastructure into existing customer workflows and codebases.
Ability to translate ambiguous customer goals into concrete technical solutions and evaluation strategies.
Strong product sense: you can hear what a customer asks for, find the problem underneath, and explain clearly what's worth building.
Comfort prototyping and shipping changes quickly with coding agents.
Strong customer-facing skills, including explaining complex technical concepts clearly and building trust with both technical and non-technical stakeholders.
Comfort owning customer engagements end-to-end, from the first call through successful production adoption.
You want to be a technical founder in the future.
Agents can’t work without this: Today’s agents hallucinate, drift, and break in production. We’re building the infrastructure that fixes this: the monitoring layer that makes agents self-improving.
We’re wired to win: We're a team of 20 but we ship like 50+ on the daily. You'll be working with olympiad medalists, debate champions, and competitive athletes who bring that same intensity to company building.
Fast track to founding: Our engineers interface directly with customers, ship code into their environments, and use their feedback to dictate what’s next on the roadmap. Everyone on the team is either an ex-founder or a founder-to-be.

Company

Judgment Labs

View company page

Source: ashby

Active within the past hour

More roles at Judgment Labs

Founding Business Development Representative

San Francisco

Boost Your Interview Chances

Improve Resume Match Score

Free

Your Score

9.0

Strong Applicant

Must-Have Skills for This Role

ABM platformAI componentsSlack

Optimize my Resume

Apply Faster with Autofill

Free

Save your profile once. LumiJobs pre-fills the employer's application form so you stop re-typing the same answers on every site.

Apply With Autofill

Or skip LumiJobs's tools and submit directly on the employer's career site.

Apply on Employer Site

Member of Technical Staff, Deployment Engineer at Judgment Labs · LumiJobs