OpenAI Applied AI Engineer at OpenAI building production systems to improve AI-powered go-to-market workflows. Own the agent improvement loop including feedback, evaluation, experimentation, and business outcomes.
Responsibilities
We're looking for an Applied AI Engineer to build production systems that help AI-powered go-to-market workflows improve over time. You will connect agent behavior, customer and operator feedback, evaluation, experimentation, and business outcomes to make these systems more effective, reliable, and responsive to evolving customer needs.
This is a deeply technical, cross-functional role with end-to-end ownership of the agent improvement loop: understand production behavior, identify failure modes, improve how the system decides or acts, and validate the resulting impact.
Own the production improvement loop across agent behavior, customer and operator feedback, evaluation, experimentation, and verified business outcomes.
Instrument agent workflows so model interactions, tool use, decisions, failures, human edits, and downstream outcomes can be understood in context.
Define meaningful quality standards, representative evaluation datasets, regression coverage, and production monitoring for real GTM workflows.
Investigate why agents underperform across context, knowledge, instructions, tools, routing, guardrails, or workflow design.
Design and ship targeted behavior improvements, including changes to prompting, context construction, decision logic, tool use, and human-review paths.
Build backend services, APIs, data models, and feedback pipelines that make agent behavior observable, steerable, and reproducible.
Run controlled experiments, production replays, or staged rollouts to measure whether changes improve quality and downstream business results.
Partner with Product, Data Science, Sales, and B2B Marketing to prioritize high-value problems and define customer and business success.
Ship with appropriate safeguards for privacy, security, reliability, human oversight, and safe operational rollout.
You might be a great fit if you have:
Qualification
4+ years of softwareExperience building agent evaluationExperience with production replayExperience with salesWe are an equal opportunity employerFor additional information
Required
4+ years of software, backend, applied AI, or product-engineering experience building reliable production systems
Preferred
Experience building agent evaluation, observability, experimentation, or AI infrastructure products.
Experience with production replay, LLM grading, human-labeled datasets, shadow evaluation, or staged rollout.
Experience improving model or agent behavior through context design, prompting, tools, decision logic, or feedback loops.
Experience with sales, B2B marketing, revenue, CRM, campaign, or other GTM-facing systems.
Experience measuring customer engagement, qualified pipeline, conversion, or operational efficiency.
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.
