Model Operations Lead, AI Gateway at Cloudflare · LumiJobs

Responsibilities

Build and lead the models team: Hire, coach, and grow the people who run the catalog today and build its intelligence over time. Give people real ownership, give direct feedback, and grow leads who can run their own areas.
Run model launches end-to-end: Scope integrations, coordinate testing and evals, confirm pricing, metering, capacity, and security, and get docs and announcements ready. Prepare day-zero launches in advance so they can ship in minutes.
Keep the catalog true: Make sure what we publish (capabilities, limits, versions, prices) matches what developers actually get. Catch silent regressions, such as broken tool calling, truncated streams, quantization changes, or usage and pricing mismatches, before customers do.
Build model intelligence: As it comes online, own the evals, capability maps, and per-task rankings behind our auto-routing profiles and model recommendations. Make sure they measure what they claim to, and connect regressions to routing decisions so customers who chose "auto" aren't the ones who discover a problem.
Treat the catalog and intelligence as products: Have a point of view on which models belong in the catalog, which routing profiles to ship, and what market intelligence to publish. Base it on usage, quality, reliability, and cost data. Turn what you learn into roadmap input.
Run a lightweight operating cadence: Keep one source of truth for what's in flight, who owns it, what's blocked, and what ships next. Keep Engineering, Product, Partnerships, and other stakeholders aligned and informed without status meetings.
Automate relentlessly: Turn repeatable steps into scripts, tools, and agent workflows: endpoint validation, eval runs, catalog and pricing reconciliation, regression detection, and provider follow-ups. Manual effort per launch should fall as the catalog grows.
Day-Zero & Quality Launches: Ensure new models launch on day zero with tested capabilities, accurate pricing, docs, and a clear call on routing eligibility.
Catalog Reliability & Health: Ensure the catalog reflects reality, and proactively identify when a model or provider is underperforming before customers notice.
Auto-Routing & Optimization: Deliver auto-routing that measurably beats a fixed model choice on cost or quality for users.
Developer Trust & Methodology: Build and maintain trusted rankings and recommendations grounded in solid methodology.
Partner & Stakeholder Management: Set clear expectations for providers, while keeping Engineering, Product, Partnerships, and other stakeholders aligned.

Model Operations Lead, AI Gateway

Responsibilities

Benefits

Company

Cloudflare

More roles at Cloudflare