Senior Production Engineer, Managed AI

San Francisco, CA - USfull timeOn Site

Apply on Employer Site

senior

$170k–$205k

H1B: no

Crusoe The Senior Production Engineer at Crusoe will design and operate managed AI services focusing on large language model workloads, building automation and reliability tooling for distributed AI pipelines. This role involves collaboration to optimize AI infrastructure and improve performance and reliability.

Responsibilities

At Crusoe, our Production Engineering team ensures the reliability and scalability of Crusoe’s AI-optimized cloud platform. We’re looking for a Senior Production Engineer with a strong background in distributed systems and hands-on experience with large language models to help us build and operate managed AI services at scale. This role is central to delivering highly available, performant, and cost-efficient AI infrastructure that powers compute-intensive, latency-sensitive workloads for our customers.
Design and operate reliable managed AI services with a focus on serving and scaling LLM workloads
Build automation and reliability tooling to support distributed AI pipelines and inference services
Define, measure, and improve SLIs/SLOs across AI workloads to ensure performance and reliability targets are met
Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters
Automate observability by building telemetry and performance tuning strategies for latency-sensitive AI services
Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling
Contribute to the architecture of next-generation distributed systems purpose-built for AI-first environments
What You’ll Bring:
Strong software engineering background — experience building production-grade systems beyond scripting or Bash
Demonstrated experience in distributed systems design and implementation
Hands-on work with large language models (LLMs) or AI/ML infrastructure

Qualification

Required

Strong software engineering background beyond scripting
Experience in distributed systems design and implementation
Hands-on work with large language models or AI/ML infrastructure
SRE mindset including defining SLIs/SLOs and building monitoring systems

Preferred

Experience scaling inference or training workloads for LLMs

Benefits

Medical
Dental
Vision
401(k)
PTO
Equity/RSU
Tuition
Parental Leave
Life Insurance

Company

Crusoe

View company page

Source: ashby

Active within the past hour

More roles at Crusoe

Accounting Manager, Leases

San Francisco, CA - US

Accounting Manager, Leases

Denver, CO - US

Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems)

San Francisco, CA - US

Operations & Maintenance Technician II

Abilene, TX - US

Boost Your Interview Chances

Improve Resume Match Score

Free

Your Score

9.0

Strong Applicant

Must-Have Skills for This Role

Distributed systemsLarge language modelsSRESLIs/SLOsMonitoringObservability

Optimize my Resume

Apply Faster with Autofill

Free

Save your profile once. LumiJobs pre-fills the employer's application form so you stop re-typing the same answers on every site.

Apply With Autofill

Or skip LumiJobs's tools and submit directly on the employer's career site.

Apply on Employer Site