We are hiring an Engineering Manager/Tech Lead Manager to lead the team that runs Kubernetes on bare-metal GPU infrastructure at Together AI. You will own how thousands of GPUs across our data centers are provisioned, orchestrated and kept healthy for the customers training, fine-tuning and serving models on our platform.

Together AI is the AI Native Cloud: a full-stack platform for running open and custom generative AI models, from GPU clusters to serverless inference. Our research and engineering teams contribute widely used open-source work such as FlashAttention, and our infrastructure runs at the frontier of GPU hardware.

This team sits at the base of that stack. Every training run, inference endpoint and customer cluster depends on the reliability, utilization and speed of the bare-metal Kubernetes layer you will lead.

Own the bare-metal Kubernetes platform

Set the technical direction for how we run Kubernetes on bare metal across multiple data centers and regions.

Drive automated, zero-touch provisioning of GPU nodes, from firmware and OS imaging through cluster join and validation.

Own cluster lifecycle at scale: upgrades, capacity expansion, node health checks, automated remediation and decommissioning.

Make GPU scheduling, topology-aware placement and high-performance networking (InfiniBand, RoCE, RDMA) first-class in the platform.

Drive reliability and efficiency

Define and meet SLOs for cluster availability, node bring-up time and GPU utilization.

Invest in observability across hardware, networking, Kubernetes and workloads so failures are found before customers see them.

Cut the time from racked hardware to customer-ready capacity.

Engineering Manager, Kubernetes Bare Metal Infrastructure

Responsibilities

Qualification

Required

Preferred

Benefits

Company

Together AI

More roles at Together AI