Member of Technical Staff, GPU Infrastructure

Seattle · Remotefull timeRemote

Apply on Employer Site

senior

$270k–$335k

H1B: yes

Cohere The Member of Technical Staff, GPU Infrastructure deploys and operates GPU Kubernetes clusters across clouds and collaborates with cloud providers and hardware partners to improve reliability and performance. The role includes automating fault detection and remediation and troubleshooting production issues.

Responsibilities

Deploy and operate GPU Kubernetes clusters across clouds, and bring up new hardware generations and providers.
Work with cloud providers and hardware partners on reliability, performance, and cost, including RDMA and high-speed interconnects.
Automate node, GPU, and fabric fault detection and remediation so most faults are fixed without a human.
Improve fleet utilization, track cost, and cut the time it takes to get a faulty node back into service.
Troubleshoot production failures and performance problems, and leave the system easier to operate than you found it.
We hire at more than one level. We set level based on the scope you've owned and how independently you drive work.
You may be a good fit if you have
Run GPU Kubernetes clusters with thousands of GPUs for ML or HPC workloads.
Debugged Linux, networking, and performance problems. Familiarity with RDMA, NCCL, or accelerator health is a plus.
Written software in Python or Go. You would rather extend a solid open-source project than rebuild it.
Worked with researchers, ML engineers, or another team whose goals were not identical to yours.
Found a bottleneck, proposed a fix, and driven it in a fast-moving environment.

Qualification

Debugged LinuxWritten software in Python or GoExperience working with researchersFamiliarity with RDMAFamiliarity with NCCLExperience with accelerator health

Required

Run GPU Kubernetes clusters with thousands of GPUs for ML or HPC workloads
Debugged Linux, networking, and performance problems
Written software in Python or Go
Experience working with researchers, ML engineers, or cross-functional teams
Experience identifying bottlenecks and driving fixes in fast-moving environments

Preferred

Familiarity with RDMA
Familiarity with NCCL
Experience with accelerator health

Benefits

Dental
401(k)
Parental Leave
Wellness

Company

Cohere

View company page

Source: ashby

Active within the past hour

Remote-friendly

More roles at Cohere

DevOps Engineer (Digital Marketing sphere)

Georgia

Lead Governance, Risk and Compliance Manager

United States

Talent Partner, GTM

New York · Remote

Lead Healthcare Analyst

United States

Boost Your Interview Chances

Improve Resume Match Score

Free

Your Score

9.0

Strong Applicant

Must-Have Skills for This Role

GPU Kubernetes clustersPythonGoLinuxRDMANCCL

Optimize my Resume

Apply Faster with Autofill

Free

Save your profile once. LumiJobs pre-fills the employer's application form so you stop re-typing the same answers on every site.

Apply With Autofill

Or skip LumiJobs's tools and submit directly on the employer's career site.

Apply on Employer Site

Member of Technical Staff, GPU Infrastructure at Cohere · LumiJobs