Sr. Software Engineer, Kernels/CUDA (C++)

Palo Alto, CAfull timeOn Site

Apply on Employer Site

senior

$200k–$375k

H1B: no

xAI Senior Software Engineer works on building and optimizing massive GPU clusters and low-level CUDA kernels for AI supercomputers. The role involves profiling, debugging, and collaborating with AI research teams to improve training speed and scalability.

Responsibilities

Design, build, and optimize massive GPU clusters for extreme-scale training and inference workloads
Develop and tune low-level CUDA kernels (GeMM, Attention, etc.), using CUTLASS, Tensor Cores, and Nsight for maximum performance
Profile, debug, and eliminate bottlenecks across GPU memory hierarchy, networking fabric, filesystems, and multi-GPU operation
Collaborate closely with AI research teams to deliver production-grade performance and scalability

Qualification

Required

5+ years of experience with low-level system programming in C/C++

Preferred

Deep low-level systems programming (C/C++/PTX/SASS)
Strong experience with large-scale GPU clusters or distributed compute infrastructure at production scale
Hands-on work with GPU kernel optimization (CUTLASS, custom kernels, Nsight profiling)
Track record of building or running high-performance infrastructure for AI workloads (training or inference platforms)
Ability to reason from first principles and optimize for both memory-bound and compute-bound scenarios

Benefits

Dental
Vision
401(k)
Equity/RSU
Life Insurance

Company

xAI

View company page

Source: greenhouse

Active within the past hour

More roles at xAI

Sr. Mobile Android Engineer

New York, NY

Sr. Model Engineer, RL Training Framework

Palo Alto, CA

Sr. Software Engineer, Training/Inference (C++)

Palo Alto, CA

Sr. Software Engineer, Network (C++)

Palo Alto, CA