Software Engineer - Kernels/CUDA (C++)

Palo Alto, CAfull timeOn Site

entry

$180k–$440k

H1B: no

xAI Software Engineer - Kernels/CUDA (C++) at xAI designs and optimizes massive GPU clusters for extreme-scale AI training and inference workloads. The role involves developing and tuning low-level CUDA kernels and collaborating with AI research teams to enhance performance and scalability.

Responsibilities

Design, build, and optimize massive GPU clusters for extreme-scale training and inference workloads
Develop and tune low-level CUDA kernels (GeMM, Attention, etc.), using CUTLASS, Tensor Cores, and Nsight for maximum performance
Profile, debug, and eliminate bottlenecks across GPU memory hierarchy, networking fabric, filesystems, and multi-GPU operation
Collaborate closely with AI research teams to deliver production-grade performance and scalability

Qualification

Required

1+ years of experience with low-level system programming in C/C++

Preferred

Deep low-level systems programming (C/C++/PTX/SASS)
Strong experience with large-scale GPU clusters or distributed compute infrastructure at production scale
Hands-on work with GPU kernel optimization (CUTLASS, custom kernels, Nsight profiling)
Track record of building or running high-performance infrastructure for AI workloads (training or inference platforms)
Ability to reason from first principles and optimize for both memory-bound and compute-bound scenarios

Benefits

Dental
Vision
401(k)
Equity/RSU
Life Insurance

Company

xAI

View company page

Source: greenhouse

Active within the past hour

More roles at xAI

Technical Recruiter

Memphis, TN

Mechanical Commissioning Technician

Memphis, TN

Mechanical Commissioning Lead

Memphis, TN

Manager, Materials Management - Memphis

Memphis, TN

Apply on Employer Site