Apply on Employer SiteApply Now
GhostPosted Oct 15, 2026
Member of Technical Staff - Inference
San Franciscofull timeOn SiteseniorH1B: no
Ghost Member of Technical Staff - Inference at Ghost builds and optimizes the inference stack for personal AI models running locally on Core. The role focuses on improving latency, throughput, and memory efficiency across interactive and background workloads.
Responsibilities
- Build and optimize the inference stack that runs personal AI models locally on Core.
- Improve latency, throughput, and memory efficiency across interactive requests and background agent workloads.
- Profile performance across the hardware and software stack, optimizing kernels, memory movement, and runtime execution.
- Build benchmarks that reflect real product workloads, including long contexts, concurrent agents, and sustained operation.
- Work closely with the hardware, post-training, and product teams.
Qualification
Familiarity with GPU architectureExperience with inference runtimesStrong experimental judgment
Required
- Experience building or optimizing inference systems for language models.
- Strong systems programming skills in C++ or similar languages, alongside proficiency in Python.
- Familiarity with GPU architecture, memory management, and performance profiling.
- Experience with inference runtimes, quantization, or GPU kernel development using CUDA, Triton, or equivalent tools.
- Strong experimental judgment: you can identify bottlenecks and evaluate tradeoffs between speed, memory, power, and model quality.
Company
Ghost
View company pageSource: ashby
Active within the past hour