Senior Machine Learning Engineer, Inference - USA

Mountain View, California, USAfull time

Apply on Employer Site

On Site

senior

$250k–$300k

H1B: no

Inworld AI Senior Machine Learning Engineer, Inference at Inworld AI focuses on optimizing and scaling realtime AI inference systems. The role includes model acceleration, distributed systems scaling, and full-cycle ownership from research to production.

Responsibilities

Optimize inference serving frameworks and techniques
Accelerate models using quantization, distillation, and caching
Profile and optimize code performance on NVIDIA GPUs
Build and scale distributed systems for high concurrency
Take ownership of model deployment from research to production

Qualification

PhD in CSProficiency in C++

Required

PhD in CS, Physics, Math, or equivalent practical experience
Experience with inference optimization and model acceleration
Proficiency in C++, CUDA, Rust, or optimized Python
Experience with distributed systems and scaling
Public work such as open-source contributions or technical write-ups

Benefits

Equity/RSU

Company

Inworld AI

View company page

Source: ashby

Active within the past hour

More roles at Inworld AI

AI Trainer (Contractor), Voice and Speech Evaluation - USA

Mountain View, California, USA · Remote

Founding Technical Account Manager - USA

Mountain View, California, USA · Remote

AI Trainer - Voice and Speech Evaluation

Remote in USA