Member of Technical Staff - Inference Systems

Required

• We need someone who:
• Can pick up unfamiliar tools quickly and knows how to assess whether they're worth using.
• Designs AI benchmarks and holds methodology to a high standard.
• Cares about inference details, understands the tradeoffs, and checks what changed across the board before calling something done.
• Doesn’t consider a model port finished until you can prove the outputs are correct.
• Design and build benchmark suites that cover inference performance, model quality, and knowledge evaluation across different hardware targets.
• Run external partner verifications: evaluate their solutions against our benchmarks, identify gaps, and clearly deliver findings.
• Port models like LFM2 onto different runtimes and frameworks, and verify correctness end-to-end.
• Maintain and extend the inference engine layer built on llama.cpp, ONNX, and MLX as new model architectures emerge from research.
• Make benchmark results explainable and verifiable, so internal teams and partners can trust and reproduce them independently.
• Desired Experience
• Hands-on experience with at least one inference framework like llama.cpp, ONNX Runtime, or MLX, going beyond basic usage into internals and modification.