Senior Software Engineer, Machine Learning Platform - Serving (US)

Preferred

• Experience with ML inference infrastructure, online feature retrieval, or other latency-sensitive distributed services.
• Experience operating containerized workloads on Kubernetes, including deployment, resource management, or autoscaling.
• Experience building self-serve developer platforms, APIs, or automation that helps other engineers move faster.
• Experience integrating open source infrastructure or models and validating their behavior under production workloads.
• Familiarity with CPU/GPU performance profiling, inference runtimes, or model deployment workflows.
• Relevant Technologies and Keywords
• Open source inference runtimes and models, NVIDIA Triton, ONNX Runtime, Kubernetes, CPU/GPU inference, gRPC, online feature stores, distributed systems, performance profiling, autoscaling, and self-serve ML infrastructure.
• Familiarity with every technology is not expected. We welcome engineers with strong backend and infrastructure fundamentals who are excited to learn the ML serving ecosystem.