Sr. Staff Software Engineer, Cribl AI

Required

• Experience building, integrating, or operating production AI/ML systems, including NLP, speech/voice or MLOps based platforms.
• Experience with AI/ML infrastructure or LLM application architectures, such as model routing, inference platforms, MCP, RAG, or evaluation frameworks.
• Experience with cloud infrastructure, API design and production observability.
• Understanding of performance optimization, scalability, reliability, and operational troubleshooting in production environments.
• Ability to independently drive technical initiatives, make architectural tradeoffs, and collaborate with Product, Research, and Engineering leadership.
• Strong problem solving skills and the ability to navigate ambiguity while maintaining focus on customer and business outcomes.
• Hands on experience with model inference runtimes such as ONNX, NVIDIA Triton, vLLM, or TensorRT-LLM.
• Experience deploying and optimizing ML models across cloud infrastructure, GPUs, or resource constrained edge devices.
• Familiarity with inference optimization techniques, including quantization, dynamic batching, KV cache and hardware aware scheduling to improve latency, throughput, and cost efficiency.
• Experience with model serving, inference benchmarking, performance profiling, and detecting model quality or performance regressions.
• Experience building or operating high throughput, low latency inference systems at scale.
• Familiarity with fine tuning, model optimization, or deploying custom NLP, speech, or other ML models.