Software Engineer- Inference Performance

Required

• Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or a related field, or equivalent practical experience.
• 3+ years building and operating distributed systems, backend infrastructure, or large-scale APIs where reliability, latency, and scale are first-class concerns.
• A proven track record of owning low-latency, reliable backend services, including rate limiting, auth, quotas, metering, and migrations.
• Infrastructure instincts with a feel for performance: profiling, tracing, capacity planning, and SLO management.
• Comfort debugging performance and reliability issues across multiple layers of the stack, from application behavior down to runtime and infrastructure internals.
• A strong sense of developer experience. You think about how systems are used, not just how they work.
• Eagerness to learn new languages, frameworks, and systems, and a real interest in inference engineering. Prior ML or LLM experience isn't required, though experience with model serving or inference systems is a plus.
• Excellent written communication and collaboration skills, including writing clear design docs and working across functions.