Robinhood Senior Software Engineer on Robinhood's AI Infrastructure team building scalable infrastructure for machine learning and AI workloads. Improve GPU efficiency and develop intelligent routing for LLMs.
Responsibilities
Design, build, and scale the infrastructure powering machine learning and AI across Robinhood, including feature stores, training pipelines, model serving, inference, and observability.
Build and optimize distributed systems that support large-scale ML/AI workloads, with a focus on performance, reliability, scalability, and latency.
Improve GPU utilization and efficiency by developing scheduling solutions for training and inference workloads.
Help evolve Robinhood's LLM gateway, including intelligent model routing, query and prompt understanding, and context optimization.
Support infrastructure for serving open-weight and fine-tuned models, enabling reliable access to AI capabilities across the company.
Partner with engineering teams across Robinhood to understand their infrastructure needs and build scalable, reusable solutions.
Own the operational health of critical infrastructure, including monitoring, troubleshooting, performance optimization, and participation in an on-call rotation.
Strong software engineering experience with a focus on infrastructure, distributed systems, or large-scale backend platforms.
Hands-on experience designing, building, and operating distributed systems in production, with a strong understanding of scalability, reliability, and system performance.
Experience solving complex infrastructure challenges, including latency optimization, resource utilization, and production system reliability.
Strong software development and system design skills, with the ability to take ownership of complex technical problems from design through production.
Experience working with infrastructure technologies and tools in production environments, with an understanding of how to build and operate reliable systems at scale.