Software Engineer, Platform at People Culture Talent · LumiJobs
Remote
mid
$200k–$350k
H1B: yes
People Culture Talent Software Engineer, Platform at People Culture Talent building backend platform services for an AI gateway. Solve streaming problems and ship reliable platform infrastructure including authentication and usage metering.
Responsibilities
The open AI evaluation platform redefining how the world's leading AI labs measure model performance is looking for a Software Engineer, Platform to help shape the future of how the world measures artificial intelligence.
They are building an AI gateway that gives developers access to multiple model providers through a unified endpoint. The product is in a private, gated launch, with additional platform capabilities—including direct model access—being built next.
You’ll help build the platform infrastructure that turns their research advantage into enterprise products. This is a founding role on the developer team. You’ll work directly with the founders and early customers to define what they build and how they build it.
Location: San Francisco onsite three days per week. Remote candidates will generally only be considered with a strong endorsement.
Build and scale hands-on backend platform services for client's AI gateway, evolving an existing prototype into a reliable, independently scalable service.
Solve hard streaming problems. Handle SSE/streaming responses across heterogeneous providers, including partial failure recovery, mid-stream fallback, and consistent response normalization.
Ship reliable platform infrastructure, including capabilities such as authentication, rate limiting, usage metering, and cost tracking as the gateway matures.
Build deep observability. Instrument the platform with distributed tracing, latency breakdowns, usage tracking, and real-time dashboards so customers (and the team) can see exactly what’s happening.
Build AI-centered platform capabilities. Integrate with client's evaluation platform and data, and collaborate with research and product teams to turn new ideas into reliable product features.
Flex across the stack. Contribute to the backend of the company's Leaderboards and Evals products when needed, working across platform and product boundaries.
A culture that values transparency, trust, and community impact.
Visa sponsorship available.
Qualification
Strong Golang experience is requiredExperience designing reliable APIsFor Senior candidatesFor Staff candidatesCloud experience with GCPAPI gatewayExperience with streaming APIsExposure to LLM APIsExperience building usage tracking
Required
5+ years of professional software engineering experience, focused on backend services, distributed systems, or developer-facing platforms.
Strong Golang experience is required. You have built and operated meaningful backend systems in production.
Experience designing reliable APIs, service integrations, or gateway/proxy-style systems.
For Senior candidates: a track record of owning and delivering important backend functionality end to end.
For Staff candidates: extensive backend/platform experience, strong technical judgment, and the ability to provide hands-on technical leadership.
Cloud experience with GCP, AWS, Azure, or another major provider is helpful but not required.
Comfortable working hands-on in a fast-moving environment where the product and infrastructure are still evolving.
Able to work from our San Francisco office three days per week.
Preferred
API gateway, proxy, or multi-provider integration experience.
Experience with streaming APIs, response normalization, or resilient distributed systems.
Exposure to LLM APIs, model serving, AI infrastructure, or evaluation platforms.
Cloud infrastructure experience across GCP, AWS, Azure, Kubernetes, Terraform, Postgres, or Redis.
Experience building usage tracking, billing/metering, authentication, or developer tooling.