Qualification

This is a hands-on roleAs part of our teamArchitect our LLM platformBuild agentic systemsOwn retrieval over clinical dataMake evaluation a first-class systemRun AI/ML in productionPrototype with usersSet the barHealthcare or clinical NLP experienceFine-tuningInference optimization

Required

Zus is hiring a Staff/Principal AI/ML Engineer to define how LLMs and AI agents power our products and the AI platform underneath them. You'll be one of the most seasoned AI/ML voices in the building, with real ownership of architecture, tooling and roadmap.
Zus aggregates clinical data from across the healthcare ecosystem. That data is messy, multi-modal and enormously valuable. Modern foundation models finally make it possible to turn it into structured, trustworthy insight at the point of care and across populations. Your job is to make that happen, safely and at scale.
This is a hands-on role. You'll write production code, ship prototypes to real users, set technical direction, and mentor the engineers who build alongside you. This work will require interactions with solution engineers, product managers, sales, and marketing.
As part of our team, you will...
Architect our LLM platform. Design the shared infrastructure every AI feature at Zus runs on: model gateway and routing across frontier and open-weight models, prompt and version management, caching, cost and latency controls, and PHI-safe guardrails.
Build agentic systems. Ship tool-using agents that reason over a patient's longitudinal record by summarizing histories, reconciling medications, surfacing care gaps and answering clinician questions with cited evidence. Use patterns like MCP servers, function calling and multi-step planning.
Own retrieval over clinical data. Build RAG and hybrid search over FHIR resources and unstructured notes: chunking and embedding strategies for clinical text, vector and graph retrieval, reranking, and grounding so every answer traces back to its source document.
Make evaluation a first-class system. Stand up offline and online evals: golden datasets with clinical reviewers, LLM-as-judge pipelines, regression suites in CI, and production monitoring for hallucination, drift and safety.
Adapt models when prompting isn't enough. Fine-tune and distill (LoRA/PEFT, SFT, preference optimization) for clinical extraction, coding and normalization tasks where smaller, cheaper, specialized models win.
Run AI/ML in production. Build CI/CD for models and prompts, inference serving, observability and human-in-the-loop feedback loops that turn user corrections into better models.
Prototype with users. Work directly with providers, product managers and engineers to find high-leverage problems, ship prototypes fast, and iterate on real usage.
Set the bar. Lead design reviews, write the docs and standards others build on, mentor engineers, and keep Zus current as the AI landscape moves.

Preferred

Healthcare or clinical NLP experience, especially with FHIR, C-CDA, clinical terminologies or HIPAA-regulated data.
Fine-tuning, distillation or preference optimization of LLMs at meaningful scale.
Built MCP servers or multi-agent systems used in production.
Inference optimization: quantization, speculative decoding, batching, GPU cost management.
Designed and executed pre-training of transformer models.
Open-source contributions, publications or talks in ML, NLP or LLM systems.
Experience as the first or founding ML engineer at a growth-stage company.
MS or PhD in a quantitative field.

Staff/Principal AI/ML Engineer at Zus Health · LumiJobs

Staff/Principal AI/ML Engineer

Responsibilities

Qualification

Required

Preferred

Benefits

Company

Zus Health

More roles at Zus Health