Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems) at Crusoe · LumiJobs

Responsibilities

We are looking for a Staff Engineer to be the technical lead and systems architect for Crusoe's Managed Data Transfer (MDT) service, the person who owns how its parts fit together and how MDT fits into Crusoe Cloud. MDT moves petabyte-scale training data between hyperscaler storage and Crusoe storage as a managed service, so AI labs and Physical AI companies can train on Crusoe GPUs without building their own transfer pipelines. You will design the control plane, the transfer worker fleet and the integration with Crusoe's storage and network, and set the path for adding other clouds and Crusoe-internal transfers.
This is an engineering leadership role on a new team. Managed Data Transfer starts from a working prototype that already serves customers in production, so your first decisions are about what to keep, harden or replace, and how to sequence that work without disrupting the customers who depend on it. You will lead the design through Crusoe's architecture review, mentor the engineers who build it, and report to the Engineering Manager of Managed Data Transfer within Managed platform services.
What You'll Be Working On:
Architecture Ownership: Own the end-to-end design of MDT: the job API and scheduler, the transfer workers on Kubernetes, storage integration and network paths. You decide what the system looks like and explain why.
Prototype Assessment and Migration: Evaluate the production prototype, decide what gets refactored, extended or replaced, and move its current users onto the managed service without interruption.
Throughput and Correctness: Set the data-plane strategy (sharding, concurrency, straggler handling, checksum verification) and the benchmarks that prove it, aiming for line-rate transfers over dedicated interconnects.
Cross-Team Contracts: Own the interfaces between MDT and Storage, Network, Kubernetes, IAM, Console, Billing and Monitoring. You define what partner teams build to and hold the line on it.
Extensibility and Build-versus-Buy: Design for new clouds and Crusoe-internal transfers with a pluggable transfer engine and regional worker pools, and evaluate open-source and vendor options before the team builds.
Operational Excellence: Set the bar for reliability, observability and on-call for every system the team ships.
Product Partnership: Work with Product on scope, pricing trade-offs and milestones, and surface edge cases early enough to change the plan.
Technical Mentorship: Raise the team's level through design reviews, RFC feedback and direct coaching, so the team runs well without depending on you.
What You'll Bring to the Team:

Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems)

Responsibilities

Qualification

Preferred

Benefits

Company

Crusoe

More roles at Crusoe