Crusoe The Staff Storage Engineer at Crusoe leads architecture and operation of the data layer for the AI cloud storage environment. This role involves performance tuning, vendor collaboration, and managing large-scale storage infrastructure.
Responsibilities
At Crusoe, we are on a mission to align the future of computing with the future of the climate. As a Staff Storage Administrator on the Storage Team, you will be the lead architect and operator of the data layer for our vertically integrated AI cloud. This team sits at the critical intersection of massive-scale data ingress/egress and high-performance GPU workloads, ensuring that our sustainable clusters deliver world-class data throughput for the world’s most demanding AI and HPC use cases.
What You'll Be Working On:
Performance Analysis & Optimization: Evaluate performance of block, file, and object storage systems across diverse workloads. Identify bottlenecks at the hardware, firmware, OS, and application layers. Develop and execute performance test plans, benchmarks, and stress tests. Tune storage stacks (I/O schedulers, caching layers, drivers, protocols) to achieve target KPIs.
Validation & Testing: Design and execute Proof of Concept (PoC) exercises to take new arrays through their paces. You will validate new vendor software releases in staging environments before rolling them out to our global production footprint.
Full-Stack Administration: Own the initial bring-up, configuration, and ongoing performance tuning of large enterprise arrays. You will manage the lifecycle of the storage OS, ensuring all systems are optimized for AI training and inference I/O patterns.
Enterprise Infrastructure Building: Collaborate with the Compute and Networking teams to build a seamless "gold standard" cloud infrastructure. You will design cloud-scale storage systems that can excel in high-concurrency, high-throughput environments.
Storage Strategy & Selection: Lead the technical evaluation of new storage technologies. You will be responsible for authoring RFPs, reviewing vendor responses, and leading "down selection" processes to ensure we invest in the best hardware for AI workloads.
Vendor Roadmap Influence: Serve as the primary technical point of contact for storage partners (such as VAST Data, Pure Storage). You will sit with their engineering teams to provide feedback on bugs, missing features, and prioritize Crusoe’s requirements on their development roadmaps.
Cross‐Functional Collaboration: Work closely with service engineering and architecture teams to influence design decisions. Provide performance guidance during feature development and release cycles. Communicate findings to both technical and non‐technical stakeholders.
What You'll Bring to the Team:
10+ years of experience in storage systems administration, with a heavy focus on petabyte-scale, on-premise data environments.
Hands-on production experience administering VAST Data and/or Pure Storage (Everpure) arrays, including bring-up, configuration, upgrades, and performance tuning.
Qualification
Experience with RDMA
Preferred
Experience with RDMA, iSCSI, NVME-oF, RoCEv2 or InfiniBand networking as it relates to high-performance storage.
Previous experience at a major Cloud Service Provider (CSP) or a high-scale AI infrastructure company.
Familiarity with distributed storage systems (Ceph, Lustre, Gluster, etc.).