Baseten Data Center Hardware Operations Site Lead at Baseten responsible for managing physical infrastructure and GPU fleet operations at a data center site. Role includes planning, installation, maintenance, and team management.
Responsibilities
As a Data Center Hardware Operations Site Lead at Baseten, you'll own the physical infrastructure behind our GPU fleet at one of our data center sites. You'll plan and lead the installation, cabling, and turn-up of new GPU clusters, keep existing clusters healthy through break/fix and upgrades, and decommission hardware when it's time. You'll work closely with our DC facilities, network, and hardware systems engineering teams across the full bare metal server lifecycle.
This is a senior, fully on-site role with a lot of ownership. You'll be the technical and project lead for your site and its first point of escalation when something goes wrong, whether that's a failed switch or a cooling alarm. You'll direct the day-to-day work of the FTE and contractor staff at your site, and partner with Site Leads at our other locations and our data center infrastructure lead to keep standards consistent across the fleet.
EXAMPLE INITIATIVES
The GPU clusters you deploy and maintain power work like this:
Multi-cloud capacity management
Inference on B200 GPUs
Multi-node inference
NVIDIA B300 vs. GB300
Lead the physical deployment of new GPU clusters at your site, including rack and stack, cabling, and turn-up in partnership with the network and hardware systems engineering teams.
Plan white space for new and existing data halls with DC Facilities, including cabinet positions, fiber tray design, rack elevations, and the power, cooling, and network capacity needed for high-density GPU racks.
Support new data hall bring-up through site walks, drawing review, and construction-to-operations turnover.
Own break/fix and hardware lifecycle at your site, from diagnosing failures and coordinating RMAs to executing upgrades, switch refreshes, and decommissioning with minimal disruption to production.
Qualification
Hands-on experience rackingAbility to work on-site at [location]Experience with Cisco IOS
Required
Bachelor's degree in a technical field or equivalent practical experience.
6+ years of experience in data center operations, with at least 2 years in a lead or supervisory role.
Hands-on experience racking, stacking, and cabling servers and network gear at scale, including copper and fiber.
Experience across the full bare metal server lifecycle: installation, break/fix, upgrades, and decommissioning.
Comfort on the Linux command line for hardware diagnostics, using tools like ipmitool, dmesg, and lspci.
Working knowledge of data center networking, enough to troubleshoot optics, transceivers, and link errors.
Working knowledge of data center mechanical and electrical systems, including power distribution (UPS, PDUs, RPPs, busway), cooling (CRAH/CRAC units, containment, liquid cooling), and BMS/EPMS alarms, enough to recognize issues and escalate them with clear technical context.
A track record of leading data center projects end to end, such as cluster deployments or data hall builds.
Experience directing contractors and vendors and coordinating work across facilities, network, and engineering teams.
Sound judgment and quick prioritization under pressure, including knowing when to escalate.
Ability to work on-site at [location], lift up to 50 lbs, work in elevated locations, and participate in an on-call rotation supporting 24/7 operations.
Preferred
Experience deploying and maintaining large NVIDIA GPU clusters (HGX/DGX platforms such as H100, H200, or B200).
Hands-on experience with direct liquid cooling, including CDUs, rear door heat exchangers, and leak response.
Construction and commissioning experience, such as reviewing submittals or witnessing tests for new data halls.
Experience with high-performance interconnects such as InfiniBand or RoCE.
Experience with Cisco IOS, Juniper Junos, or similar network operating systems.
Experience with DCIM tools such as NetBox.
Scripting in Python or Bash to automate diagnostics or inventory tasks.
Certifications such as CompTIA Server+ or Network+.