Cerebras Software Engineer on the Host and Network IO Team developing full IO path implementation for AI/HPC systems. Responsible for optimizing bandwidth, latency, and network traffic while interfacing with multiple teams and hardware components.
Responsibilities
The Host and Network IO Team develops the full IO path implementation between a distributed system of server nodes, through the cluster, down to the custom RoCE network stack implemented in Cerebras' system, and over the proprietary IOs onto the WSE. As a software developer on the team, you will interface between AI application-level IO teams, cluster architecture teams, and FPGA/ASIC teams to develop solutions that optimize bandwidth and latency while minimizing congestion, pauses, pause spreading, unfairness, etc. Strong skills in socket programming will enable you to deploy robust management operations, while deftness in RDMA Verbs will enable you to optimize CPU resources and shape network traffic to deliver real world impact on AI performance metrics, as well as developing tools for gaining insight and visibility into network behavior. Meticulous analysis and rigour are key tenants of this role, harnessing that together with a deeply-understood mental model of the server, NIC, protocol, switch, and custom hardware behavior will enable you to lead network debug, optimize traffic patterns, and prescribe architectural changes.
Develop x86 & ARM software to expose next-generation hardware IO capabilities for AI/HPC application teams
Govern a generic IO API with multiple internal users.
Develop control and configuration subsystems directly interacting with Cerebras hardware
Drive network performance debug of large AI clusters
Gather and analyze network statistics and packet traces to root cause and alleviate bottlenecks and sub-optimalities.
Develop tools/telemetry for increasing visibility into the network and IO datapath.
Optimize cpu/mem utilization leveraging kernel bypass and zero-copy techniques
Integrate leading edge networking technologies and protocols
Lead cross-functional technical projects spanning multiple teams and integrating diverse software and hardware components to deliver an improved network IO solution.
Foster clear and effective communication across teams and stakeholders.
Skills & Qualifications
Qualification
Required
Master's/PhD in Computer Science or Electrical Engineering + 1 year industry experience, OR 3+ years industry experience
