 |
OpenAI PodcastAndrew Mayne in conversation with OpenAI Author: OpenAI
Hosted by Andrew Mayne, The OpenAI Podcast features conversations with the people building with and working at OpenAI. Topics range from how new features are developed to what users are doing with the technology. Its a practical look at how AI is made and where its going, told by the people closest to the work. Hosted on Acast. See acast.com/privacy for more information. Language: en Genres: Science, Technology Contact email: Get it Feed URL: Get it iTunes ID: Get it |
Listen Now...
Episode 18 - Why AI needs a new kind of supercomputer network
Episode 18
Wednesday, 6 May, 2026
Training frontier models isn’t as simple as adding more GPUs—one small problem and the whole coordinated dance falls apart. OpenAI’s Mark Handley and Greg Steinbrecher discuss how a new supercomputer network design, used to train some of the company’s latest models, keeps the whole system moving in lockstep, even with record numbers of GPUs. They break down Multipath Reliable Connection, a new protocol OpenAI developed with AMD, Broadcom, Intel, Microsoft, and Nvidia, and why they’re making it available for the whole industry to use.Chapters00:00 Intro00:39 Greg and Mark's paths to OpenAI04:34 Why training AI stresses networks differently10:05 Bottlenecks, failures, and the cost of waiting15:19 How Multipath Reliable Connection works18:59 A protocol to route around failures25:05 Why OpenAI is making MRC an open standard35:09 Could AI compute move to space? Hosted on Acast. See acast.com/privacy for more information.
