SIG Network: The State of Networking for AI on Ku... David M, Haiyan M, Bowei D & Kellen S & Nadia P

This talk covers the advancements in networking for AI use cases within Kubernetes, presented by David Martin from Red Hat and other panelists from Google and NVIDIA. The session highlights key projects and initiatives, such as the Gateway API and its Inference Extension, while also maintaining Kubernetes as a tier 1 platform for AI workloads. The speakers engage in both presentations and guided discussions, focusing on how networking for AI has unique requirements while still resembling general networking practices. Attendees are encouraged to participate and bring questions regarding the future of AI networking on Kubernetes.