AI'm at the Gate! Introducing the AI Gateway Working G... Morgan Foster, Nir Rozenbaum & Shachar Tal

This talk introduces the AI Gateway Working Group in Kubernetes, presented by Morgan Foster and Nir Rozenbaum from Red Hat, along with Shachar Tal from Palo Alto Networks. The session outlines the group's mission, scope, and early initiatives focused on developing standards at the intersection of artificial intelligence and networking. With the increasing reliance on gateways, load balancers, and proxies for AI systems, the group aims to standardize important features such as external AI backend callouts for egress scenarios and payload-processing hooks. Attendees will gain insights into initial designs, early prototypes, and the evolving roadmap of AI-aware gateway capabilities in Kubernetes, along with opportunities for their involvement.