Sponsored Keynote: From One Node to Distributed Training and Inference. How the PyTo... Ramine Roane

This keynote presentation by Ramine Roane, Corporate Vice President of AI Product Management and Ecosystem Development at AMD, focuses on the evolution of PyTorch from a research framework to a distributed-first platform designed for large-scale AI production. The speaker discusses the challenges associated with scaling inference across multiple nodes as AI models expand to hundreds of billions of parameters. Additionally, the session covers the emerging ecosystem surrounding PyTorch, including tools like Monarch and TorchTitan, as well as the development of open, hardware-agnostic systems that facilitate this transformation.