Keynote: vLLM & Ray Updates - Tyler Michael Smith & Artur Niederfahrenhorst

This keynote session features Tyler Michael Smith, Chief Architect of Inference Engineering at Red Hat, and Artur Niederfahrenhorst, Member of Technical Staff at Anyscale. The speakers provide updates on vLLM and Ray, exploring their advancements in the realm of large language models and distributed computing. They discuss the implications of these technologies on inference engineering and highlight best practices for optimizing performance in machine learning workflows. Attendees gain valuable insights into the state of the art in scalable AI applications.