REST in Peace: AI Needs to Be Async - Meet Asya - Artem Yushkovskiy, Delivery Hero

This talk, titled "REST in Peace: AI Needs to Be Async," features Artem Yushkovskiy from Delivery Hero as he explores the evolving landscape of AI orchestration. He discusses how modern AI involves intricate interactions among various models, tools, and services, tackling challenges such as errors, timeouts, and rate limits. Yushkovskiy introduces the Asya framework, which utilizes message queues and actor-model microservices for handling asynchronous processes. He emphasizes the benefits of this approach, including independent scalability and enhanced composability, and highlights its successful implementation in production environments to manage real AI workloads effectively.