Volcano: Orchestrating the Full AI Lifecycle – From Training To Inferen... Chen Zicong & Hajnal Máté

This talk explores how Volcano, developed by Huawei Technologies and Aumovio, serves as a Unified Scheduling Platform capable of orchestrating the full AI lifecycle, from training to inference and agent workloads. The speakers highlight how Volcano addresses infrastructure fragmentation by delivering high throughput scheduling and enabling multi-scheduler coordination for diverse workloads beyond batch jobs. Key topics include the capabilities of Volcano-Global for splitting massive training jobs across clusters, Kthena for enterprise-grade LLM serving, and AgentCube for rapid agent workload scheduling. Additionally, the session covers the modern resource abstraction offered by Volcano through DRA integration, GPU sharing, and heterogeneous pooling to improve task-to-accelerator mapping efficiency.