Operationalizing AI Workloads on Kubernetes With OpenKruise - Zhang Zhen & Vec Sun

This talk covers the operational challenges of handling AI workloads on Kubernetes, presented by Zhang Zhen from Alibaba Cloud and Vec Sun from Xiaohongshu. The speakers discuss the need for pre-warming container images to ensure quick startups due to large models and libraries, as well as the complexities of managing distributed training jobs that use PodGroups. They introduce OpenKruise's solutions, including cron-based pre-warming, an advanced disruption policy for maintaining PodGroup availability, and enhancements to support planned in-place restarts of entire PodGroups. These innovations aim to improve the reliability and efficiency of AI workload operations on Kubernetes at scale.