Sponsored Keynote: Inference and Sovereign AI: Scaling Cloud-Nat... Karena Angell & Vincent Caldeira

This talk focuses on the challenges of deploying inference pipelines at scale for cloud-native AI applications. The speakers, Karena Angell and Vincent Caldeira from Red Hat, introduce Sovereign AI, a Kubernetes-native approach that balances performance, scalability, and control. They discuss real-world strategies for hardware-aware scheduling, dynamic scaling, and multi-tenant resource management, aiming to help teams manage low-latency and high-throughput AI services on diverse infrastructures. Attendees will gain insights into containerizing models, optimizing GPU usage, and ensuring compliance with regulatory requirements while running AI workloads efficiently and securely.