Hacking GPU Observability: eBPF & Ephemeral Containers in Action on Kubernetes - Brandon Kang

This talk covers the challenges of observing and securing GPU workloads on Kubernetes, particularly in the context of scaling AI and ML pipelines. The speaker, Brandon Kang from Akamai Technologies, demonstrates how ephemeral containers and eBPF can be utilized together to troubleshoot, monitor, and protect GPU-based applications without disrupting production. Attendees will learn to replicate live GPU environments for debugging, leverage eBPF for real-time kernel-level telemetry, and implement anomaly detection and zero-trust policies. The session features practical examples, including tracing GPU performance bottlenecks and securing container provenance using cryptographic techniques, equipping participants with effective strategies for managing and safeguarding their GPU pipelines.