Lightning Talk: Live Migration of PyTorch GPU Nodes From Azure To European Clouds - Mike Krom

This talk covers the live migration of PyTorch GPU nodes from Azure to European cloud providers, addressing the sovereignty concerns for European teams using hyperscalers like Azure, AWS, or GCP for their ML workloads. The speaker, Mike Krom from Acf Cyber Solutions, demonstrates the process of migrating a GPU-enabled PyTorch virtual machine, including essential components such as CUDA drivers and Jupyter notebooks, without the need to retrain models or rebuild environments. Practical challenges like GPU compatibility, reproducibility, and data movement across clouds are discussed, with a focus on using DigitalNomadSky, an open-source platform for cross-cloud VM migration, illustrating how to maintain control over ML infrastructure while mitigating risks associated with jurisdiction and vendor lock-in.