Locking Down Ray Serve: How to Secure Ur ML Models? - Kateryna Hrytsaienko, Valtech

This talk presents an in-depth analysis of securing Ray Serve for machine learning models within Kubernetes environments. The speaker, Kateryna Hrytsaienko from Valtech, addresses the complexities of managing data flow and communication between clusters. The session explores in-cluster access controls, multi-cluster communication, and effective secret management strategies, aimed at preventing unexpected disruptions. Attendees can expect to learn from real case studies that highlight both successful approaches and significant pitfalls, accompanied by practical configurations and cautionary advice.