Spark performance tuning for Kubernetes/Serverless workloads - Rachit Arora

This talk focuses on optimizing Spark jobs within cloud platforms, emphasizing the need for efficiency when creating temporary Spark clusters, whether through Function as a Service or on Kubernetes. The speaker explores practical tips for tuning Spark jobs on widely-used Resource Managers like Yarn and Kubernetes, aiming to enhance performance and reduce costs. Additionally, the session addresses common questions from users and customers related to Spark Clusters on various cloud platforms, providing insights that help maximize resource utilization.