Sandbox Operator: Enabling Session-Aware, Efficient MCP Tool Execution... Mingshan Zhao & Zhen Zhang

This talk covers the implementation of the Sandbox Operator to enhance the execution of session-aware and efficient MCP tools within Kubernetes. The speakers, Mingshan Zhao and Zhen Zhang from Alibaba, discuss the challenges of maintaining contextual state in user sessions while managing resource constraints in Kubernetes environments. They highlight issues such as excessive Pod growth due to massive concurrent sessions and resource waste from idle Pods. The session explores core features of the Sandbox Operator, including the management of Sandbox Pods, integration of checkpoint and snapshot mechanisms to preserve tool state, and techniques for reconstructing tool context to ensure continuity for users.