Road to a self-healing infrastructure with HolmesGPT and a private LLM - Victor Getz and Artem Lajko

This talk demonstrates how to set up a private, on-premise, container-based large language model (LLM) using Terraform and Kubernetes. It delves into adding gigabytes of documents and interacting with private, sensitive data. The session includes a live demonstration of connecting the LLM to HolmesGPT, showcasing its ability to automatically resolve Kubernetes-related issues. Artem Lajko and Victor Getz, both experienced in cloud architecture and Kubernetes, lead the discussion, sharing insights from their extensive backgrounds in software development and platform engineering.