About this talk
In this session, Michael Schmid provides an insightful overview of how amazee.ai operates its AI infrastructure on a global scale. He discusses the complexities behind AI development that go beyond a simple API endpoint, including the execution of large language models, the functionality of VectorDBs, and the tools used for monitoring, alerting, and metrics. Additionally, he addresses the important topics of privacy and data compliance while showcasing actual demos and dashboards, offering attendees a detailed look at cutting-edge practices in open-source and privacy-first AI implementation.