Shaping Intelligent APIs: Scaling LLMs, Open Ecosystems, Enterprise AI - Daniel Oh

This talk focuses on the significance of designing and scaling AI-powered APIs in the context of Large Language Models (LLMs) and enterprise transformation. Daniel Oh, a Java Champion and Senior Principal Developer Advocate at Red Hat, explores how LLMs, Open API standards, and cloud-native architectures collaborate to redefine intelligent and interoperable enterprise systems. The session emphasizes the integration of AI models with business applications through OpenAPI specifications and covers key topics such as GPU optimization, latency management, and distributed reliability using technologies like Kubernetes, Knative, and Quarkus. Through real-world case studies, participants learn how to bridge AI innovation with platform engineering and address important considerations regarding ethics, governance, and regulatory compliance for scalable AI deployment.