DrupalCon Dublin 2016: Building High Available ELK for Drupal

This talk addresses the challenges of setting up a scalable ELK solution to manage massive spikes in log volume, specifically designed for sysadmins and system-savvy developers. The speaker, Marji, discusses the implementation of a highly available ELK stack capable of processing logs and metrics from various servers and Drupal environments. Key topics include designing a scalable architecture, autoscaling Logstash indexers, preventing Elasticsearch from running out of disk space through S3 backup and curator strategies, and securing log transmissions with TLS/SSL. Marji shares insights from his two years of experience running ELK stacks for hundreds of Drupal servers while also exploring methods for log transmission from Drupal to Logstash.