DrupalCon Amsterdam 2014: Using Open Source Logging and Monitoring Tools

In this talk, Steven Merrill explores the importance of monitoring logs and metrics generated by the daemons that support website production. He discusses how open-source tools like collectd and Logstash can be leveraged to gather system-level metrics, ship and parse logs from various servers in a Drupal hosting stack, and display this data using applications such as Kibana and Grafana. The session also covers best practices for obtaining detailed insights from logs, including capturing millisecond durations for server metrics and the use of the ELK stack on drupal.org to efficiently manage and analyze billions of logs each month. Attendees will gain practical knowledge on applying these strategies to enhance their own logging infrastructure and track trends effectively.