name: inverse layout: true class: center, middle, inverse
--- # Galaxy Monitoring with Telegraf and Grafana .footnote[Tip: press `P` to view the presenter notes] ??? Presenter notes contain extra information which might be useful if you intend to use these slides for teaching. Press `P` again to switch presenter notes off --- ### <i class="fa fa-question-circle" aria-hidden="true"></i><span class="visually-hidden">question</span> Questions - How to monitor Galaxy with Telegraf - How do I set up InfluxDB - How can I make graphs in Grafana? - How can I best alert on important metrics? --- ### <i class="fa fa-bullseye" aria-hidden="true"></i><span class="visually-hidden">objectives</span> Objectives - Setup InfluxDB - Setup Telegraf - Setup Grafana - Create several charts --- # Telegraf, InfluxDB, and Grafana General purpose tools for monitoring systems and services. Tool | Use --- | --- [Telegraf](https://github.com/influxdata/telegraf) | plugin-driven server agent for collecting & reporting metrics [Influxdb](https://github.com/influxdata/influxdb/) | purpose built time series database [Grafana](https://grafana.com/) | dashboard for beautiful analytics and monitoring Dataflow: - Galaxy produces data - Telegraf consumes and buffers it, before sending it to - InfluxDB which stores the data - And Grafana is used to visualise it --- # Infrastructure for Grafana * Everything captured in Galaxy Ansible [infrastructure-playbook](https://github.com/galaxyproject/infrastructure-playbook/) repository. * Ansible [playbook](https://github.com/dj-wasabi/ansible-telegraf) to install Telegraf. * Ansible [tasks](https://github.com/galaxyproject/infrastructure-playbook/blob/master/roles/stats/tasks/redhat.yml) for installing InfluxDB and Grafana. --- # Grafana showcase * usegalaxy.eu [public server](https://stats.usegalaxy.eu) * usegalaxy.org.au [public server](https://stats.genome.edu.au) * usegalaxy.org private server If you see a dashboard you can export its configuration and put it on your Grafana with your data. Copy away! --- ### <i class="fa fa-key" aria-hidden="true"></i><span class="visually-hidden">keypoints</span> Key points - Telegraf provides an easy solution to monitor servers - Galaxy can send metrics to Telegraf - Telegraf can run arbitrary commands like `gxadmin`, which provides influx formatted output - InfluxDB can collect metrics from Telegraf - Use Grafana to visualise these metrics, and monitor their values --- ## Thank you! This material is the result of a collaborative work. Thanks to the [Galaxy Training Network](https://wiki.galaxyproject.org/Teach/GTN) and all the contributors!