View markdown source on GitHub

Galaxy Monitoring

Contributors

Nate Coraor, Björn Grüning, Simon Gladman, Helena Rasche
last_modification Last modification: Apr 6, 2021

Manage Jobs

An admin interface to list current unfinished jobs and finished jobs of a certain age.


Log Files


Analytics

Can we make better walltime decisions?

scripts/runtime_stats.py: Database-driven job runtime statistics


Reports

Galaxy ships with its own app that reports usage (user, job, data, etc numbers)


Nagios

Nagios is a general-purpose tool for monitoring systems and services.

Galaxy-specific check in contrib/nagios/: Runs Galaxy jobs


Sentry


Job Metrics

Galaxy can collect metrics on each job through configurable plugins in job_metrics_conf.xml.

Some plugins:


Telegraf, InfluxDB, and Grafana

General purpose tools for monitoring systems and services.

Tool Use
Telegraf plugin-driven server agent for collecting & reporting metrics
Influxdb purpose built time series database
Grafana dashboard for beautiful analytics and monitoring

Dataflow:


Infrastructure for Grafana


Grafana showcase

If you see a dashboard you can export its configuration and put it on your Grafana with your data. Copy away!


Thank you!

This material is the result of a collaborative work. Thanks to the Galaxy Training Network and all the contributors! page logo This material is licensed under the Creative Commons Attribution 4.0 International License.