View markdown source on GitHub

Galaxy on the Cloud

Contributors

Simon Gladman
last_modification Last modification: Jul 26, 2021

All these Clouds

It’s positively meterological..


Overview

.large[

Speaker Notes


Help!

.large[

What do you do now? ]


Help!

.large[

What do you do now?

.special[Use the cloud man!] ] .center[cloudman]


Clouds?

Cloud computing … is a model for enabling ubiquitous, on-demand access to a shared pool of configurable computing resources … which can be rapidly provisioned and released with minimal management effort. Cloud computing and storage … may be located far from the user – ranging in distance from across a city to across the world. - Wikipedia, Cloud Computing.

.center[Amazon Web Services OpenStack
Google Cloud Microsoft Azure]

Speaker Notes

On demand, free or paid, transient, NOT meant to be persistent, turn off when you don’t need them.


Available Clouds

.large[

Speaker Notes

Really want to monitor how much you’re using these in order to minimize costs. They do give out edu grants and Galaxy has received large ones at GCCs.

Aussie one is free, same in UK, Jetstream you need to obtain credits through a granting agency


Why Clouds?

.large[

Speaker Notes

Have a course, suddenly 150 people show up and are flooding the normal queue, expecting to run jobs in workshops and not sit in queue for 2 days since they won’t be here tomorrow. Cloud is a great way to instantly provide resources.

EU does Training Infrastructure as a Service and spins up cloud resources whenever they need.

Don’t have to purchase + maintain hardware, which is great. Uploading data can be difficult.


Galaxy on the Cloud

.large[

Speaker Notes

The GVL image has CVMFS pre-installed, same for other Galaxy images, basically ready to go. Provide cloud credentials to CloudLaunch and it will manage Galaxy on your behalf


CloudLaunch

.large[

Speaker Notes

How do you get more cloud resources? Obtain resources from provider and then use CloudLaunch


Launch Demo

.large[ End-user perspective

https://launch.usegalaxy.org/ ]


Cloud Manager

.center[cloudman logo, a small puffy white man with a yellow tie.]

.large[


CloudMan

.center[.reduce80[cloudman admin interface showing a cluster and controls. Three squares are green indicating worker nodes.]]

Speaker Notes

The green are worker nodes


CloudMan Admin

.center[.reduce80[cloudman admin interface showing a list of services which can be started or stopped and their state, like galaxy is running and pulsar is unstarted.]]

Speaker Notes

Can start NGINX, Galaxy, Pulsar, etc.


Cluster on the Cloud?

.large[


Auto-Scaling

.large[

.center[.reduce60[Screenshot of cloudman autoscaling configuration with a minimum and maximum number of worker nodes to maintain.]]


CloudMan Galaxy

.large[


CloudMan Galaxy

.pull-left[ .reduce85[A toolbox showing some common tools] ] .pull-right[ A tool interface showing many datasets provided by cvmfs and the reference data from Galaxy. ]


CloudMan Galaxy


Persistence

.large[

Speaker Notes


Looking to the future

.large[


Thank you!

This material is the result of a collaborative work. Thanks to the Galaxy Training Network and all the contributors! page logo This material is licensed under the Creative Commons Attribution 4.0 International License.