Ocean's variables study

Author(s) Marie Josse avatar Marie Josse
Overview
Creative Commons License: CC-BY Questions:
  • How to process extract ocean’s variables?

  • How to use ODV collections?

  • How to create climatological estimates?

Objectives:
  • Deals with ODV collection with data orginating from Emodnet chemistry

  • Visualise ocean variables in order to study climate changes

Requirements:
Time estimation: 1 hour
Supporting Materials:
Published: Nov 29, 2023
Last modification: Nov 29, 2023
License: Tutorial Content is licensed under Creative Commons Attribution 4.0 International License. The GTN Framework is licensed under MIT
purl PURL: https://gxy.io/GTN:T00376
version Revision: 6

Introduction

Through this tutorial, you will learn in the first part how to import, visualise, and extract data from an ODV collection by using the ODV Galaxy interactive tool. In the second part, you will learn how to use DIVAnd using the inputs the outputs from ODV.

Ocean Data View (ODV) is a software package for the interactive exploration, analysis and visualization of oceanographic and other geo-referenced profile, time-series, trajectory, or sequence data. To know more about ODV go check the official page

DIVAnd (Data-Interpolating Variational Analysis in n dimensions) performs an n-dimensional variational analysis/gridding of arbitrarily located observations. Observations will be interpolated/analyzed on a curvilinear grid in 1, 2, 3 or more dimensions. See the official page

Agenda

In this tutorial, we will cover:

  1. Introduction
  2. Managing ODV Galaxy interactive tool
  3. Ocean Data View
    1. Visualise your Data
    2. Subset Data
    3. Save Data
  4. DIVAnd : Data-Interpolating Variational Analysis in n dimensions
    1. Change Datatype
    2. Launch DIVAnd
  5. Conclusion
  6. Extra information

Managing ODV Galaxy interactive tool

ODV is now integrated in Galaxy as an interactive tool. This kind of tool works differently than classical tools as it allows the user to interact in an interactive way with your data. This kind of tool is used to give access to Jupyter notebooks, RStudio or R Shiny apps for example.

To use ODV, you need to use the dedicated form, you can specify input datasets from your history you want to use in ODV, then press the execute button to launch an ODV instance. When the graphical user interface of ODV is ready to be used, a URL will be displayed at the top of the Galaxy center panel. If you don’t see it, you can see and access it through the “Active InteractiveTools” space of the “User” menu or you can click on galaxy-eye on the tool in the history.

Once you finish your work on ODV, if you want to retrieve data and/or the entire project, you need to save files in ODV/galaxy/outputs, then quit ODV properly through the “Project” Menu tab.

You can come back to where you left off the tutorial anytime by clicking level.

Hands-on: Log in to Galaxy
  1. Open your favorite browser (Chrome, Safari or Firefox as your browser, not Internet Explorer!)
  2. Browse to your Galaxy instance
  3. On the top panel go to Login or Register

The Galaxy homepage is divided into three panels:

  • Tools on the left
  • Viewing panel in the middle
  • History of analysis and files on the right
Screenshot of the Galaxy interface, the tools panel is on the left, the main panel is in the center, and the history is on the right.Open image in new tab

Figure 1: Galaxy interface explanation

The first time you use Galaxy, there will be no files in your history panel.

Hands-on: Deploy your own ODV instance
  1. Create a new history for this tutorial and give it a name (for example “Ocean’s variables”) for you to find it again later if needed.

    Click the new-history icon at the top of the history panel.

    If the new-history is missing:

    1. Click on the galaxy-gear icon (History options) on the top of the history panel
    2. Select the option Create New from the menu

  2. Import a ODV collection data locally as a zip folder.

    1. Click on Upload Data on the top of the left panel
    2. Click on Choose local file and select the files or drop the files in the Drop files here part
    3. Click on Start
    4. Click on Close

  3. Ocean Data View with the following parameters:

    • “Select if you are using an ODV collection in a zip folder or if you have your own raw data”: The data you are using are an ODV collection in a zip folder
    • “ODV collection in a zip folder.”: Eutrophication_Med_profiles_2022_unrestricted_SNAPSHOT_2023-10-24T16-39-44.zip

Screenshot of what parameters to input in ODV before running the tool.

  1. Click on Run Tool
  1. Go to User > Active InteractiveTools
  2. Wait for the ODV to be running (Job Info)
  3. Click on ODV

The data here are Mediterranean Sea - Eutrophication and Acidity aggregated datasets EMODnet Chemistry aims to provide access to marine chemistry datasets and derived data products concerning eutrophication, acidity, and contaminants. The importance of the selected substances and other parameters relates to the Marine Strategy Framework Directive (MSFD). This aggregated dataset contains all unrestricted EMODnet Chemistry data on eutrophication and acidity and covers the Mediterranean Sea. Data were aggregated and quality controlled by the ‘Hellenic Centre for Marine Research, Hellenic National Oceanographic Data Centre (HCMR/HNODC)’ in Greece.

ITS-90 water temperature and water body salinity variables have also been included (‘as are’) to complete the eutrophication and acidity data. If you use these variables for calculations, please refer to SeaDataNet for the quality flags: https://www.seadatanet.org/Products/Aggregated-datasets.

Regional datasets concerning eutrophication and acidity are automatically harvested, and the resulting collections are aggregated and quality-controlled using ODV Software and following a common methodology for all sea regions ( https://doi.org/10.13120/8xm0-5m67). Parameter names are based on P35 vocabulary, which relates to EMODnet Chemistry aggregated parameter names and is available at: https://vocab.nerc.ac.uk/search_nvs/P35/.

When not present in the original data, water body nitrate plus nitrite was calculated by summing all nitrate and nitrite parameters. The same procedure was applied for water body dissolved inorganic nitrogen (DIN), which was calculated by summing all nitrate, nitrite, and ammonium parameters. Concentrations per unit mass were converted to a unit volume using a constant density of 1.25 kg/L. Hellenic Centre for Marine Research, Hellenic National Oceanographic Data Centre (HCMR/HNODC) 2022

Ocean Data View

Visualise your Data

You can expand the ODV left panel (where there are 3 dots, vertically) to access the “clipboard” menu and paste the content you want to paste on an ODV form. From there you can copy-paste everything from one side to the other. Then, click outside of this panel to collapse it.

Image showing in transparent on the left of the ODV interface the clipboard.

If at one point your ODV interface becomes grey with a red panel on the top “X ODV - Disconnected”, do NOT panic ;) you just need to reload your tab (circular arrow top left)

Hands-on: Loading data
  1. Click on close of the pop-up screen for the check for Updates
  2. Go the top left and click on File, then on Open…
  3. On the pop-up screen on the left panel select ODV, then the folder galaxy, then data. You should see a folder open it (double clicking)
  4. Select the file with a .odv extension Screenshot of what your pop-up screen should be like when selecting the right data.
  5. Click on Open in the bottom right

There your data should be opening an you can now visualise them!

Visualistation on an ODV map of the ODV collection.

Question
  1. What are the longitude and latitude of the red dot?
  1. On the to right window you can read Longitude 34°E and Latitude 32.332°N.

Subset Data

Hands-on: Create a subset
  1. On the left smaller map right click and select Zoom
  2. Then move your cursor on the map you should see a red rectangle moving along
  3. Reduce the rectangular to have the selection you want on the map. It can be something similar to the following image (no need to be exactly the same) Selection on the map of the part of the data that you want to analyse.
  4. Once you’re happy with your selection click on Enter on your keyboard. Result of the subsetting and how the maps should look now.

Here you have created a a subset of your data.

  1. Go to the central map
  2. Click right and select Properties…
  3. For example, make your data dots bigger in “Display Style” increase the number below “Symbol Size” to 50, and click OK Image on how to change the size of your dots.

You can now see bigger dots representing your data. Image of your maps after the increase of the dots' size.

If you want to save it now that you already saved it once in the right folder outputs you just have to click lef on te save icon top left when it’s red.

Save Data

Hands-on: Choose Your Own Tutorial

This is a "Choose Your Own Tutorial" section, where you can select between multiple paths. Click one of the buttons below to select how you want to follow the tutorial

Here you can choose if you want to save your view as an ODV view in xview format (you will not able to directly visualise it on Galaxy) or if you want to save it in png which you can visualise on Galaxy.

Hands-on: Save your subset view
  1. On the top left of your screen, you can see a red save button. Right-click on it.
  2. In the pop-up screen go to the folder ODV, galaxy, outputs.
  3. In File name rename your view (for example subset_Eutrophication_Med_profiles_2022), and Save.
Hands-on: Save your subset map
  1. Click right on the map and select Save Plot As…
  2. In the pop-up screen go to the folder ODV, galaxy, outputs.
  3. In File name rename your view (for example subset_Eutrophication_Med_profiles_2022_1)
  4. In Files of type select PNG (*.png *.PNG) and Save then OK and OK.
Hands-on: Extract your variables in netcdf data

Now we want to extract and save the right parameters of your data in netcdf format.

  1. Go to the the left and click on Export, Data and NetCDF File…
  2. In the pop-up screen go to the folder ODV, galaxy, outputs.
  3. Click Save
  4. A new pop-up window opens “Select Extended Metadata Variables for Export” Let the 56 items selected and click OK
  5. “Select Data Variables for Export” here you need to select 1: Depth[m], ̀4: Water body dissolved oxygen concentration [umol/l], 6: Water body phosphate [umol/l] and click OK Screenshot of the variables one needs to select.
  6. “NetCDF File Properties” change the Longitude range to [-180 ... 180] degrees_E, then select Export metadata quality flags and Export data quality flags and OK.
  7. And OK again

You now know how to export and save the right variables on ODV to netCDF data.

Now, if you have finished with your analysis you can exit ODV. To do so you need to do it properly.

Hands-on: Exit ODV and go back on Galaxy
  1. On the top left click on File select Exit
  2. If you want to save the other window also click on Yes. Here we don’t need it so click No.

You can now go back to your Galaxy instance. Now, after waiting for everything to turn green in your history, you can see 3 new outputs Screenshot of the 3 new outputs present in your galaxy History.

In the history panel click on the galaxy-eye (eye) icon of your output.

You can now visualize the outputs in Galaxy middle panel.

Screenshot of the text output showing the variables selected. Image in the middle pannel of the map.

DIVAnd : Data-Interpolating Variational Analysis in n dimensions

Change Datatype

Hands-on: Change the datatype from ODV outputs

Go to your output ‘data_from_Eutrophication_Med_profiles_2022_unrestricted’

In the Datatypes section select netcdf

  • Click on the galaxy-pencil pencil icon for the dataset to edit its attributes
  • In the central panel, click on the galaxy-gear Convert tab on the top
  • In the lower part galaxy-chart-select-data Datatypes, select your desired datatype
    • tip: you can start typing the datatype into the field to filter the dropdown menu
  • Click the Save button

Launch DIVAnd

Use ODV outputs (which you just changed the datatype) as DIVAnd input.

Hands-on: Run DIVANnd
  1. Use DIVAnd with the following parameters:
    • “Do you already have a notebook”: Start with a fresh notebook
    • “Include data into the environment”: data_from_Eutrophication_Med_profiles_2022_unrestricted
  2. Run tool
    1. Go to User > Active InteractiveTools
    2. Wait for the DIVAnd to be running (Job Info)
    3. Click on DIVAnd

Now that you are in your jupyterlab with the right environment to use DIVAnd and a set of notebooks (in the folder notebooks) to guide you, you can start the rest of your analysis. You can find your data from ODV in the data folder of the jupyterlab.

Once you are done you have to save all your wanted data and visualisation in the outputs folder and then go to the top left in the file section and click on Exit.

After a couple of minutes, your outputs should appear in your Galaxy history.

Conclusion

Great you now know how to extract ocean variables from an ODV collection and use these extracted data in DIVAnd.

Extra information

Coming up soon follow-up tutorials on Coastal Water Dynamics workflow (and other Earth-System related trainings). Keep an galaxy-eye open if you are interested!