Small Non-coding RNAs (ncRNAs) play a vital role in many cellular processes such as RNA splicing, translation, gene regulation. The small RNA-seq is a type of RNA-seq in which RNA fragments are size selected to capture only short RNAs. One of the most common applications of the small RNA-seq is discovering novel small ncRNAs. Mapping the small RNA-seq data reveals interesting patterns that represent the traces of the small RNA processing.

For example, consider the miRNA biogenesis. The primary miRNA transcripts are processed by Drosha-complexes and results in hairpin precursor miRNAs. Then after they transported to the cytoplasm, Dicer slices off the hairpin. One of the RNA strands bound by Argonaute proteins regulates the target mRNA while the other strand is degraded.

The following figure (bottom part of the figure is taken from Pasquinelli 2012) represents one of the small RNA processing patterns. The vertical block bars represent a mapped reads on reference genome. The height of the bars represents the number of reads mapped at that location. Reads in each bubble represent a read profile. In this case, they both are from miRNAs. From the small RNA-seq, we often see the two processed miRNA strands after mapping. The miRNA strand which targets the mRNA is expressed and we see more reads compared to the degraded strand. The gap between those two piles of reads represents the missing hairpin.

Open image in new tab

In this tutorial, we will learn how to use BlockClust to cluster similar processing patterns together.

Agenda

In this tutorial, we will cover:

1. Preprocessing of the data
   1. Get data
   2. Sort BAM file
   3. BAM to BED of tags
2. Grouping of the adjacent reads into read profiles
   1. Sort the BED file of tags
   2. Group reads into blocks and blockgroups using blockbuster
3. Clustering with BlockClust
4. Conclusion

Preprocessing of the data

The data is we use is from human cell line MCF-7 sequenced in single-end on Illumina Genome Analyzer II. Reads are 36nt long and should be sufficiently long enough for this type of data. We start with a BAM file as an input for this tutorial. This BAM file is a result of mapping the reads on human reference genome build hg19 using segemehl. If you want to use your own raw sequencing data, please clip the adapters and map to the reference genome.

In the first step, we convert the BAM file into BED file. This is not a plain file conversion. Hence we cannot use any kind of BAM to BED conversion tools. We use BlockClust tool in the pre-processing mode for this purpose. The resulting BED file contains tags (a tag is a unique read sequence in a deep-sequencing library) and their normalized expression (in column 5), i.e. the ratio of the read count per tag to the number of mappings on the reference genome.

Get data

Hands-on: Data upload

1. Create a new history for this tutorial

   Tip: Creating a new history

   To create a new history simply click the new-history icon at the top of the history panel:

   

2. Import the files from Zenodo

   https://zenodo.org/record/2172221/files/GSM769512.bam
   

   Tip: Importing via links

   • Copy the link location

   • Click galaxy-upload Upload Data at the top of the tool panel

   • Select galaxy-wf-edit Paste/Fetch Data

   • Paste the link(s) into the text field

   • Press Start

   • Close the window

Question

Why is it mandatory to clip the adapters from the small RNA-seq data?

Solution

Generally, the processed RNA fragments from the small RNAs are about 18-30nt long. If the sequenced read length is longer than the fragment (which is usually the case), the sequencer reads into the 3’ adapter.

Sort BAM file

Before continue to BAM to BED conversion we need to sort the alignments in the input BAM file by their positions.

Hands-on: Sort BAM

1. Samtools sort tool with the following parameters:
   • param-file “BAM File”: GSM769512.bam

BAM to BED of tags

Now it is time to do the actual conversion.

Hands-on: BlockClust preprocessing

1. BlockClust tool with the following parameters:
   • “Select mode of operation”: Pre-processing
   • param-file “BAM file containing alignments”: output of Samtools sort tool

Grouping of the adjacent reads into read profiles

Now we group the adjacent reads into so-called blocks and blockgroups using blockbuster tool. In general, each blockgroup should represent a single ncRNA read profile.

Open image in new tab

Details: More details about the theory

The idea is to perform peak detection on the signal obtained by counting the number of reads per nucleotide. This signal, spanning adjacent loci, is then modeled with a mixture of Gaussians. An iterative greedy procedure is then used to collect reads that belong to the same block, starting from the largest Gaussian component, and removing them in successive iterations. The tool further assembles a sequence of adjacent blocks into a blockgroup if the blocks are either overlapping or are at a distance smaller than a user-defined threshold. A more detailed explanation is at the blockbuster website

Sort the BED file of tags

In order to run the blockbuster successfully the input BED file need to be sorted by chromosome, strand, start position and then end positions.

Hands-on: Sort the BED file

1. Sort tool with the following parameters:
   • param-file “Sort Query”: output of BlockClust tool
   • In “Column selections”:
     • “on column”: Column: 1
     • “Flavor”: Alphabetical sort
   • Click on “Insert Column selections”:
   • In “Column selections”:
     • “on column”: Column: 6
     • “Flavor”: Alphabetical sort
   • Click on “Insert Column selections”:
   • In “Column selections”:
     • “on column”: Column: 2
     • “Flavor”: Fast numeric sort
   • Click on “Insert Column selections”:
   • In “Column selections”:
     • “on column”: Column: 3
     • “Flavor”: Fast numeric sort
   • “Ignore case”: Yes

Group reads into blocks and blockgroups using blockbuster

Hands-on: blockbuster

1. blockbuster tool with the following parameters:
   • param-file “BED file containing read expressions”: output of Sort tool
   • “Type of output”: reads (blockbuster format)

Clustering with BlockClust

Here we use BlockClust in clustering mode. All you need here is the output of the blockbuster.

Apart from clustering, BlockClust has built-in class specific discriminative models for C/D box snoRNA, H/ACA box snoRNA, miRNA, rRNA, snRNA, tRNA and Y_RNA. So it can also be used to predict if a read profile might belong to one of the known ncRNA class.

Hands-on: clustering

1. BlockClust tool with the following parameters:
   • “Select mode of operation”: Clustering and classification
     • param-file “Input blockgroups file”: output of blockbuster tool
     • “Select reference genome”: Human (hg19)
     • “Would you like to perform classification?”: Yes
     • “Mode of classification”: Model based

The tool produces the following four output files.

The BlockClust: BED of predicted clusters file is the result of Markov cluster algorithm. Each entry in this file represents a blockgroup. The 4th column contains is in the form of annotation:blockgroup_id:cluster_id. The cluster_id represents which cluster the blockgroup belongs to.

The BlockClust: Model based predictions BED file is the result of classification. Each entry in this file represents a blockgroup. The 4th column contains the annotation of the ncRNA which it overlaps. For the blockgroups which are not overlapped with any known ncRNAs, the prefix predicted_ is added indicating that it is predicted by the BlockClust classification models.

The BlockClust: Hierarchical clustering plot file shows a dendrogram construced based on average linkage clustering.

The BlockClust: Pairwise similarities file contains the pairwise similarities of all input blockgroups.

Next, we will visualize the read profiles (from the BAM file) and the predictions (BED from BlockClust) together.

Hands-on: visualization

1. Install IGV (if not already installed)
2. Start IGV locally
3. Expand the param-file GSM769512.bam file
4. Click on the local in display with IGV to load the reads into the IGV browser
5. Expand the param-file BlockClust: Model based predictions BED file
6. Click on the local in display with IGV to load the reads into the IGV browser
7. Go to the location chr4:90653059-90653141 in IGV.

Question

1. Do you see any already annotated transcript in that location?
2. What does the read profile resemble?
3. What did BlockClust predict?

Solution

1. There is no annotated gene from RefSeq annotation on the same strand.
2. It resembles the miRNA profiles mentioned in the introduction section. One of the read piles looks like mature miRNA and the other like miRNA*.
3. Predicted as a miRNA.

Comment

In order for this step to work, you will need to have either IGV or Java web start installed on your machine. However, the questions in this section can also be answered by inspecting the IGV screenshots below.

Check the IGV documentation for more information.

Conclusion

In this tutorial, we learned how to use BlockClust to cluster real small RNA sequencing read profiles based on their similarity. We also learned that the BlockClust can also be used to classify the read profiles based on pre-built classification models.

You've Finished the Tutorial

Please also consider filling out the Feedback Form as well!

Key points

• Small non-coding RNA read profiles are often associate with function

• Clusters of read profiles correlate with the ncRNA classes

Frequently Asked Questions

Useful literature

Further information, including links to documentation and original publications, regarding the tools, analysis techniques and the interpretation of results described in this tutorial can be found here.

References

1. Pasquinelli, A. E., 2012 MicroRNAs and their targets: recognition, regulation and an emerging reciprocal relationship. Nature Reviews Genetics 13: 271–282. 10.1038/nrg3162

Feedback

Did you use this material as an instructor? Feel free to give us feedback on how it went.
Did you use this material as a learner or student? Click the form below to leave feedback.

Citing this Tutorial

1. Pavankumar Videm, Small Non-coding RNA Clustering using BlockClust (Galaxy Training Materials). https://training.galaxyproject.org/training-material/topics/transcriptomics/tutorials/small_ncrna_clustering/tutorial.html Online; accessed TODAY
2. Hiltemann, Saskia, Rasche, Helena et al., 2023 Galaxy Training: A Powerful Framework for Teaching! PLOS Computational Biology 10.1371/journal.pcbi.1010752
3. Batut et al., 2018 Community-Driven Data Analysis Training for Biology Cell Systems 10.1016/j.cels.2018.05.012

BibTeX

@misc{transcriptomics-small_ncrna_clustering,
author = "Pavankumar Videm",
	title = "Small Non-coding RNA Clustering using BlockClust (Galaxy Training Materials)",
	year = "",
	month = "",
	day = "",
	url = "\url{https://training.galaxyproject.org/training-material/topics/transcriptomics/tutorials/small_ncrna_clustering/tutorial.html}",
	note = "[Online; accessed TODAY]"
}
@article{Hiltemann_2023,
	doi = {10.1371/journal.pcbi.1010752},
	url = {https://doi.org/10.1371%2Fjournal.pcbi.1010752},
	year = 2023,
	month = {jan},
	publisher = {Public Library of Science ({PLoS})},
	volume = {19},
	number = {1},
	pages = {e1010752},
	author = {Saskia Hiltemann and Helena Rasche and Simon Gladman and Hans-Rudolf Hotz and Delphine Larivi{\`{e}}re and Daniel Blankenberg and Pratik D. Jagtap and Thomas Wollmann and Anthony Bretaudeau and Nadia Gou{\'{e}} and Timothy J. Griffin and Coline Royaux and Yvan Le Bras and Subina Mehta and Anna Syme and Frederik Coppens and Bert Droesbeke and Nicola Soranzo and Wendi Bacon and Fotis Psomopoulos and Crist{\'{o}}bal Gallardo-Alba and John Davis and Melanie Christine Föll and Matthias Fahrner and Maria A. Doyle and Beatriz Serrano-Solano and Anne Claire Fouilloux and Peter van Heusden and Wolfgang Maier and Dave Clements and Florian Heyl and Björn Grüning and B{\'{e}}r{\'{e}}nice Batut and},
	editor = {Francis Ouellette},
	title = {Galaxy Training: A powerful framework for teaching!},
	journal = {PLoS Comput Biol}
}

                   

Galaxy Administrators: Install the missing tools

You can use Ephemeris's shed-tools install command to install the tools used in this tutorial.

shed-tools install [-g GALAXY] [-a API_KEY] -t <(curl https://training.galaxyproject.org/training-material/api/topics/transcriptomics/tutorials/small_ncrna_clustering/tutorial.json | jq .admin_install_yaml -r)

Alternatively you can copy and paste the following YAML

---
install_tool_dependencies: true
install_repository_dependencies: true
install_resolver_dependencies: true
tools:
- name: text_processing
  owner: bgruening
  revisions: d698c222f354
  tool_panel_section_label: Text Manipulation
  tool_shed_url: https://toolshed.g2.bx.psu.edu/
- name: samtools_sort
  owner: devteam
  revisions: f56bdb93ae58
  tool_panel_section_label: SAM/BAM
  tool_shed_url: https://toolshed.g2.bx.psu.edu/
- name: blockbuster
  owner: rnateam
  revisions: 7c7ff7a3503f
  tool_panel_section_label: RNA Analysis
  tool_shed_url: https://toolshed.g2.bx.psu.edu/
- name: blockclust
  owner: rnateam
  revisions: aab6cf87b40a
  tool_panel_section_label: RNA Analysis
  tool_shed_url: https://toolshed.g2.bx.psu.edu/

Feedback

No feedback has been recieved yet for this training. Be the first one by filling in the feedback form from above.