An introduction to get started in genome assembly and annotation

name: inverse
layout: true
class: center, middle, inverse

</span></div>

</span></div>

---

# An introduction to get started in genome assembly and annotation

<div class="contributors-line">
		
	
<ul class="text-list">
			
			<li>
				<a href="/training-material/hall-of-fame/alexcorm/" class="contributor-badge contributor-alexcorm"><img src="/training-material/assets/images/orcid.png" alt="orcid logo" width="36" height="36"/><img src="https://avatars.githubusercontent.com/alexcorm?s=36" alt="Alexandre Cormier avatar" width="36" class="avatar" />
    Alexandre Cormier</a>
			<li>
				<a href="/training-material/hall-of-fame/lleroi/" class="contributor-badge contributor-lleroi"><img src="/training-material/assets/images/orcid.png" alt="orcid logo" width="36" height="36"/><img src="https://avatars.githubusercontent.com/lleroi?s=36" alt="Laura Leroi avatar" width="36" class="avatar" />
    Laura Leroi</a></li>
</ul>

</div>

<div class="footnote" style="bottom: 8em;">
  <i class="far fa-calendar" aria-hidden="true"></i><span class="visually-hidden">last_modification</span> Updated:   
  <i class="fas fa-fingerprint" aria-hidden="true"></i><span class="visually-hidden">purl</span><abbr title="Persistent URL">PURL</abbr>: <a href="https://gxy.io/GTN:S00034">gxy.io/GTN:S00034</a>
</div>

<div class="footnote" style="bottom: 5em;">

<i class="fas fa-file-alt" aria-hidden="true"></i><span class="visually-hidden">text-document</span><a href="slides-plain.html"> Plain-text slides</a> |

</div>

<div class="footnote" style="bottom: 2em;">
    <strong>Tip: </strong>press <kbd>P</kbd> to view the presenter notes
    | <i class="fa fa-arrows" aria-hidden="true"></i><span class="visually-hidden">arrow-keys</span> Use arrow keys to move between slides

</div>

???
Presenter notes contain extra information which might be useful if you intend to use these slides for teaching.

Press `P` again to switch presenter notes off

Press `C` to create a new window where the same presentation will be displayed.
This window is linked to the main window. Changing slides on one will cause the
slide to change on the other.

Useful when presenting.

---

## Requirements

Before diving into this slide deck, we recommend you to have a look at:

- [Introduction to Galaxy Analyses](/training-material/topics/introduction)

- [Sequence analysis](/training-material/topics/sequence-analysis)
    - Quality Control: [<i class="fab fa-slideshare" aria-hidden="true"></i><span class="visually-hidden">slides</span> slides](/training-material/topics/sequence-analysis/tutorials/quality-control/slides.html) - [<i class="fas fa-laptop" aria-hidden="true"></i><span class="visually-hidden">tutorial</span> hands-on](/training-material/topics/sequence-analysis/tutorials/quality-control/tutorial.html)

---

### <i class="far fa-question-circle" aria-hidden="true"></i><span class="visually-hidden">question</span> Questions

- Definitions of bioinformatics terms for assembly and annotation

- What are the guidelines before starting a Genome Assembly and Annotation project?

- What file formats are used for assembly and annotation?

---

# The truth about bioinformatics

.image-100[
  ![Bioinformatics is not just about pushing a button and getting your result](../../images/genome_assembly_introduction/the_truth_about_bioinformatics.jpg)
]

---

# Let's start with some important definitions

.image-40[
  ![Importance to speak the same language](../../images/genome_assembly_introduction/bulle-bd.png)
]

---
.left[
**Contig**: a contiguous sequence in an assembly. A contig does not contain long stretches of unknown sequences (aka assembly **gaps**).

**Scaffold**: a sequence consists of one or multiple contigs connected by assembly gaps of typically inexact sizes. A scaffold is also called a **supercontig**, though this terminology is rarely used nowadays.

**Assembly**: a set of contigs or scaffolds.
]

.image-60[
  ![Illustration of the working principle of scaffolding](../../images/genome_assembly_introduction/scaffolding.png)
]

---

.left[
**Haplotig**: a contig that comes from the same haplotype. In an unphased assembly, a contig may join alleles from different parental haplotypes in a diploid or polyploid genome.

**Primary assembly**: a complete assembly with long stretches of phased blocks.

**Alternate assembly**: an incomplete assembly consisting of haplotigs in heterozygous regions. An alternate assembly always accompanies a primary assembly. It is not useful by itself as it is fragmented and incomplete.

**Haplotype-resolved assembly**: sets of complete assemblies consisting of haplotigs, representing an entire diploid/polyploid genome.
]

.image-60[
  ![Illustration of the assembly types](../../images/genome_assembly_introduction/assemblies_definitions.png)
]

---

.left[
**Telomere to telomere**: An assembly where each chromosome is fully phased and assembled without gaps.

**Linkage group**: a set of contigs or scaffolds ordered and oriented using a collection of genes that are inferred to be located together on a single chromosome because of the pattern of their inheritance.
]

.image-20[
  ![Example of linkage map from JCVI](../../images/genome_assembly_introduction/linkage_map.png)
]

---

.left[
**Coverage in terms of redundancy (A)**: number of reads that align to, or "cover," a known reference. It describes how often, in average, a reference sequence is covered by bases from the reads.

**Coverage in terms of the percentage coverage of a reference by reads (B)**: E.g. if 90% of a reference is covered by reads (and 10% not) it is a 90% coverage.

**Sequencing depth (C)**: total number of usable reads from the sequencing machine.
]

.image-80[
  ![Illustration of coverage and depth](../../images/genome_assembly_introduction/comparison-coverage-and-sequencing-depth.gif)
]

---

# Assembly and annotation in a ideal world

.image-100[
  ![The perfect assembly dream](../../images/genome_assembly_introduction/assembly_dream.png)
]

---

# Key concepts for assembly and annotation

.image-100[
  ![Assembly and annotation overview](../../images/genome_assembly_introduction/assembly_and_annotation_simplified_overview.png)
]

---

# Steps before starting a genome project

.left[
- Step 1: Build a broad community of collaborators for the project, if possible

- Step 2: Gather information about the target genome

- Step 3: Select the best possible DNA source and an optimal extraction procedure

- Step 5: Choose an appropriate sequencing technology

- Step 6: Check the computational resources requirements and availability
]

---

### Build a wide community for the project (*if it's possible*)

.left[
The aim of a genome project is to **sequence the entire target genome** for a wide **range of genomics applications**.
]

.left[
**Analyses**, **reanalyses** and **integration** of genomic and other phenotype information are required:
]

- **Facilities:** Wet lab, sequencing, bioinformatics,…
- **Personnel:** Highly skilled
- **Software:** Knowledge intensive

.left[
<i class="fas fa-exclamation-triangle" aria-hidden="true"></i><span class="visually-hidden">warning</span> The cost of data storage, maintenance, transfer, and analysis are likely to be significant and will represent an increasing proportion of overall sequencing costs in the future.
]

---

### Genome information: Genome size

.pull-left[
**How to collect informations?**

- Experimentally : Flow cytometry
- Databases:
  - Fungi: [http://www.zbi.ee/fungalgenomesize](http://www.zbi.ee/fungalgenomesize)
  - Animals: [http://www.genomesize.com](http://www.genomesize.com)
  - Plants: [http://data.kew.org/cvalues ](http://data.kew.org/cvalues)
- Bibliography
]

.pull-right[
.image-100[
  ![variation in estimated genome sizes in base pairs](../../images/genome_assembly_introduction/genomes-size.png)
]]

.footnote[https://commons.wikimedia.org/w/index.php?curid=19537795]

---

### Genome information: GC content

.pull-left[
**Why?**

.left[
Sequencing is not random!
GC and AT rich regions are under-represented.
]

**How to solve?**
- Chemistry quirks
- Increase the sequencing depth
- Technologies combination (long and short reads)
]

.pull-right[
.image-100[
  ![Sequencing coverage by GC content](../../images/genome_assembly_introduction/coverage-x-GC.png)
]]

.footnote[Chaisson et al. Genetic variation and the de novo assembly of human genomes. Nat Rev Genet 16, 627–640 (2015).]

---

### Genome information: Ploidy level

.pull-right[
.image-55[
  ![Heterozigous genotype](../../images/genome_assembly_introduction/ploidy.png)
]]

.pull-left[

**Ploidy (N):**

Number of sets of chromosomes in a cell

| Organism                  | Ploidy    |
|:--------------------------|:---------:|
| Bacteria                  | 1N        |
| Human, mouse, rat         | 2N        |
| Amphibians (*Xenopus*)    | 2N to 12N |
| Plants (wheat)            | 6N        |
| **Autopolyploid**         | .         |
| **Hybrids**               | .         |

]

**Higher ploidy -> harder to assemble => Increase of sequencing depth**

.footnote[Daniel Hartl. Essential Genetics: A Genomics Perspective. Jones & Bartlett Learning. p. 177. ISBN 978-0-7637-7364-9. (2011).]

---

### Genome information: Heterozygosity level

.pull-left[
.left[
**Heterozygous:** Locus-specific,  diploid (2N) organism has two different alleles of a particular gene at the same locus
]]

.pull-right[
.image-100[
  ![Heterozigous genotype](../../images/genome_assembly_introduction/heterozygous.jpg)
]]

.left[
**Heterozygosity** is a metric used to indicate the probability that an individual is heterozygous for a particular allele
]

**Higher heterozygosity -> harder to assemble => Increase of sequencing depth**

.footnote[https://www.genome.gov/genetics-glossary/heterozygous]

---

### Genome information: Heterozygosity level

.image-125[
  ![Concepts in phased assemblies](../../images/genome_assembly_introduction/phased-assemblies.png)
]

.footnote[Heng Li’s blog: lh3.github.io/2021/04/17/concepts-in-phased-assemblies]

---

### Genome information: Complexity aka repeats elements

.left[
**It is impossible to resolve repeats of length L unless you have reads longer than L**
]

Most common source of assembly errors:

.pull-left[
.image-65[
  ![Collapsed consensus from repeat copies](../../images/genome_assembly_introduction/collapsed-consensus.png)
]]

.pull-right[
.image-65[
  ![Collapsed, excision and rearrangement consensus](../../images/genome_assembly_introduction/excision-rearrangement-consensus.png)
]]

---

### Genome information: Others

- **Karyotype:** chromosome number
- **Sex chromosome system:** None, XY, ZW, UV,…
- **Purity:** possible presence of contaminants and/or symbionts?
- Is there any other **useful data (NCBI, SRA, ENA, etc)** that could improve my assembly?

---

### Genome information: Tips

.pull-left[
- **Flow cytometry** :
   - Genome size
   - Ploidy level
- **k-mer frequency from Illumina reads** :
   - Genome size
   - Ploidy level
   - GC content
   - Heterozygosity
   - Repeats composition
]

---

### The best possible DNA

.left[
Select the best possible DNA source and extraction method.
The extraction of **high-quality DNA** is the **most important** aspect of a successful genome project

The **lack of a good starting material** will limit the choice of sequencing technology and  **affect the quality of data obtained**
]

---

### The best possible DNA: Chemical purity of DNA

.left[
**Sample-related contaminants:**
- Polysaccharides
- Proteoglycans
- Proteins
- Secondary metabolites
- Polyphenols
- Humic acids
- Pigments
- Etc,...

All these contaminants **can affect the efficiency of library preparation**, regardless of the technology, and this is especially true **for PCR-free libraries** (PacBio and ONT)
]

---

### The best possible DNA: Quantity of DNA

.left[
Different technologies require different amount of DNA:
- Illumina and 10x > 3 ng
- BioNano > 200 ng
- ONT > 1 μg
- Hi-C > 5 μg
- PacBio > 15 μg
]

---

### The best possible DNA: Structural integrity of DNA

.left[
High Molecular Weight (**HMW**) for Nanopore/PacBio (obtained mainly from fresh material)
]

---

### The best possible DNA: Tips

.left[
- Many **DNA extraction protocol** are available for a wide range of species/taxa (VGP, Darwin Tree of Life, Nanopore, PacBio, etc)
- **Keep DNA samples** from the same individual in case of library preparation or sequencing failure, need more coverage, new sequencing technology, etc
- Use a **single individual** and sequence a **haploid, a highly inbred diploid** organism, or an **isogenic** individual
]

---

### Appropriate sequencing technology

.left[
This mainly **depends on the quantity and quality of DNA as well as the cost of the experiment** but many parameters need to be considered before performing an NGS experiment:

- Short **versus** long reads or **both**
- Read length
- Read quality/error rate
- Genome read coverage/depth
- Library preparation
- Downstream applications
]

---

### Appropriate sequencing technology: Assembly

.left[
- **Illumina or MGI:** short reads (up to 2x250bp) with high quality reads. Sequencing bias with AT/GC rich regions
- **IonTorrent:** short reads (up to 500bp) with medium quality reads
- **Nanopore:** long reads (average ~15kbp) with low quality reads. Errors are not randomly distributed!
- **PacBio:**
  - CLR: long reads (average ~20kbp) with low quality reads
  - HiFi: long reads (average ~15kbp) with high quality reads
]

---

### Appropriate sequencing technology: Scaffolding

.left[
- **Hi-C:** **restriction enzyme fragmentation** (single, multiples sites or DNAse). Need huge amount of coverage.
  - Phase Genomics
  - Dovetail Genomics
  - Arima Genomics
- Optical mapping: technique to physically locate specific enzymes restriction sites or sequence motifs to produce DNA sequence fingerprints.
  - BioNano
  - BGI
- Mate pair (deprecated)
- BAC/YAC/Fosmids (deprecated)
]

---

### Appropriate sequencing technology

.image-100[
  ![Several sequencing technologies](../../images/genome_assembly_introduction/sequencing-technologies.png)
]

.footnote[Stark, R., Grzelak, M. & Hadfield, J. RNA sequencing: the teenage years. Nat Rev Genetics 20, 631–656 (2019).]

---

### Appropriate sequencing technology: Short vs long reads

.pull-left[
**Short reads platforms**:
Highest sequencing depth but shorter reads
]

.pull-rigth[
.image-40[
  ![Reads accuracy distribution](../../images/genome_assembly_introduction/short-read-sequencing-platforms-specifications.png)
]]

.pull-left[
**Long reads platforms**:
Longer reads but less sequencing depth
]

.pull-rigth[
.image-40[
  ![Reads accuracy distribution](../../images/genome_assembly_introduction/long-read-sequencing-platforms-specifications.png)
]]

.footnote[Kanzi, A. M. et al. Next Generation Sequencing and Bioinformatics Analysis of Family Genetic Inheritance. Frontiers Genetics 11, 544162 (2020).]

---

### Appropriate sequencing technology: Short vs long reads

.pull-left[
**Reads accuracy differs depending on the sequencing technology:**
- Illumina and PacBio HiFi: more accurate
- ONT and PacBio CLR: less accurate (but longer)
]

.pull-rigth[
.image-40[
  ![Reads accuracy distribution](../../images/genome_assembly_introduction/reads-accuracy-distribution.png)
]]

---

### Appropriate sequencing technology: Coverage versus depth

.left[
**Coverage in terms of redundancy**

**Coverage in terms of the percentage coverage of a reference by reads**

Intuitively, increase sequencing depth should increase both types of coverage.
]

.image-40[
  ![Sequencing coverage by GC content](../../images/genome_assembly_introduction/coverage-x-GC.png)
]

.footnote[Chaisson et al. Genetic variation and the de novo assembly of human genomes. Nat Rev Genet 16, 627–640 (2015).]

---

### Computational resources and requirements

.left[
To be successful, you must have **sufficient computing resources (CPUS, RAM, walltime and storage)**.
- The resources needed are **different** for each step:
  - Assembly
  - Annotation
  - Other analysis tools

- For genome **assembly:**
  - Running times and RAM increase with data **type** and **amount**
  - More data for large genomes, increase **runtime/RAM/Storage**
  - Most of tools **run** on a **single node**: they are parallelized but not distributed

- For genome **annotation:**
  - Mapping/alignment of external data (RNA-seq, proteins) can be parallelized and distributed
  - Annotation process can be parallelized and distributed
]

---

### Typical sequencing strategies: Bacterial genomes

.left[
- PacBio CLR or Oxford Nanopore reads at 40-50x coverage, self-correction and/or hybrid correction (using Illumina data)
- Illumina 2x250bp paired-end reads from MiSeq
]

---

### Typical sequencing strategies: Larger genomes

.left[
- PacBio CLR or Oxford Nanopore reads at 100x coverage, hybrid correction using Illumina data and scaffolding using Hi-C
- PacBio HiFi reads at 30x coverage and scaffolding using Hi-C
- PacBio HiFi reads at 30x coverage, 120x Oxford Nanopore ultra long reads
]

---

# Bioinformatics data formats

.left[
**FASTA**: a text-based format for representing either nucleotide sequences or amino acid (protein) sequences, in which nucleotides or amino acids are represented using single-letter codes.
]

.image-100[
  ![Fasta format description](../../images/genome_assembly_introduction/fasta_format.png)
]
Image licensed CC-BY 4.0 <span class="citation"><a href="https://doi.org/10.3390/info7040056">Hosseini <i>et al.</i> 2016</a></span>

.footnote[Hosseini, M., Pratas, D. & Pinho, A. J. A Survey on Data Compression Methods for Biological Sequences. Information 7, 56 (2016).]

---

# Bioinformatics data formats

.left[
**FASTQ**: a text-based format for storing both a biological sequence (usually nucleotide sequence) and its corresponding quality scores (Phred). Both the sequence letter and quality score are each encoded with a single ASCII character for brevity. It's the standard sequencing output for Illumina and MGI sequencers.
]

.image-100[
  ![Fastq format description](../../images/genome_assembly_introduction/fastq_format.png)
]
Image licensed CC-BY 4.0 <span class="citation"><a href="https://doi.org/10.3390/info7040056">Hosseini <i>et al.</i> 2016</a></span>

.footnote[Hosseini, M., Pratas, D. & Pinho, A. J. A Survey on Data Compression Methods for Biological Sequences. Information 7, 56 (2016).]

---

# Bioinformatics data formats

.left[
**FAST5**: the standard sequencing output for Oxford Nanopore sequencers. It is based on the hierarchical data format HDF5 format which enables storage of large and complex data. In contrast to fasta and fastq files a FAST5 file is binary and can not be opened with a normal text editor. Data stored in nanopore FAST5 files can contain the sequence of a read in fastq format (after basecalling), the raw signal of the pore as well as several log files and other information
]

.image-100[
  ![Interactive view of a Fast5 with HDFview](../../images/genome_assembly_introduction/fast5_hdfViewer.png)
]

---

# Bioinformatics data formats

**SAM (Sequence Alignment Map)**: a text-based format originally for storing biological sequences aligned to a reference sequence developed by Heng Li and Bob Handsaker et al.

**BAM (Binary Alignment Map)**: the comprehensive raw data of genome sequencing; it consists of the lossless, compressed binary representation of the SAM format. It's the standard sequencing output for PacBio sequencers.

**CRAM (Compressed Reference-oriented Alignment Map)**: a compressed columnar file format for storing biological sequences aligned to a reference sequence.

.pull-left[
.image[
  ![SAM format description](../../images/genome_assembly_introduction/sam_format.png)
]]

.pull-right[
Image licensed CC-BY 4.0 <span class="citation"><a href="https://doi.org/10.3390/info7040056">Hosseini <i>et al.</i> 2016</a></span>
]

.footnote[Hosseini, M., Pratas, D. & Pinho, A. J. A Survey on Data Compression Methods for Biological Sequences. Information 7, 56 (2016).]

---
### <i class="fas fa-key" aria-hidden="true"></i><span class="visually-hidden">keypoints</span> Key points

- We learned the definitions of bioinformatics terms used in genomes assembly and annotation

- We have seen the bioinformatics file formats used for these analyses

- We learned the importance of preparing the project to ensure its success

- We learned the importance of surrounding ourselves with all the people who have knowledge of the different parts of the project (wet lab, sequencing, bioinformatics,...)

---

## Thank You!

This material is the result of a collaborative work. Thanks to the [Galaxy Training Network](https://training.galaxyproject.org) and all the contributors!

<div class="contributors-line">
		
<table class="contributions">
	
	<tr>
		<td><abbr title="These people wrote the bulk of the tutorial, they may have done the analysis, built the workflow, and wrote the text themselves.">Author(s)</abbr></td>
		<td>
			<a href="/training-material/hall-of-fame/alexcorm/" class="contributor-badge contributor-alexcorm"><img src="/training-material/assets/images/orcid.png" alt="orcid logo" width="36" height="36"/><img src="https://avatars.githubusercontent.com/alexcorm?s=36" alt="Alexandre Cormier avatar" width="36" class="avatar" />
    Alexandre Cormier</a><a href="/training-material/hall-of-fame/lleroi/" class="contributor-badge contributor-lleroi"><img src="/training-material/assets/images/orcid.png" alt="orcid logo" width="36" height="36"/><img src="https://avatars.githubusercontent.com/lleroi?s=36" alt="Laura Leroi avatar" width="36" class="avatar" />
    Laura Leroi</a>
		</td>
	</tr>

<tr>
		<td><abbr title="These people edited the text, either for spelling and grammar, flow, GTN-fit, or other similar editing categories">Editor(s)</abbr></td>
		<td>
			<a href="/training-material/hall-of-fame/abretaud/" class="contributor-badge contributor-abretaud"><img src="/training-material/assets/images/orcid.png" alt="orcid logo" width="36" height="36"/><img src="https://avatars.githubusercontent.com/abretaud?s=36" alt="Anthony Bretaudeau avatar" width="36" class="avatar" />
    Anthony Bretaudeau</a><a href="/training-material/hall-of-fame/stephanierobin/" class="contributor-badge contributor-stephanierobin"><img src="/training-material/assets/images/orcid.png" alt="orcid logo" width="36" height="36"/><img src="https://avatars.githubusercontent.com/stephanierobin?s=36" alt="Stéphanie Robin avatar" width="36" class="avatar" />
    Stéphanie Robin</a><a href="/training-material/hall-of-fame/r1corre/" class="contributor-badge contributor-r1corre"><img src="/training-material/assets/images/orcid.png" alt="orcid logo" width="36" height="36"/><img src="https://avatars.githubusercontent.com/r1corre?s=36" alt="Erwan Corre avatar" width="36" class="avatar" />
    Erwan Corre</a></td>
	</tr>

</table>

</div>

</div>

Tutorial Content is licensed under <a rel="license" href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</a>.<br/>