name: inverse layout: true class: center, middle, inverse
# Quality Control
Updated: Dec 14, 2021
to view the presenter notes
??? Presenter notes contain extra information which might be useful if you intend to use these slides for teaching. Press `P` again to switch presenter notes off Press `C` to create a new window where the same presentation will be displayed. This window is linked to the main window. Changing slides on one will cause the slide to change on the other. Useful when presenting. --- ## Requirements Before diving into this slide deck, we recommend you to have a look at: - [Introduction to Galaxy Analyses](/training-material/topics/introduction) --- ### <i class="far fa-question-circle" aria-hidden="true"></i><span class="visually-hidden">question</span> Questions - How to control quality of NGS data? - What are the quality parameters to check for each dataset? - How to improve the quality of a sequence dataset? --- ### <i class="fas fa-bullseye" aria-hidden="true"></i><span class="visually-hidden">objectives</span> Objectives - Manipulate FASTQ files - Control quality from a FASTQ file for short and long reads - Use FastQC/NanoPlot/PycoQC - Understand output - Use tools for quality correction --- # Why Quality Control? ??? Potential audience poll ideas: - Sequenced something or assembled a genome or transcriptome? - Can guess why we need to do QC on our data? Comments: - Process of removing low quality sequences that might corrupt downstream analyses - Some assemblers like Spades have an auto-correction process and ask for raw data --- ### Where is my data coming from? ![Cartoon of different types of sequencing and where they appear in the genome. Bisulfite and ChIP-Seq have arrows pointing to nucleosomes. DNaseq-seq points to the region between nucleosomes. Hi-C and ChIA-PET point to the long range chromatin interactions. RNA-Seq points to a subset of the genome showing a promoter and transcribed region.](../../images/ecker_2012.png) <small>[*Ecker et al, Nature, 2012*](https://www.ncbi.nlm.nih.gov/pubmed/22955614)</small> ??? - Many sequencing techniques - [Huge diversity in protocols](https://www.illumina.com/science/sequencing-method-explorer.html) - Knowledge about source of data (+expectations of how it looks) is important in QC process - What is/isn't normal for your data Segue: Might be concerned about different processing for each --- ### From experiments to data ![RNA Seq, Exome Seq, ChIP-Seq, and DNA-Seq all point to a large sequencing box and produce files. Then come bioinformatic analysis, namely quality control, on all of the different types.](../../images/from_exp_to_data.png) Quality control = First step of the bioinformatics analyses ??? - But no matter what technique used, same file format - Always should go through QC Segue: So let's look at how that data is stored --- ### Sequences: FASTA ``` >Identifier1 (comment) XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX >Identifier2 (comment) XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX XX ``` ??? - familiar if you've seen genomic data before - Starts with greater-than sign - Then an identifier with no spaces - Everything after a space is a comment - Newline - Everything up to next greater-than is sequence data (wrapping unnecessary) Segue: But this is just sequence, and we have data from a sequencer, which includes quality --- ### Sequences: FASTQ ``` @Identifier1 (comment) XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX + QQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQ @Identifier2 (comment) XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX + QQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQQ ``` ??? - Four lines - @ + identifier on first line, just like fasta - sequence - + - quality score characters Segue: so what do the quality chars mean? --- ### Quality score Measure of the quality of the identification of the nucleobases <br>generated by automated DNA sequencing <small> Phred Quality Score | Probability of incorrect base call | Base call accuracy --- | --- | --- 10 | 1 in 10 | 90% 20 | 1 in 100 | 99% 30 | 1 in 1000 | 99.9% 40 | 1 in 10,000 | 99.99% 50 | 1 in 100,000 | 99.999% 60 | 1 in 1,000,000 | 99.9999% </small> ??? - Logarithmic scale --- ### Quality score ![Graph of quality score vs probability of misidentification. There are two lines, red shows -10log(p) while solexa has a different formula](../../images/quality_score.png) ??? - Solexa uses slightly different measure --- ### Quality score encoding ![Encoding of the quality score with ASCII characters for different Phred encoding. The ascii code sequence is shown at the top with symbols for 33 to 64, upper case letters, more symbols, and then lowercase letters. Sanger maps from 33 to 73 while solexa is shifted, starting at 59 and going to 104. Illumina 1.3 starts at 54 and goes to 104, Illumina 1.5 is shifted three scores to the right but still ends at 104. Illumina 1.8+ goes back to the Sanger except one single score wider. Illumina](../../../sequence-analysis/images/fastq-quality-encoding.png) ??? - Earlier saw sequence + quality were same length of text - Each score encoded as a single character - Uses ASCII (common computer encoding, maps numbers to characters) - Each technology has a different mapping - Mostly see illumina 1.8 these days, others only if historical --- ## PacBio HiFi *vs* CLR ![Comparison between PacBio HiFi and CLR sequencing methods](../../images/quality-control/pacbio_hifi_vs_clr.png) - **HiFi (CCS)**: 99%+ accurate read achieved by multiple passes of the polymerase over a **single molecule** - **CLR**: 90% accurate read from **multiples molecules** ??? - HiFi read is the result of a consensus of subreads from the same molecule (i.e. multiple pass over the same molecule). It's imply to have shorter sequences to allow multiple pass on a single molecule by the polymerase. - CLR read come from a single pass from a single molecule. It's allow to have longer reads but with a lower read quality. Warning: Absence of encoded quality since Sequel I into fastq files with CLR. --- ## Identifying Potential Quality Issues --- ## FastQC A versatile tool for short and long reads quality control --- ### FastQC ![Screenshot of FastQC report, showing the table of contents with green checks on nearly every result, and the base statistics and per-base sequence quality graphs shown.](../../../sequence-analysis/images/fastqc-report.png) ??? - Analyses your fastq files - Has many modules - They report on different aspects of the sequence - Modules include: - Basic Statistics - Per base sequence quality - Per sequence quality scores - Per base sequence content - Per base GC content - Per sequence GC content - Per base N content - Sequence Length Distribution - Sequence Duplication Levels - Overrepresented sequences - Kmer Content --- ### Quality score: Per-base ![Fastqc quality score plot, most results are in the green region but the box portion of the box and whisker plot start to dip into the yellow, medium quality (less than 30) region near 34+ base position in read. The whiskers begin extending to the red region (less than 20) by base 31 and get progressively worse.](../../../sequence-analysis/images/per_base_sequence_quality_good.png) <i class="fa fa-thumbs-up"></i> Good quality score --- ### Per-base Quality ![Fastqc quality score plot, most results are in the green region up until 30. The whiskers extend to the yellow region from the start, and after base 30 get progressively worse, goign to the worst possible score by the end. The boxes cover the yellow region by base 40.](../../images/per_base_sequence_quality_bad.png) <i class="fa fa-thumbs-down"></i> Bad quality score --- ### Per-base Quality - Nanopore ![A graph for Nanopore reads (R9.4) basecalled with guppy. Almost all bases are in the red region below 20.](../../images/per_base_sequence_quality_nanopore.png) <i class="far fa-thumbs-up" aria-hidden="true"></i><span class="visually-hidden">congratulations</span> Good quality score ??? - Nanopore reads have an higher error rate, around 5% while it's ~0.5% for Illumina - Q10 -> Q14 with recent versions of Guppy - Q20+ with new sequencing kit by the end of 2021 (new chemistry) --- ### Per-base Quality - PacBio HiFi ![A graph for PacBio HiFi reads. All reads are in the green region and quality score are encoded up to 92.](../../images/per_base_sequence_quality_pacbio_hifi_good.png) <i class="far fa-thumbs-up" aria-hidden="true"></i><span class="visually-hidden">congratulations</span> Good quality score ??? - PacBio encodes quality with a higher range than Illumina to increase precision in base quality assessment --- ### Per-base Quality - PacBio CLR ![A graph for PacBio CLR reads. It's empty as quality is set to 0 for all bases!](../../images/per_base_sequence_quality_pacbio_clr.png) Quality information is "absent" for CLR reads since Sequel I. Quality for each base is automatically set to 0 (i.e. "!")! --- ### Per-sequence Quality ![A per-sequence quality showing quality score distribution histogram with average quality per read plotted. Most reads pile up around quality 30, but another peak appears at 17. very few reads have quality less than 10.](../../images/per_sequence_quality.png) ??? - For Illumina, the pic should be near 30 - For Nanopore, the pic is generally between 10 and 12. It depends on pore (R9 vs R10) and basecaller version and models (fast, hac, sup). - For PacBio HiFi, the pic should be near 90. --- ### Per-tile Quality ![A heatmap with several red and green squares, but overall largely blue.](../../images/per_tile_quality.png) ??? In Illumina libraries, the original sequence identifier is retained. Encoded in these is the flowcell tile from which each read came. There might be transient problems such as bubbles going through the flowcell, or more permanent problems such as smudges on the flowcell, or debris inside the flowcell lane. This graph will only appear with Illumina libraries which retain their original sequence identifiers. The graph allows to check the quality scores from each tile across all bases, to see if there was a loss in quality associated with only one portion of the flowcell. The plot shows the deviation from the average quality for each tile. The colours are on a cold to hot scale, with cold colours being positions where the quality was at or below the average for that base in the run, and hot colours to indicate that a tile had worse quality reads than other tiles for that base. In the example below you can see that certain tiles show consistently poor quality. A good plot should be blue all over. --- ### Per-base Sequence Content ![A line chart mapping sequence content across all bases with % of the four nucleotides plotted. The graph starts off very jagged and stabilises by base 12.](../../images/per_base_sequence_content.png) ??? The per-base sequence content highlights the proportion of each base in each position of a sequence for which each of the four DNA bases have been called. In a random library there would be little to no difference between the different bases of a sequence run. The relative amount of each base should reflect the overall amount of these bases, but in any case they should not be hugely imbalanced from one another. It is worth noting that some types of libraries will always produce biased sequence composition, normally at the start of the read. Libraries produced by priming with random hexamers (including nearly all RNA-Seq libraries) and those which were fragmented using transposases, inherit an intrinsic bias in the positions at which the reads start. This bias does not concern an absolute sequence, but instead provides an enrichment of a number of different K-mers at the 5’ end of the reads. Whilst this is a true technical bias, it isn’t something which can be corrected by trimming and in most cases doesn’t seem to adversely affect the downstream analysis. It will however produce a warning or error in this module. There are a number of common scenarios for these issues: - Over-represented sequences - Biased fragmentation - Biased composition libraries - Aggressive adapter trimming --- ### Per-sequence GC content ![A line chart showing mean GC content and threoretical distribution as largely overlapping peaks.](../../images/per_sequence_GC_content.png) ??? The GC content distribution of most samples should follow a normal distribution. In some cases, a bi-modal distribution can be observed, especially for metagenomic data sets. An unusually shaped distribution could indicate a contaminated library or some other kinds of biased subset. A normal distribution which is shifted indicates some systematic bias which is independent of base position. Such a systematic bias creating a shifted normal distribution won’t be flagged as an error, since the tool cannot guess what the provided genome’s GC content should be. Issues in the GC content distribution usually indicate a problem with the library. Sharp peaks on an otherwise smooth distribution are normally the result of a specific contaminant (adapter dimers for example), which may well be picked up by the over-represented sequences module. Broader peaks may represent contamination with a different species. --- ### Per-base N content ![A line graph of N content across all bases. It shows several peaks to 65 at specific positions and goes to 100 near the end.](../../images/per_base_N_content.png) ??? Sequences can contain the ambiguous base N for positions that could not be identified as a particular base. A high number of Ns can be a sign for a low quality sequence or even dataset. If no quality scores are available, the sequence quality can be inferred from the percent of Ns found in a sequence or dataset. If a sequencer is unable to make a base call with sufficient confidence then it will normally substitute an N rather than a conventional base call. It’s not unusual to see a very low proportion of Ns appearing in a sequence, especially nearer the end of a sequence. However, if this proportion rises above a few percent it suggests that the analysis pipeline was unable to interpret the data well enough to make valid base calls. --- ### Sequence length distribution ![A graph with a single peak at 75, and 0 outside of this region.](../../images/sequence_length_distribution.png) ??? Some high throughput sequencers generate sequence fragments of uniform length, while others can output reads of wildly varying lengths. The length distribution can be then used as quality measure. You would expect a normal distribution for the best result. However, most sequencing results show a slowly increasing and then a steep falling distribution. FastQC generates a graph showing the distribution of fragment sizes in the file which was analysed. In many cases this will produce a simple graph showing a peak only at one size, but for variable length FASTQ files this will show the relative amounts of each different size of sequence fragment. This module will raise a warning if all sequences are not the same length. This module will raise an error if any of the sequences have zero length. --- ### Sequence length distribution - PacBio / Nanopore ![A graph with a main peak around 15,000bp for PacBio HiFi run.](../../images/sequence_length_distribution_long-reads.png) ??? For long reads, the distribution is much more important and depends on the fragment size selection, primers, DNA weight and quality, etc --- ### Duplicated sequences ![Two line graphs, deduplicated sequences in red, and total sequences in blue. They start off near 100 and go rapidly to zero by sequence duplication level 2 and 3.](../../images/sequence_duplication_levels.png) ??? This quality check module counts the degree of duplication for every sequence in the library, and creates a plot showing the relative number of sequences with different degrees of duplication: - the blue line represents the full sequence set, showing how its duplication levels are distributed; - the red line represents the de-duplicated sequences, plotting the proportions of deduplicated sequence sets which come from different duplication levels in the original data. In genomic projects, sequence duplication is investigated. Duplicated sequences can arise when there are too few fragments present at any stage prior to sequencing. This module issues a warning if non-unique sequences make up for more than 20% of the total sequences. An error is raised instead if non-unique sequences make up for more than 50% of the total. --- ### Tag sequences: Adapter contamination ![The graph shows a line at zero for the five possible datasets.](../../images/adapter_content.png) ??? Tag sequences are artifacts at the ends of sequence reads such as multiplex identifiers, adapters, and primer sequences that were introduced during pre-amplification with primer-based methods. The base frequencies across the reads present an easy way to check for tag sequences. If the distribution seems uneven (high frequencies for certain bases over several positions), it could indicate some residual tag sequences. This doesn’t indicate a problem as such - just that the sequences will need to be adapter trimmed before proceeding with any downstream analysis. To investigate tag or adapter content, FastQC generates a plot showing a cumulative percentage count of the proportion of the library which has seen each of the adapter sequences at each position. Once a sequence has been seen in a read it is counted as being present right through to the end of the read so the percentages you see will only increase as the read length goes on. --- ### Tag sequences: K-mer content ![several peaks are visible on the log2 obs/exp graph of different k-mers at different positions in the read.](../../images/kmer_content.png) ??? Another way to find tag sequences is to look at the K-mer content, and find those which do not have even coverage through the length of your reads and could correspond to tag sequences. K-mers with positionally biased enrichment are reported. The top 6 most biased K-mer are additionally plotted to show their distribution. Over-represented K-mers will appear as sharp spikes at a single point in the sequence, deviating from what should be a progressive or broad enrichment. --- ## NanoPlot A quality control tool for long reads (Nanopore/PacBio) --- ### NanoPlot report ![Header of a NanoPlot html report ](../../images/nanoplot_report.png) Qscores (Qx): it is the average per-base error probability, expressed on the log (Phred) scale ??? - Analyses your fastq/bam files - Reports on different aspects of the reads - Modules include: - Summary Statistics - Mean / Median / N50 reads length - Mean / Median / N50 reads quality - Number of reads - Total of bases generated - Plots (depends on parameters) - Histogram of read lengths - Yield by length - Read lengths vs Average read quality --- ### Read length *vs* Read quality score (Qscores) ![Distribution for HiFi reads with a default filter >= Q20 ](../../images/LengthvsQualityScatterPlot_dot.png) Each dot represents a read. In the case of PacBio HiFi, the minimum Qscore is fixed to 20 which explains the absence of any dot under this score. ??? This plot give a 2D visualisation of quality score for reads according to reads length. It allows to detect bias quickly and easily. --- ### Histogram of read length ![Distribution around 15 / 20kb in HiFi mode ](../../images/HistogramReadlength.png) ??? It's a similar representation as FastQC sequence length distribution. The length distribution can then be used as quality measure, as you would expect a normal distribution for the best result. Also, at least for PacBio HiFi, the pic should be centered near 15kb. --- ### Run yield by Length ![Yield for HiFi run ](../../images/Yield_By_Length.png) This plot shows the total number of bases read in the run, as a function of the length of the read that contained them. The Y-axis is scaled based on the quantity of data in the fastq/a that was analyzed (20Gbp in this example). ??? - Very long reads represent only a small part of the total bases pairs generated. - In case of HiFi reads, the contribution of long reads starts to decrease after 10kb and 50% of the data correspond to the N50. - Used to evaluate the contribution of each size fraction --- ## PycoQC An interactive quality control tool for basecalled Nanopore data ??? - Analyse your run after basecalling - Has many modules - Dynamics plot - They report on different aspects of the sequence - Modules include: - Basic Statistics - Basecalled reads length - Basecalled reads PHRED quality - Basecalled reads length vs reads PHRED quality - Output reads over experiment time - Read length over experiment time - Read quality over experiment time - Channel activity over time - Number of reads per barcode (optional) --- ### General and basecalled summary ![General summary about a Nanopore run from PycoQC. It includes general information about the run itself (duration, channels, run ids and barcode in case of barcoded runs).](../../images/general_run_summary-pycoqc.png) ![General summary about the reads.](../../images/basecall_summary-pycoqc.png) ??? The 2 tables give general information about the run itself like the duration of the run, the number of active channels (pores), run ids and number of barcodes if necessary. It also provides information about the reads themself, like the total reads, bases, N50, median and median PHRED score. Reads with a Qscore >= 7 (default with Guppy) are marked as "Pass" --- ### Basecalled reads length ![A graph with a read length distribution between 200bp and 150kbp.](../../images/basecalled_reads_length-pycoqc.png) --- ### Basecalled reads PHRED quality (Qscores) ![A graph of PHRED quality (Qscore) with a distribution centered around 10.](../../images/basecalled_reads_PHRED_quality-pycoqc.png) Reminder: Qscores is the average per-base error probability, expressed on the log (Phred) scale --- ### Basecalled reads length *vs* reads PHRED quality (Qscores) ![Standard distribution for Nanopore reads.](../../images/basecalled_reads_length_vs_reads_PHRED_quality-pycoqc.png) ??? As for NanoPlot, this representation give a 2D visualisation of quality score for reads according to reads length. It allows to detect bias quickly and easily. --- ### Output over experiment time ![Sequenced reads over time for a single run.](../../images/output_over_experiment_time-pycoqc.png) ??? This representation gives information about sequenced reads over the time. - Each pic indicates a new loading of the flow cell (3 + the first load). - The contribution in total reads for each "refuel". - The production of reads is decreasing over time: - Most of material (DNA/RNA) is sequenced - Saturation of pores - Material degradation - ... - In this example, the contribution of refuling is very low and it can be considered as a bad run. Unlike all other technologies, with Nanopore you can refuel the flow cell with biological material without needing to make another run. --- ### Read length over experiment time ![Read length during an experiment.](../../images/read_length_over_experiment_time-pycoqc.png) ??? The read length over experiment time should be stable. It can slightly increase over the time as short fragments tend to be over-sequenced at the beginning and are less present over the time. --- ### Read quality over experiment time ![Read quality over the time.](../../images/read_quality_over_experiment_time-pycoqc.png) ??? The read quality should be stable over the time. --- ### Channel activity over time ![View of the activity of each pore from the flow cell over the time.](../../images/channel_activity_over_time-pycoqc.png) ??? It gives an overview of available pores, pore usage during the experiment and shows if the loading of the flow cell is good (almost all pores are used). In this case, the run can be considered bad as the number of used pores is decreasing over the time. --- ## Improving the quality of sequences - Filtering of sequences - with small mean quality score - too small - with too many N bases - based on their GC content - ... - Cutting/Trimming sequences - from low quality score parts - tails - ... ??? - Trimming is not always recommended (e.g. see Spades documentation) --- ### <i class="fas fa-key" aria-hidden="true"></i><span class="visually-hidden">keypoints</span> Key points - Run quality control on every sequencing dataset before any other analyses - Choose QC parameters carefully - Re-run FastQC to check the impact of the quality control --- ## Thank You! This material is the result of a collaborative work. Thanks to the [Galaxy Training Network](https://training.galaxyproject.org) and all the contributors!
This material is licensed under the Creative Commons Attribution 4.0 International License