Skip to content

Latest commit

 

History

History
executable file
·
471 lines (268 loc) · 11.1 KB

talk.md

File metadata and controls

executable file
·
471 lines (268 loc) · 11.1 KB

Amplicon Sequencing Data Analysis with QIIME 2

Christian Diener, Gibbons Lab

from the 2021 ISB Virtual Microbiome Series



Hold your horses 🐴

Let's get the slides first (use your computer, phone, TV, fridge, anything with a 16:9 screen)

https://gibbons-lab.github.io/isb_course_2021/16S


Organization of the course


Setup

💻 Let's switch to the notebook and get started


Click me to open the notebook!


Wait... what?

All output we generate can be found in the treasure_chest folder at

https://github.com/gibbons-lab/isb_course_2021

or materials/treasure_chest in the Colaboratory notebook.


QIIME

Pronounced like wind chime.

Created ~2010 during the Human Microbiome Project (2007 - 2016) under the leadership of Greg Caporaso and Rob Knight.


What is QIIME?

QIIME 2 is a powerful, extensible, and decentralized microbiome analysis package with a focus on data processing and analysis transparency.

Quantitative Insights into Microbial Ecology


So what is it really?

Essentially, QIIME is a set of commands to transform microbiome data into intermediate outputs and visualizations.

It's commonly used via the command line.


QIIME 2 was introduced in 2016 and improves upon QIIME 1, based on user experiences during the HMP.

Major changes:

  • integrated tracking of data provenance
  • semantic type system
  • extendable plugin system
  • multiple user interfaces (in progress)

Where to find help?

QIIME 2 comes with a lot of help, including a wide range of tutorials, general documentation and a user forum where you can ask questions.


Artifacts, actions and visualizations

QIIME 2 manages artifacts, which are basically intermediate data that feed into actions to either produce other artifacts or visualizations.


Remember

Artifacts often represent intermediate steps, but Visualizations are end points meant for human consumption ☝️.


What is amplicon sequencing?


Why the 16S gene?

The 16S gene is universal and contains interspersed conserved regions perfect for PCR priming and hypervariable regions with phylogenetic heterogeneity.


The Earth Microbiome Project

Photo by Nathan Jennings.


A communal catalogue reveals Earth’s multiscale microbial diversity


Our samples

  • 15 samples from 5 environments
  • honey bee gut, cenotes in Yucatan (freshwater), ocean, human gut, soil




Photos by Dmitry Grigoriev, Jared Rice, Matt Hardy, Alex Block, and Roman Synkevich.


What will we do today?


Illumina FastQ files (Basespace)

@SRR2143527.13917 13917 length=251
TACGTAGGTGGCGAGCGTTATCCGGAATTATTGGGCGTAAA...
+
BBBBAF?A@D2BEEEGGGFGGGHGGGCFGFHHCFHCEFGGH...

We have our raw sequencing data, but QIIME 2 only operates on artifacts. How do we convert our data into an artifact??

🐥 or 🥚?


Our first QIIME 2 commands

💻 Let's switch to the notebook and get started


Time to bring out the big guns 💣⚡

We will now run the DADA2 plugin, which will do 3 things:

  1. filter and trim the reads
  2. find the most likely original sequences in the sample (ASVs)
  3. remove chimeras
  4. count the abundances

Preprocessing sequencing reads

  1. trim low quality regions
  2. remove reads with low average quality
  3. remove reads with ambiguous bases (Ns)
  4. remove PhiX (bacteriophage genome commonly added as a control to sequencing runs)

Identifying alternative sequence variants (ASVs)

Expectation-Maximization (EM) algorithm used to build a dataset-specific error model and find true amplicon sequence variants (ASVs), all at once.


PCR chimeras

The primers used in this study were F515/R806. The numbers denote positions along the 16S gene. So, how long is the amplified fragment?


We now have a table containing the counts for each ASV in each sample. We also have a list of ASVs.


:thinking_face: Do you have an idea for what we could do with these two data sets? What quantities might we be interested in?


Diversity metrics

In microbial community analysis we are usually interested in two different families of diversity metrics, alpha diversity (ecological diversity within a sample) and beta diversity (ecological differences between samples).


Alpha diversity

How diverse is a single sample?

  • richness: how many taxa do we observe (richness)?
    → total number of observed taxa
  • evenness: how evenly are abundances distributed across taxa?
    → Evenness index
  • mixtures: metrics that combine both richness and evenness
    → Shannon index, Simpson's Index

Statistical tests for alpha diversity

Alpha diversity will provide a single value/covariate for each sample.

It can be treated as any other sample measurement and is suitable for classic univariate tests (t-test, Mann-Whitney U test).


Beta diversity

How different are two or more samples/donors/sites from one another other?

  • unweighted: how many taxa are shared between samples?
    → Jaccard index, unweighted UniFrac
  • weighted: do shared taxa have similar abundances?
    → Bray-Curtis distance, weighted UniFrac

UniFrac

Do samples share genetically similar taxa?

Weighted UniFrac further scales phylogenetic branch lengths by abundances.


How to build a phylogenetic tree?

One of the basic things we might want to look at is how the ASVs across all samples are evolutionarily related to one another. That is, we are often interested in their phylogeny.

Phylogenetic trees are built from multiple sequence alignments and sequences are arranged by sequence similarity (branch length).


We can visualize this tree with EMPRESS.


Principal Coordinate Analysis


Statistical tests for beta diversity

More complicated. Usually not normal and very heterogeneous. PERMANOVA can deal with that.


Run the diversity analyses

💻 Let's switch to the notebook and calculate the diversity metrics


What organisms are present in our samples?

We are still just working with sequences and we have no idea what organisms those sequences correspond to.


:thinking_face: What would you do to go from a sequence to an organism's name?


Taxonomic ranks


Even though directly aligning our sequences to a database of known genes seems most intuitive, this does not always work well in practice. Why?


Multinomial Naive Bayes

Instead, use subsequences (k-mers) and their counts to predict the lineage/taxonomy with machine learning methods. For 16S amplicon fragments, this approach often provides better generalization and faster results.


Let's assign taxonomy to our samples

💻 Let's switch to the notebook and assign taxonomy to our ASVs


Your turn

Are certain taxa only found in one environment? Are others more widely distributed?


The project challenge 🦠

Submit your figure here.

Note:

Welcome to the 2021 ISB Microbiome Project challenge. Create a figure submission in this channel for a chance to win an awesome ISB T-shirt. Our team will pick one winning submission for each geographical region.

Rules:

  • one entry per participant
  • figure content has to be created only using Qiime 2 and the EMP data set from the course
  • 4 panels (sub-figures) maximum, a single figure/plot is perfectly okay
  • must include text that provides the region you identify with and a caption for the figure

Regions: Regions are from the United Nations Geoscheme. You can use the map in the link with the following changes:

  • North America is split into: North America, United States, and Canada
  • Antarctica is included as a region

And we are done 👏

ISB team
Joey Petosa
Allison Kudla
Christian Diener
Sean Gibbons
Priyanka Baloni
Tomasz Wilmanski
Noa Rappaport
Alex Carr
Audri Hubbard
Renee Duprel
Joe Myxter
Thea Swanson

Thanks!