Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Throughout the course we've gone over how errors can pop up in your data and how they can effect confidence in variant calls and knowledge of what variants are actually real. Here we provide you with real data to show the difference between a non-corrected library and a error corrected library.

Warning
titlePrerequisite required

This tutorial makes use of data generated in the quick Error Correction tutorial. If you have not done that tutorial already you should do it first.

...

  1. Run breseq on fastq files corresponding to error corrected, and non-error corrected data
  2. Gain an understanding of just how powerful error correction can be

...


Get some data:

The reference files 1400flanking.gff3, and REL606.maksed.gff3  should be copied from the $BI/gva_course/mixed_population directory into a new folder GVA_breseq_Error_Correction while DED110_SSCS.fastq, and DED110_all.trimmed.fastq should be copied from your GVA_Error_Correction folder. 

...

Expand
titleClick here if you need help copying the fastq files you made in the previous tutorial...
Code Block
cp $SCRATCH/GVA_Error_Correction/DED110_SSCS.fastq .
cp $SCRATCH/GVA_Error_Correction/DED110_all.trimmed.fastq .

...

Generate a commands file

Like our other breseq tutorials these commands should be run on an idev shell and they should be run in the background so both comparisons can be run at the same time. the job queue system.

In this case we are going to be running breseq in both polymorphism mode (-p), and targeted sequencing mode (-t). By default breseq creates a lot of html files as output which ordinarily are very useful to visualize what the characteristics of any mutation are (in a better way than can be done with IGV). For normal runs this is extremely useful. For targeted deep sequencing runs (especially ones where we have not done error corrections), this can be incredibly time consuming. Since we are ultimately only interested in comparing the difference in number of mutations detected and their frequencies rather tahn than the specific characteristics of those mutations, we also include the --brief-html-output option. We will also be using 2 different reference files, 1400flanking.gff3 should be used as a standard reference while REL606.masked.gff3 should be used as a junction only reference. 

Code Block
languagebash
titlePlace the commands on line 2 and 3 in a new file named breseq_commands
mkdir Logs module unload samtools
SSCS_output
breseq -p -t -o SSCS_output/trimmed -r 1400flanking.gff3 -s REL606.masked.gff3 --brief-html-output DED110_all.trimmed.fastq >& Logs/trimmed.log.txt
&
breseq -p -t -o SSCS_output/SSCS -r 1400flanking.gff3 -s REL606.masked.gff3 --brief-html-output DED110_SSCS.fastq >& Logs/SSCS.log.txt &
# wait a few moments and check that breseq is running using the tail command
tail Logs/*.log.txt

Generate a slurm file

Code Block
languagebash
titleModify your slurm file
cp /corral-repl/utexas/BioITeam/gva_course/GVA2021.launcher.slurm breseq.slurm
nano breseq.slurm
Line numberAs isTo be
16

#SBATCH -J jobName

#SBATCH -J SSCSbreseq
17

#SBATCH -n 1

#SBATCH -n 2

21

#SBATCH -t 12:00:00

#SBATCH -t 6:00:00

22

##SBATCH --mail-user=ADD

#SBATCH --mail-user=<YourEmailAddress>

23

##SBATCH --mail-type=all

#SBATCH --mail-type=all

27

conda activate GVA2021

conda activate GVA-breseq

31

export LAUNCHER_JOB_FILE=commands

export LAUNCHER_JOB_FILE=breseq_commands

The changes to lines 22 and 23 are optional but will give you an idea of what types of email you could expect from TACC if you choose to use these options. Just be sure to pay attention to these 2 lines starting with a single # symbol after editing them.

Line 27 assumes you named your breseq environment GVA-breseq in the earlier tutorial. 

Again use ctl-o and ctl-x to save the file and exit.

Submit a job

Code Block
languagebash
titlesubmit the job to run on the que
sbatch breseq.slurm

Generate comparison table for the 2 types of samples

One the job is complete, Just like the previous tutorial we now want to create a comparison file using "gdtools compare" so we can see the difference of having the trimmed reads vs the SSCS reads. This time you want to create a file "trimmed_vs_SSCS.html".

Expand
titleIf you need a hint without the answer click the triangle...

This was extensively covered in the Advanced Breseq tutorial. You may want to review this section of the tutorial for more detailed explanation while you wait for the 2 runs to complete. Check which commands are still running using the jobs command and the tail command listed above.

Code Block
gdtools compare -h

the above will display instructions stating that gdtools compare needs a genebank (gbk) reference file, and .gd files to compare. The -o command is used to direct the output to a specific file name and/or location.

Expand
titleIf you are still stuck and want the answer click the triangle...
Code Block
gdtools compare -o trimmed_vs_SSCS.html -r reference/REL606.masked.gff3 -r reference/1400flanking.gff3 SSCS_output/SSCS/output/output.gd SSCS_output/trimmed/output/output.gd

The comparison table as well as the output for the trimmed and SSCS reads can now be exported to your local computer for viewing.

Evaluating the effect of error correction:

Once you have transferred the trimmed_vs_SSCS.html file back to your computer, open it and scroll around to see what the effects of our SSCS error correction were.

Return to GVA2020GVA2021