TACC - High Performance Computing for NextGen Sequence Analysis

Oct 8, 2012

Your Instructors

Learning objectives

1. Role of TACC for UT System researchers

2. Logging into Lonestar and other TACC systems

3. Batch vs interactive computing on Lonestar

4. The TACC software environmment

5. File systems available on TACC Lonestar

6. Parallelism strategies for increasing efficiency of NextGen analyses

7. Use of idev interactive sessions on TACC systems

8. Moving files via SFTP and SCP

Outline

Linux and Lonestar Refresher Course (9:00-10:00)

• Linux basics with Lonestar

  • Logging in via SSH

  • Command-line tricks (tab completion and the history)

  • Essential Linux commands

  • Wildcards and special file names

  • Using options with Linux commands

  • Getting help

  • Extra:

• Lonestar Essentials

  • The login (or head) nodes

    • Acceptable uses for login nodes

    • What not to use login nodes for

  • Lonestar file systems

    • Diagram of Lonestar's directories

  • Running compute jobs on Lonestar

    • Batch (qsub)

    • Interactive (idev)

• Editing files

  • Using nano on the command line

  • Demo: Using TextWrangler (Mac), Notepad++ (Windows), or gEdit (Linux) from a desktop environment

• Finding and using software

  • The module system

    • avail, list, load, swap, unload, key

  • Linux PATHs

  • Extra: List of genomics modules available at TACC

  • Extra: Installing your own Linux software

Break (10:00-10:15)

Delving into HPC-oriented NGS analysis (10:15-11:15)

• Tutorial: Read mapping with BWA and BOWTIE

• Supplemental Material

  • Presentation: 

Speeding up your analyses using parallel computing (11:15-11:50)

• Introduction:  (PDF)

• Tutorial: Using threads to speed up mapping on a single compute node

• Tutorial: Using the TACC Parametric Launcher to speed up mapping (or any other natively parallel task) across multiple nodes

  • Bonus example: Using the Launcher to automate Rscript analyses

Set-up for Afternoon (11:50-12:00)

• Pre-flight instructions for Interactive Computing session

  • Please complete before going to lunch!

Lunch (12:00-1:00)

• Please return promptly!

Variant Calling with SAMtools (1:00-1:40)

• Tutorial: Variant calling using SAMtools

  • Calling SNPs and Indels

  • Inspecting alignments supporting a variant using tview

  • Filtering variants

  • Finding summary statistics

• Supplemental material

Downloading and uploading files using SFTP (1:40-1:50)

• The sftp and scp commands

• DEMO: Using CyberDuck on the desktop

  • Cyberduck 4.2.1 for Mac OS X

  • Cyberduck 4.2.1 for Windows XP, Vista, 7

• Supplemental material

  • Using sFTP for file browsing on Linux

Review (1:50-2:00)

After-class QA (2:00-2:30)