Book Image

Bioinformatics with Python Cookbook - Second Edition

By : Tiago Antao
Book Image

Bioinformatics with Python Cookbook - Second Edition

By: Tiago Antao

Overview of this book

Bioinformatics is an active research field that uses a range of simple-to-advanced computations to extract valuable information from biological data. This book covers next-generation sequencing, genomics, metagenomics, population genetics, phylogenetics, and proteomics. You'll learn modern programming techniques to analyze large amounts of biological data. With the help of real-world examples, you'll convert, analyze, and visualize datasets using various Python tools and libraries. This book will help you get a better understanding of working with a Galaxy server, which is the most widely used bioinformatics web-based pipeline system. This updated edition also includes advanced next-generation sequencing filtering techniques. You'll also explore topics such as SNP discovery using statistical approaches under high-performance computing frameworks such as Dask and Spark. By the end of this book, you'll be able to use and implement modern programming techniques and frameworks to deal with the ever-increasing deluge of bioinformatics data.

Related Content you might be interested in

Current Title:

Small book image
Bioinformatics with Python Cookbook - Second Edition
Tiago Antao
Nov, 2018 | 360 pages
No titles found
Table of Contents (16 chapters)
Title Page
Title Page
About Packt
About Packt
Contributors
Contributors
Preface
Preface
Free Chapter
1
Python and the Surrounding Software Ecology
Python and the Surrounding Software Ecology
Introduction
Installing the required software with Anaconda
Installing the required software with Docker
Interfacing with R via rpy2
Performing R magic with Jupyter Notebook
2
Next-Generation Sequencing
Next-Generation Sequencing
Introduction
Accessing GenBank and moving around NCBI databases
Performing basic sequence analysis
Working with modern sequence formats
Working with alignment data
Analyzing data in VCF
Studying genome accessibility and filtering SNP data
Processing NGS data with HTSeq
3
Working with Genomes
Working with Genomes
Introduction
Working with high-quality reference genomes
Dealing with low-quality genome references
Traversing genome annotations
Extracting genes from a reference using annotations
Finding orthologues with the Ensembl REST API
Retrieving gene ontology information from Ensembl
4
Population Genetics
Population Genetics
Introduction
Managing datasets with PLINK
Introducing the Genepop format
Exploring a dataset with Bio.PopGen
Computing F-statistics
Performing Principal Components Analysis
Investigating population structure with admixture
5
Population Genetics Simulation
Population Genetics Simulation
Introduction
Introducing forward-time simulations
Simulating selection
Simulating population structure using island and stepping-stone models
Modeling complex demographic scenarios
6
Phylogenetics
Phylogenetics
Introduction
Preparing a dataset for phylogenetic analysis
Aligning genetic and genomic data
Comparing sequences
Reconstructing phylogenetic trees
Playing recursively with trees
Visualizing phylogenetic data
7
Using the Protein Data Bank
Using the Protein Data Bank
Introduction
Finding a protein in multiple databases
Introducing Bio.PDB
Extracting more information from a PDB file
Computing molecular distances on a PDB file
Performing geometric operations
Animating with PyMOL
Parsing mmCIF files using Biopython
8
Bioinformatics Pipelines
Bioinformatics Pipelines
Introduction
Introducing Galaxy servers
Accessing Galaxy using the API
Developing a Galaxy tool
Using generic pipelines with bioinformatics data
Deploying a variant analysis pipeline with Airflow
9
Python for Big Genomics Datasets
Python for Big Genomics Datasets
Introduction
Using high-performance data formats – HDF5
Doing parallel computing with Dask
Using high-performance data formats – Parquet
Computing sequencing statistics using Spark
Optimizing code with Cython and Numba
10
Other Topics in Bioinformatics
Other Topics in Bioinformatics
Introduction
Doing metagenomics with the QIIME 2 Python API
Inferring shared chromosomal segments with Germline
Accessing the Global Biodiversity Information Facility via REST
Georeferencing GBIF datasets
Plotting protein interactions with Cytoscape the hard way
11
Advanced NGS Processing
Advanced NGS Processing
Introduction
Preparing the dataset for analysis
Using Mendelian error information for quality control
Using decision trees to explore the data
Exploring the data with standard statistics
Finding genomic features from sequencing annotations
Index
Index

Analyzing data in VCF

After running a genotype caller (for example, GATK or SAMtools), you will have a VCF file reporting on genomic variations, such as SNPs, insertions/deletions (INDELs), copy number variations (CNVs), and so on. In this recipe, we will discuss VCF processing with the PyVCF module.

Getting ready

While NGS is all about big data, there is a limit to how much I can ask you to download as a dataset for this book. I believe that 2 to 20 GB of data for a tutorial is asking too much. While the 1,000 Genomes' VCF files with realistic annotations are in this order of magnitude, we will want to work with much less data here. Fortunately, the Bioinformatics community has developed tools to allow for the partial download of data. As part of the SAMtools/htslib package (http://www.htslib.org/), you can download tabix and bgzip, which will take care of data management. On the command line, perform the following:

tabix -fh ftp://ftp-
trace.ncbi.nih.gov/1000genomes/ftp/release/20130502/supporting...
Previous Section
End of Section 7
Next Section