9. Python for Big Genomics Datasets | Bioinformatics with Python Cookbook

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

Bioinformatics with Python Cookbook

By : Tiago Antao

4.7 (6)

Bioinformatics with Python Cookbook

4.7 (6)

By: Tiago Antao

Overview of this book

If you have intermediate-level knowledge of Python and are well aware of the main research and vocabulary in your bioinformatics topic of interest, this book will help you develop your knowledge further.

Preface

Preface

What this book covers

What you need for this book

Who this book is for

Sections

Conventions

Reader feedback

Customer support

Free Chapter

1. Python and the Surrounding Software Ecology

1. Python and the Surrounding Software Ecology

Introduction

Installing the required software with Anaconda

Installing the required software with Docker

Interfacing with R via rpy2

Performing R magic with IPython

2. Next-generation Sequencing

2. Next-generation Sequencing

Introduction

Accessing GenBank and moving around NCBI databases

Performing basic sequence analysis

Working with modern sequence formats

Working with alignment data

Analyzing data in the variant call format

Studying genome accessibility and filtering SNP data

3. Working with Genomes

3. Working with Genomes

Introduction

Working with high-quality reference genomes

Dealing with low-quality genome references

Traversing genome annotations

Extracting genes from a reference using annotations

Finding orthologues with the Ensembl REST API

Retrieving gene ontology information from Ensembl

4. Population Genetics

4. Population Genetics

Introduction

Managing datasets with PLINK

Introducing the Genepop format

Exploring a dataset with Bio.PopGen

Computing F-statistics

Performing Principal Components Analysis

Investigating population structure with Admixture

5. Population Genetics Simulation

5. Population Genetics Simulation

Introduction

Introducing forward-time simulations

Simulating selection

Simulating population structure using island and stepping-stone models

Modeling complex demographic scenarios

Simulating the coalescent with Biopython and fastsimcoal

6. Phylogenetics

6. Phylogenetics

Introduction

Preparing the Ebola dataset

Aligning genetic and genomic data

Comparing sequences

Reconstructing phylogenetic trees

Playing recursively with trees

Visualizing phylogenetic data

7. Using the Protein Data Bank

7. Using the Protein Data Bank

Introduction

Finding a protein in multiple databases

Introducing Bio.PDB

Extracting more information from a PDB file

Computing molecular distances on a PDB file

Performing geometric operations

Implementing a basic PDB parser

Animating with PyMol

Parsing mmCIF files using Biopython

8. Other Topics in Bioinformatics

8. Other Topics in Bioinformatics

Introduction

Accessing the Global Biodiversity Information Facility

Geo-referencing GBIF datasets

Accessing molecular-interaction databases with PSIQUIC

Plotting protein interactions with Cytoscape the hard way

9. Python for Big Genomics Datasets

9. Python for Big Genomics Datasets

Introduction

Setting the stage for high-performance computing

Designing a poor human concurrent executor

Performing parallel computing with IPython

Computing the median in a large dataset

Optimizing code with Cython and Numba

Programming with laziness

Thinking with generators

Index

Index

Programming with laziness

Lazy evaluation of a data structure delays the computation of values until they are needed. It comes mostly from functional programming languages, but has been increasingly adopted by Python among other popular languages. Indeed, one of the biggest differences between Python 2 and Python 3 is that Python 3 tends to be lazier than Python 2. It turns out that lazy evaluation allows easier analysis of large datasets, generally requiring much less memory and sometimes performs much less computation.

Here, we will take a very simple example from Chapter 2, Next-generation Sequencing, we will take two paired-end read files and try to read them simultaneously (as order on both files represents the pair).

Getting ready

We will repeat part of the analysis performed on the FASTQ recipe in Chapter 2, Next-generation Sequencing. This will require two FASTQ files (SRR003265_1.filt.fastq.gz and SRR003265_2.filt.fastq.gz) that you can retrieve from https://github.com/tiagoantao...

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

Bioinformatics with Python Cookbook

Search

Your notes and bookmarks