9. Python for Big Genomics Datasets | Bioinformatics with Python Cookbook

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents
Feedback & Rating

Bioinformatics with Python Cookbook

By : Tiago Antao

4.7 (6)

Bioinformatics with Python Cookbook

4.7 (6)

By: Tiago Antao

Overview of this book

If you have intermediate-level knowledge of Python and are well aware of the main research and vocabulary in your bioinformatics topic of interest, this book will help you develop your knowledge further.

Preface

Preface

What this book covers

What you need for this book

Who this book is for

Sections

Conventions

Reader feedback

Customer support

Free Chapter

1. Python and the Surrounding Software Ecology

1. Python and the Surrounding Software Ecology

Introduction

Installing the required software with Anaconda

Installing the required software with Docker

Interfacing with R via rpy2

Performing R magic with IPython

2. Next-generation Sequencing

2. Next-generation Sequencing

Introduction

Accessing GenBank and moving around NCBI databases

Performing basic sequence analysis

Working with modern sequence formats

Working with alignment data

Analyzing data in the variant call format

Studying genome accessibility and filtering SNP data

3. Working with Genomes

3. Working with Genomes

Introduction

Working with high-quality reference genomes

Dealing with low-quality genome references

Traversing genome annotations

Extracting genes from a reference using annotations

Finding orthologues with the Ensembl REST API

Retrieving gene ontology information from Ensembl

4. Population Genetics

4. Population Genetics

Introduction

Managing datasets with PLINK

Introducing the Genepop format

Exploring a dataset with Bio.PopGen

Computing F-statistics

Performing Principal Components Analysis

Investigating population structure with Admixture

5. Population Genetics Simulation

5. Population Genetics Simulation

Introduction

Introducing forward-time simulations

Simulating selection

Simulating population structure using island and stepping-stone models

Modeling complex demographic scenarios

Simulating the coalescent with Biopython and fastsimcoal

6. Phylogenetics

6. Phylogenetics

Introduction

Preparing the Ebola dataset

Aligning genetic and genomic data

Comparing sequences

Reconstructing phylogenetic trees

Playing recursively with trees

Visualizing phylogenetic data

7. Using the Protein Data Bank

7. Using the Protein Data Bank

Introduction

Finding a protein in multiple databases

Introducing Bio.PDB

Extracting more information from a PDB file

Computing molecular distances on a PDB file

Performing geometric operations

Implementing a basic PDB parser

Animating with PyMol

Parsing mmCIF files using Biopython

8. Other Topics in Bioinformatics

8. Other Topics in Bioinformatics

Introduction

Accessing the Global Biodiversity Information Facility

Geo-referencing GBIF datasets

Accessing molecular-interaction databases with PSIQUIC

Plotting protein interactions with Cytoscape the hard way

9. Python for Big Genomics Datasets

9. Python for Big Genomics Datasets

Introduction

Setting the stage for high-performance computing

Designing a poor human concurrent executor

Performing parallel computing with IPython

Computing the median in a large dataset

Optimizing code with Cython and Numba

Programming with laziness

Thinking with generators

Index

Index

Customer Reviews

4.7 (6)

5 star

66.7%

4 star

33.3%

3 star

0%

2 star

0%

1 star

0%

Computing the median in a large dataset

As you have seen in the first recipe, computing the median requires having all the values available. With something like a mean, we just need an accumulator and a counter. The fundamental point of this recipe is to introduce the idea of approximate computing; with big data, it may not always be the best strategy to get the precise value (of course, this should be evaluated on a case-by-case basis).

Getting ready

We will require the first recipe to have been fully run.

Here, we will take two different strategies to compute the median: approximating the data points in a way that allows compression of data and subsampling of data.

As usual, this is available in the 08_Advanced/Median.ipynb notebook.

How to do it...

Take a look at the following steps:

Our first approach will be to use approximations of all values, starting with creating a dictionary. This code should be run where the first recipe was run:
```
from __future__ import division, print_function
import...
```

Visually different images

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

Bioinformatics with Python Cookbook

Search

Your notes and bookmarks