Book Image

IPython Interactive Computing and Visualization Cookbook

By : Cyrille Rossant
Book Image

IPython Interactive Computing and Visualization Cookbook

By: Cyrille Rossant

Overview of this book

Related Content you might be interested in

Current Title:

Small book image
IPython Interactive Computing and Visualization Cookbook
Cyrille Rossant
Sep, 2014 | 512 pages
No titles found
Table of Contents (22 chapters)
IPython Interactive Computing and Visualization Cookbook
IPython Interactive Computing and Visualization Cookbook
Credits
Credits
About the Author
About the Author
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
A Tour of Interactive Computing with IPython
A Tour of Interactive Computing with IPython
Introduction
Introducing the IPython notebook
Getting started with exploratory data analysis in IPython
Introducing the multidimensional array in NumPy for fast array computations
Creating an IPython extension with custom magic commands
Mastering IPython's configuration system
Creating a simple kernel for IPython
2
Best Practices in Interactive Computing
Best Practices in Interactive Computing
Introduction
Choosing (or not) between Python 2 and Python 3
Efficient interactive computing workflows with IPython
Learning the basics of the distributed version control system Git
A typical workflow with Git branching
Ten tips for conducting reproducible interactive computing experiments
Writing high-quality Python code
Writing unit tests with nose
Debugging your code with IPython
3
Mastering the Notebook
Mastering the Notebook
Introduction
Teaching programming in the notebook with IPython blocks
Converting an IPython notebook to other formats with nbconvert
Adding custom controls in the notebook toolbar
Customizing the CSS style in the notebook
Using interactive widgets – a piano in the notebook
Creating a custom JavaScript widget in the notebook – a spreadsheet editor for pandas
Processing webcam images in real time from the notebook
4
Profiling and Optimization
Profiling and Optimization
Introduction
Evaluating the time taken by a statement in IPython
Profiling your code easily with cProfile and IPython
Profiling your code line-by-line with line_profiler
Profiling the memory usage of your code with memory_profiler
Understanding the internals of NumPy to avoid unnecessary array copying
Using stride tricks with NumPy
Implementing an efficient rolling average algorithm with stride tricks
Making efficient array selections in NumPy
Processing huge NumPy arrays with memory mapping
Manipulating large arrays with HDF5 and PyTables
Manipulating large heterogeneous tables with HDF5 and PyTables
5
High-performance Computing
High-performance Computing
Introduction
Accelerating pure Python code with Numba and just-in-time compilation
Accelerating array computations with Numexpr
Wrapping a C library in Python with ctypes
Accelerating Python code with Cython
Optimizing Cython code by writing less Python and more C
Releasing the GIL to take advantage of multicore processors with Cython and OpenMP
Writing massively parallel code for NVIDIA graphics cards (GPUs) with CUDA
Writing massively parallel code for heterogeneous platforms with OpenCL
Distributing Python code across multiple cores with IPython
Interacting with asynchronous parallel tasks in IPython
Parallelizing code with MPI in IPython
Trying the Julia language in the notebook
6
Advanced Visualization
Advanced Visualization
Introduction
Making nicer matplotlib figures with prettyplotlib
Creating beautiful statistical plots with seaborn
Creating interactive web visualizations with Bokeh
Visualizing a NetworkX graph in the IPython notebook with D3.js
Converting matplotlib figures to D3.js visualizations with mpld3
Getting started with Vispy for high-performance interactive data visualizations
7
Statistical Data Analysis
Statistical Data Analysis
Introduction
Exploring a dataset with pandas and matplotlib
Getting started with statistical hypothesis testing – a simple z-test
Getting started with Bayesian methods
Estimating the correlation between two variables with a contingency table and a chi-squared test
Fitting a probability distribution to data with the maximum likelihood method
Estimating a probability distribution nonparametrically with a kernel density estimation
Fitting a Bayesian model by sampling from a posterior distribution with a Markov chain Monte Carlo method
Analyzing data with the R programming language in the IPython notebook
8
Machine Learning
Machine Learning
Introduction
Getting started with scikit-learn
Predicting who will survive on the Titanic with logistic regression
Learning to recognize handwritten digits with a K-nearest neighbors classifier
Learning from text – Naive Bayes for Natural Language Processing
Using support vector machines for classification tasks
Using a random forest to select important features for regression
Reducing the dimensionality of a dataset with a principal component analysis
Detecting hidden structures in a dataset with clustering
9
Numerical Optimization
Numerical Optimization
Introduction
Finding the root of a mathematical function
Minimizing a mathematical function
Fitting a function to data with nonlinear least squares
Finding the equilibrium state of a physical system by minimizing its potential energy
10
Signal Processing
Signal Processing
Introduction
Analyzing the frequency components of a signal with a Fast Fourier Transform
Applying a linear filter to a digital signal
Computing the autocorrelation of a time series
11
Image and Audio Processing
Image and Audio Processing
Introduction
Manipulating the exposure of an image
Applying filters on an image
Segmenting an image
Finding points of interest in an image
Detecting faces in an image with OpenCV
Applying digital filters to speech sounds
Creating a sound synthesizer in the notebook
12
Deterministic Dynamical Systems
Deterministic Dynamical Systems
Introduction
Plotting the bifurcation diagram of a chaotic dynamical system
Simulating an elementary cellular automaton
Simulating an ordinary differential equation with SciPy
Simulating a partial differential equation – reaction-diffusion systems and Turing patterns
13
Stochastic Dynamical Systems
Stochastic Dynamical Systems
Introduction
Simulating a discrete-time Markov chain
Simulating a Poisson process
Simulating a Brownian motion
Simulating a stochastic differential equation
14
Graphs, Geometry, and Geographic Information Systems
Graphs, Geometry, and Geographic Information Systems
Introduction
Manipulating and visualizing graphs with NetworkX
Analyzing a social network with NetworkX
Resolving dependencies in a directed acyclic graph with a topological sort
Computing connected components in an image
Computing the Voronoi diagram of a set of points
Manipulating geospatial data with Shapely and basemap
Creating a route planner for a road network
15
Symbolic and Numerical Mathematics
Symbolic and Numerical Mathematics
Introduction
Diving into symbolic computing with SymPy
Solving equations and inequalities
Analyzing real-valued functions
Computing exact probabilities and manipulating random variables
A bit of number theory with SymPy
Finding a Boolean propositional formula from a truth table
Analyzing a nonlinear differential system – Lotka-Volterra (predator-prey) equations
Getting started with Sage
Index
Index

About the Reviewers

Chetan Giridhar is an open source evangelist and Python enthusiast. He has been invited to talk at international Python conferences on topics such as filesystems, search engines, and real-time communication. He is also working as an associate editor at Python editorial, The Python Papers Anthology.

Chetan works as a lead engineer and evangelist at BlueJeans Network (http://bluejeans.com/), a leading video conferencing site on Cloud Company.

He has co-authored an e-book, Design Patterns in Python, Testing Perspective, and has reviewed books on Python programming at Packt Publishing.

I'd like to thank my parents (Jayant and Jyotsana Giridhar), my wife Deepti, and my friends/colleagues for supporting and inspiring me.

Robert Johansson has a PhD in Theoretical Physics from Chalmers University of Technology, Sweden. He is currently working as a researcher at the Interdisciplinary Theoretical Science Research Group at RIKEN, Japan, focusing on computational condensed-matter physics and quantum mechanics.

Maurice HT Ling completed his PhD in Bioinformatics and BSc (Hons) in Molecular and Cell Biology from The University of Melbourne, Australia. He is currently a research fellow in Nanyang Technological University, Singapore, and an honorary fellow in The University of Melbourne, Australia. Maurice coedits The Python Papers and cofounded the Python User Group (Singapore), where he has served as an executive committee member since 2010. His research interests lies in life—biological and artificial life, and artificial intelligence—using computer science and statistics as tools to understand life and its numerous aspects. His personal website is http://maurice.vodien.com.

Jose Unpingco is the author of the Python for Signal Processing blog and the corresponding book. A graduate from University of California, San Diego, he has spent almost 20 years in the industry as an analyst, instructor, engineer, consultant, and technical director in the area of signal processing. His interests include time-series analysis, statistical signal processing, random processes, and large-scale interactive computing.

Unpingco has been an active member of the scientific Python community for over a decade, and developed some of the first video tutorials on IPython and scientific Python. He has also helped fund a number of scientific Python efforts in a wide variety of disciplines.

Previous Section
Next Chapter