Profiling, Debugging, and Testing | Learning NumPy Array

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

Learning NumPy Array

By : Ivan Idris

4 (9)

Learning NumPy Array

4 (9)

By: Ivan Idris

Overview of this book

Learning NumPy Array

Learning NumPy Array

Credits

Credits

About the Author

About the Author

About the Reviewers

About the Reviewers

www.PacktPub.com

www.PacktPub.com

Preface

Preface

Free Chapter

Getting Started with NumPy

Getting Started with NumPy

Python

Installing NumPy, Matplotlib, SciPy, and IPython on Windows

Installing NumPy, Matplotlib, SciPy, and IPython on Linux

Installing NumPy, Matplotlib, and SciPy on Mac OS X

Building from source

NumPy arrays

Online resources and help

Summary

NumPy Basics

NumPy Basics

The NumPy array object

Creating a multidimensional array

Selecting array elements

NumPy numerical types

Creating a record data type

One-dimensional slicing and indexing

Manipulating array shapes

Creating views and copies

Fancy indexing

Indexing with a list of locations

Indexing arrays with Booleans

Stride tricks for Sudoku

Broadcasting arrays

Summary

Basic Data Analysis with NumPy

Basic Data Analysis with NumPy

Introducing the dataset

Determining the daily temperature range

Looking for evidence of global warming

Comparing solar radiation versus temperature

Analyzing wind direction

Analyzing wind speed

Analyzing precipitation and sunshine duration

Analyzing monthly precipitation in De Bilt

Analyzing atmospheric pressure in De Bilt

Analyzing atmospheric humidity in De Bilt

Summary

Simple Predictive Analytics with NumPy

Simple Predictive Analytics with NumPy

Examining autocorrelation of average temperature with pandas

Describing data with pandas DataFrames

Correlating weather and stocks with pandas

Predicting temperature

Analyzing intra-year daily average temperatures

Introducing the day-of-the-year temperature model

Modeling temperature with the SciPy leastsq function

Day-of-year temperature take two

Moving-average temperature model with lag 1

The Autoregressive Moving Average temperature model

The time-dependent temperature mean adjusted autoregressive model

Outliers analysis of average De Bilt temperature

Using more robust statistics

Summary

Signal Processing Techniques

Signal Processing Techniques

Introducing the Sunspot data

Moving averages

Smoothing functions

Forecasting with an ARMA model

Filtering a signal

Demonstrating cointegration

Summary

Profiling, Debugging, and Testing

Profiling, Debugging, and Testing

Assert functions

Profiling a program with IPython

Debugging with IPython

Performing Unit tests

Nose tests decorators

Summary

The Scientific Python Ecosystem

The Scientific Python Ecosystem

Numerical integration

Interpolation

Using Cython with NumPy

Clustering stocks with scikit-learn

Detecting corners

Comparing NumPy to Blaze

Summary

Index

Index

Profiling a program with IPython

As most of us learned in programming classes, premature optimization is the root of all evil. However, once you approach the final stages of software development, it could very well be that certain parts of the code are unnecessarily slow or use more memory than is strictly needed. We can find these issues through the process of profiling. Profiling involves measuring metrics such as execution time for a piece of code such as a function or a single statement.

IPython is an interactive Python environment, which also comes with a shell similar to the standard Python shell. In IPython, we can profile small snippets of code using timeit. We can also profile a larger script. We will show both approaches.

Timing a snippet:
Start IPython in pylab mode
```
ipython -pylab
```
Create an array containing 1,000 integer values between 0 and 1,000.
```
In [1]: a = arange(1000)
```
This is the time to search for the answer to everything 42 in the array.
```
In [2]: %timeit searchsorted(a, 42...
```

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

Learning NumPy Array

Search

Your notes and bookmarks