Book Overview & Buying
Table Of Contents

Learning Concurrency in Python

By : Elliot Forbes

3.3 (3)

Buy this Book

Learning Concurrency in Python

3.3 (3)

By: Elliot Forbes

Buy this Book

Overview of this book

Python is a very high level, general purpose language that is utilized heavily in fields such as data science and research, as well as being one of the top choices for general purpose programming for programmers around the world. It features a wide number of powerful, high and low-level libraries and frameworks that complement its delightful syntax and enable Python programmers to create. This book introduces some of the most popular libraries and frameworks and goes in-depth into how you can leverage these libraries for your own high-concurrent, highly-performant Python programs. We'll cover the fundamental concepts of concurrency needed to be able to write your own concurrent and parallel software systems in Python. The book will guide you down the path to mastering Python concurrency, giving you all the necessary hardware and theoretical knowledge. We'll cover concepts such as debugging and exception handling as well as some of the most popular libraries and frameworks that allow you to create event-driven and reactive systems. By the end of the book, you'll have learned the techniques to write incredibly efficient concurrent systems that follow best practices.

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Free Chapter

Speed It Up!

History of concurrency

Threads and multithreading

Processes

Multiprocessing

Reactive programming

GPU programming

The limitations of Python

Concurrent image download

Improving number crunching with multiprocessing

Summary

Parallelize It

Understanding concurrency

I/O bottlenecks

Understanding parallelism

How do they work on a CPU?

System architecture styles

Computer memory architecture styles

Summary

Life of a Thread

Threads in Python

Handling threads in Python

How does the operating system handle threads

Multithreading models

Summary

Synchronization between Threads

Synchronization between threads

Shared resources and data races

Summary

Communication between Threads

Standard data structures

Defining your own thread-safe communication structures

Summary

Debug and Benchmark

Testing strategies

Debugging

Benchmarking

Profiling

Summary

Executors and Pools

Concurrent futures

Future objects

ProcessPoolExecutor

Improving our crawler

concurrent.futures in Python 2.7

Summary

Multiprocessing

Working around the GIL

The life of a process

Multiprocessing pools

Communication between processes

Multiprocessing managers

Communicating sequential processes

Summary

Event-Driven Programming

Event-driven programming

Asyncio

Debugging asyncio programs

Twisted

Gevent

Summary

Reactive Programming

Basic reactive programming

ReactiveX, or RX

PyFunctional

Summary

Using the GPU

Introduction to GPUs

Why use the GPU?

CUDA

PyCUDA

Numba

Accelerate

Theano

PyOpenCL

Summary

Choosing a Solution

Libraries not covered in this book

Designing your systems

Summary

ReactiveX, or RX

Reactive Extensions, or RX, first hit the scenes in around 2010 and has been heavily adopted by large tech companies such as Netflix using RxJava. It has since grown into something far bigger and more prevalent within the industry.

It comes in many different flavors for each of the different programming languages currently out there. The most popular of these are as follows:

RxJava for Java
RxJS for JavaScript
RxPy for Python
RxSwift for Swift

The full list of Rx flavors can be found at https://github.com/ReactiveX.

Reactive Extensions for Python, or RxPY as it has been condensed to, is a library for composing asynchronous and event-based programs using observable collections and LINQ-style query operators in Python. I first came across a similar version of ReactiveX when I was working with the new Angular framework, and my experience with it was great. It...

Tech Concepts

Programming languages

Tech Tools