Book Image

Python Parallel Programming Cookbook

By : Giancarlo Zaccone
Book Image

Python Parallel Programming Cookbook

By: Giancarlo Zaccone

Overview of this book

This book will teach you parallel programming techniques using examples in Python and will help you explore the many ways in which you can write code that allows more than one process to happen at once. Starting with introducing you to the world of parallel computing, it moves on to cover the fundamentals in Python. This is followed by exploring the thread-based parallelism model using the Python threading module by synchronizing threads and using locks, mutex, semaphores queues, GIL, and the thread pool. Next you will be taught about process-based parallelism where you will synchronize processes using message passing along with learning about the performance of MPI Python Modules. You will then go on to learn the asynchronous parallel programming model using the Python asyncio module along with handling exceptions. Moving on, you will discover distributed computing with Python, and learn how to install a broker, use Celery Python Module, and create a worker. You will understand anche Pycsp, the Scoop framework, and disk modules in Python. Further on, you will learnGPU programming withPython using the PyCUDA module along with evaluating performance limitations.
Table of Contents (13 chapters)
Python Parallel Programming Cookbook
About the Author
About the Reviewers

Chaining objects with Pyro4

In this recipe, we'll show you how to create a chain of objects, which call each other, with Pyro4. Let's suppose that we want to build a distributed architecture like this:

Chaining an object with Pyro4

We have four objects: a client and three servers disposed in a chain topology, as shown in the preceding figure. The client forwards a request to Server1 and starts the chain call, forwarding the request to Server2. Then, it calls the next object in the chain and Server3. The chain call ends when Server3 calls Server1 again.

The example we're going to show highlights the aspects of the management of remote objects, which can be easily extended to handle more complex distributed architectures.

How to do it…

To implement a chain of objects with Pyro4, we need five Python scripts. The first one is the client ( Here is the code for it:

from __future__ import print_function
import Pyro4

obj = Pyro4.core.Proxy("PYRONAME:example.chain.A")
print("Result=%s" % obj...