Book Image

Hands-On Software Engineering with Python

By : Brian Allbee, Nimesh Verma
Book Image

Hands-On Software Engineering with Python

By: Brian Allbee, Nimesh Verma

Overview of this book

Software Engineering is about more than just writing code—it includes a host of soft skills that apply to almost any development effort, no matter what the language, development methodology, or scope of the project. Being a senior developer all but requires awareness of how those skills, along with their expected technical counterparts, mesh together through a project's life cycle. This book walks you through that discovery by going over the entire life cycle of a multi-tier system and its related software projects. You'll see what happens before any development takes place, and what impact the decisions and designs made at each step have on the development process. The development of the entire project, over the course of several iterations based on real-world Agile iterations, will be executed, sometimes starting from nothing, in one of the fastest growing languages in the world—Python. Application of practices in Python will be laid out, along with a number of Python-specific capabilities that are often overlooked. Finally, the book will implement a high-performance computing solution, from first principles through complete foundation.
Table of Contents (21 chapters)
Free Chapter
1
Programming versus Software Engineering

Local parallel processing

The primary focus for the local parallelization of processing will be on the multiprocessing module. There are a couple of other modules that might be usable for some parallelization efforts (and those will be discussed later), but multiprocessing provides the best combination of flexibility and power with the least potential for restrictions from the Python interpreter or other OS-level interference.

As might be expected from the module's name, multiprocessing provides a class (Process) that facilitates the creation of child processes. It also provides a number of other classes that can be used to make working with child processes easier, including Queue (a multiprocess-aware queue implementation that can be used as a data destination), and Value and Array, which allow single and multiple values (of a single type) to be stored in a memory...