Book Image

Mastering Python Scientific Computing

Book Image

Mastering Python Scientific Computing

Overview of this book

Table of Contents (17 chapters)
Mastering Python Scientific Computing
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Index

Advanced features of IPython


In subsequent subsections, we will have discussions of the various advanced features of IPython.

Fault-tolerant execution

The IPython task interface prepares the engines as fault-tolerant and dynamic-load-balanced cluster systems. In the task interface, the user does not have access to the engine. Instead, task allocation completely depends on the scheduler, and this makes the design of the interface simple, flexible, and powerful.

If a task fails in IPython, for any reason, then the task will be requeued and its execution will be attempted again. A user can configure the system to take a predefined number of retries if there is a failure, and they can also resubmit the task.

If required, users can explicitly resubmit any task. Alternatively, they can set a flag to retry the task for a predefined number of times—by setting a flag of the view or scheduler.

If the user is sure that the cause of the error is not a bug or problem in the code, then they can set the retries...