We will start with a simple parallel "Hello world" program using ipcluster
.
To use IPython for parallel computing, you will need a controller and one or more engines. The easiest way to get them is to start them on your localhost using the ipcluster
command:
ipcluster start –n 4
It will start a controller and four engines.
This can be somewhat fraught with subtle errors, however, as the engines do not necessarily have the same environment as the command line that started them. You may have more luck starting the entire thing from inside an IPython session, using the !
escape for system commands, shown as follows:
In [5]: !ipcluster start -n 4 & In [6]: 2015-10-26 15:52:53.738 [IPClusterStart] Using existing profile dir: '/nfs/02/wit0096/.ipython/profile_default' 2015-10-26 15:52:53.828 [IPClusterStart] Removing pid file: /nfs/02/wit0096/.ipython/profile_default/pid/ipcluster.pid 2015-10-26 15:52:53.828 [IPClusterStart] Starting ipcluster with ...