-
Book Overview & Buying
-
Table Of Contents
The C++ Programmer's Mindset
By :
Problems that are too large for a single computer with a handful of threads require a larger and better coordinated effort from a cluster of computers. To coordinate work among a large number of nodes in a cluster requires a message passing infrastructure, such as the numerous implementations of MPI. These can be deployed on in-house compute clusters, externally managed clusters, or in the cloud. In all cases, the programming is the same, and it is for the MPI implementation to enable the work to proceed. However, this does not mean you shouldn’t think carefully about the organization of the cluster and the work being performed.
When multiple nodes are involved, one must be careful about the way that one accesses data and other resources. Multiple simultaneous accesses to a shared resource can create congestion and, in extreme cases, severely degrade performance. In the cloud, one must take care to consider where data and the compute nodes are located. The best...