In this section, we will cover some additional topics that will help us understand the additional characteristics of the multi-GPU system.
Additional tricks
Benchmarking an existing system with an InfiniBand network card
Different benchmarks are available for testing the RDMA feature. One such benchmark for the InfiniBand adapter can be found at https://www.openfabrics.org/. You can test your bandwidth by executing the following code:
$ git clone git://git.openfabrics.org/~grockah/perftest.git
$ cd perftest
$ ./autogen.sh
$ export CUDA_H_PATH=<<Path to cuda.h>>
$ ./configure –prefix=$HOME/test
$ make all install
Then, you can run the following commands to test the bandwidth:
For example host to GPU memory...