Book Image

Julia 1.0 High Performance - Second Edition

By : Avik Sengupta
Book Image

Julia 1.0 High Performance - Second Edition

By: Avik Sengupta

Overview of this book

Julia is a high-level, high-performance dynamic programming language for numerical computing. If you want to understand how to avoid bottlenecks and design your programs for the highest possible performance, then this book is for you. The book starts with how Julia uses type information to achieve its performance goals, and how to use multiple dispatches to help the compiler emit high-performance machine code. After that, you will learn how to analyze Julia programs and identify issues with time and memory consumption. We teach you how to use Julia's typing facilities accurately to write high-performance code and describe how the Julia compiler uses type information to create fast machine code. Moving ahead, you'll master design constraints and learn how to use the power of the GPU in your Julia code and compile Julia code directly to the GPU. Then, you'll learn how tasks and asynchronous IO help you create responsive programs and how to use shared memory multithreading in Julia. Toward the end, you will get a flavor of Julia's distributed computing capabilities and how to run Julia programs on a large distributed cluster. By the end of this book, you will have the ability to build large-scale, high-performance Julia applications, design systems with a focus on speed, and improve the performance of existing programs.
Table of Contents (19 chapters)
Title Page
Dedication
Foreword
Licences

Deep learning on the GPU

The spread of deep learning methodologies has coincided with the popularity of the GPU in computing. These methods are very amenable to parallelization. Indeed, a lot of deep learning methods would not be feasible without GPUs. 

Running deep learning models on the GPU requires the installation of the CuDNN library from NVIDIA. This library contains fast implementations of the low-level mathematical primitives needed for deep learning systems. You'll need to register with the NVIDIA Developer Network and then download the library from https://developer.nvidia.com/cudnn. Choose the version for your operating system and install it on your machine. You'll need to have installed the appropriate graphics drivers and the CUDA toolkit prior to installing CuDNN. 

These primitives are now ready to be used from a higher-level library. To demonstrate...