Book Image

Julia 1.0 High Performance - Second Edition

By : Avik Sengupta
Book Image

Julia 1.0 High Performance - Second Edition

By: Avik Sengupta

Overview of this book

Julia is a high-level, high-performance dynamic programming language for numerical computing. If you want to understand how to avoid bottlenecks and design your programs for the highest possible performance, then this book is for you. The book starts with how Julia uses type information to achieve its performance goals, and how to use multiple dispatches to help the compiler emit high-performance machine code. After that, you will learn how to analyze Julia programs and identify issues with time and memory consumption. We teach you how to use Julia's typing facilities accurately to write high-performance code and describe how the Julia compiler uses type information to create fast machine code. Moving ahead, you'll master design constraints and learn how to use the power of the GPU in your Julia code and compile Julia code directly to the GPU. Then, you'll learn how tasks and asynchronous IO help you create responsive programs and how to use shared memory multithreading in Julia. Toward the end, you will get a flavor of Julia's distributed computing capabilities and how to run Julia programs on a large distributed cluster. By the end of this book, you will have the ability to build large-scale, high-performance Julia applications, design systems with a focus on speed, and improve the performance of existing programs.
Table of Contents (19 chapters)
Title Page
Dedication
Foreword
Licences

Getting started with GPUs

To begin, you'll need a computer with a discrete GPU installed. For the purposes of this chapter, that will mean a GPU manufactured by NVIDIA. While other brands of GPUs are available, support for those is much weaker, both for general scientific programs, and, in particularin Julia. Hence, we will not have the opportunity to discuss them in this chapter and we limit our focus to NVIDIA GPUs. 

Once you have access to a computer with a GPU (whether on your desktop or on the cloud), the first order of business is to install a driver and CUDA toolkit on the machine. The exact instructions will depend on your operating system and the GPU model you use. You will need to ensure that the versions of the device driver and CUDA toolkit are compatible.

CUDA is the programming model used by NVIDIA for general-purpose computing on its GPUs. It&apos...