Book Image

Distributed Computing with Go

By : V.N. Nikhil Anurag
Book Image

Distributed Computing with Go

By: V.N. Nikhil Anurag

Overview of this book

Distributed Computing with Go gives developers with a good idea how basic Go development works the tools to fulfill the true potential of Golang development in a world of concurrent web and cloud applications. Nikhil starts out by setting up a professional Go development environment. Then you’ll learn the basic concepts and practices of Golang concurrent and parallel development. You’ll find out in the new few chapters how to balance resources and data with REST and standard web approaches while keeping concurrency in mind. Most Go applications these days will run in a data center or on the cloud, which is a condition upon which the next chapter depends. There, you’ll expand your skills considerably by writing a distributed document indexing system during the next two chapters. This system has to balance a large corpus of documents with considerable analytical demands. Another use case is the way in which a web application written in Go can be consciously redesigned to take distributed features into account. The chapter is rather interesting for Go developers who have to migrate existing Go applications to computationally and memory-intensive environments. The final chapter relates to the rather onerous task of testing parallel and distributed applications, something that is not usually taught in standard computer science curricula.
Table of Contents (11 chapters)

The standard indexing model

Consider the index in a book. Each book will have its own index, which lists all the words in an alphabetical order showing their location within the book. However, if we want to keep track of word occurrences in multiple books, checking each book's index is quite inefficient. Let's look at an example.

An example – books with an index of words

Imagine we have three books: Book 1, Book 2, and Book 3, and the following are their respective indexes. The numbers beside each word represent which page the word occurs on:

* Book 1 (Index)
  - apple - 4, 10, 20
  - cat - 10, 21, 22
  - zebra - 15, 25, 63
    
* Book 2 (Index)
  - banana - 14, 19, 66
  - cake - 10, 37, 45
  - zebra - 67...