Book Image

Deep Learning from the Basics

By : Koki Saitoh
5 (1)
Book Image

Deep Learning from the Basics

5 (1)
By: Koki Saitoh

Overview of this book

Deep learning is rapidly becoming the most preferred way of solving data problems. This is thanks, in part, to its huge variety of mathematical algorithms and their ability to find patterns that are otherwise invisible to us. Deep Learning from the Basics begins with a fast-paced introduction to deep learning with Python, its definition, characteristics, and applications. You’ll learn how to use the Python interpreter and the script files in your applications, and utilize NumPy and Matplotlib in your deep learning models. As you progress through the book, you’ll discover backpropagation—an efficient way to calculate the gradients of weight parameters—and study multilayer perceptrons and their limitations, before, finally, implementing a three-layer neural network and calculating multidimensional arrays. By the end of the book, you’ll have the knowledge to apply the relevant technologies in deep learning.
Table of Contents (11 chapters)

Summary

In this chapter, we covered perceptrons. The perceptron is a very simple algorithm, so you should be able to understand how it works quickly. The perceptron is the basis of a neural network, which we will learn about in the next chapter. These points may be summed up in the following list:

  • A perceptron is an algorithm with inputs and outputs. When it receives a certain input, it outputs a fixed value.
  • A perceptron has "weight" and "bias" parameters.
  • You can use perceptrons to represent logic circuits such as AND and OR gates.
  • An XOR gate cannot be represented with a single-layer perceptron.
  • A two-layer perceptron can be used to represent an XOR gate.
  • A single-layer perceptron can only represent linear areas, while a multilayer perceptron can represent nonlinear areas.
  • Multilayer perceptrons can represent a computer (theoretically).