Book Image

AI Crash Course

By : Hadelin de Ponteves
5 (2)
Book Image

AI Crash Course

5 (2)
By: Hadelin de Ponteves

Overview of this book

Welcome to the Robot World … and start building intelligent software now! Through his best-selling video courses, Hadelin de Ponteves has taught hundreds of thousands of people to write AI software. Now, for the first time, his hands-on, energetic approach is available as a book. Starting with the basics before easing you into more complicated formulas and notation, AI Crash Course gives you everything you need to build AI systems with reinforcement learning and deep learning. Five full working projects put the ideas into action, showing step-by-step how to build intelligent software using the best and easiest tools for AI programming, including Python, TensorFlow, Keras, and PyTorch. AI Crash Course teaches everyone to build an AI to work in their applications. Once you've read this book, you're only limited by your imagination.
Table of Contents (17 chapters)
16
Index

Deep Q-learning

You've toured the foundations of deep learning, and you already know Q-learning; since deep Q-learning consists of combining Q-learning and deep learning, you're ready to get an intuitive grasp of deep Q-learning and crush it.

Before we start, try to guess some of how this is going to work. I would like you to take a moment and think about how you could integrate Q-learning into an ANN.

First things first, you might have guessed what the inputs and outputs of the neural network are going to be. The input of the artificial neural network is of course going to be the input state, which could be a 1-dimensional vector encoding what is happening in the environment, or an image (like the ones seen by a self-driving car). And the output is going to be the set of Q-values for each action, meaning it is going to be a 1-dimensional vector of several Q-values, one for each action that can be performed. Then, just like before, the AI takes the action...