Book Image

AI Crash Course

By : Hadelin de Ponteves
5 (2)
Book Image

AI Crash Course

5 (2)
By: Hadelin de Ponteves

Overview of this book

Welcome to the Robot World … and start building intelligent software now! Through his best-selling video courses, Hadelin de Ponteves has taught hundreds of thousands of people to write AI software. Now, for the first time, his hands-on, energetic approach is available as a book. Starting with the basics before easing you into more complicated formulas and notation, AI Crash Course gives you everything you need to build AI systems with reinforcement learning and deep learning. Five full working projects put the ideas into action, showing step-by-step how to build intelligent software using the best and easiest tools for AI programming, including Python, TensorFlow, Keras, and PyTorch. AI Crash Course teaches everyone to build an AI to work in their applications. Once you've read this book, you're only limited by your imagination.
Table of Contents (17 chapters)
16
Index

Welcome to Q-Learning

Ladies and gentlemen, things are about to get even more interesting than before. The next model we are about to tackle is at the heart of many AIs built today; robots, autonomous vehicles, and even AI players of video games. They all use Q-learning at the core of their model. Some of them even combine Q-learning with deep learning, making a highly advanced version of Q-learning called deep Q-learning, which we will cover in Chapter 9, Going Pro with Artificial Brains – Deep Q-Learning.

All of the AI fundamentals still apply to Q-learning, as follows:

  1. Q-learning is a Reinforcement Learning model.
  2. Q-learning works on the inputs (states) and outputs (actions) principle.
  3. Q-learning works on a predefined environment, including the states (the inputs), the actions (the outputs), and the rewards.
  4. Q-learning is modeled by a Markov decision process.
  5. Q-learning uses a training mode, during which the parameters that are learned...