Book Image

AI Crash Course

By : Hadelin de Ponteves
5 (4)
Book Image

AI Crash Course

5 (4)
By: Hadelin de Ponteves

Overview of this book

Welcome to the Robot World … and start building intelligent software now! Through his best-selling video courses, Hadelin de Ponteves has taught hundreds of thousands of people to write AI software. Now, for the first time, his hands-on, energetic approach is available as a book. Starting with the basics before easing you into more complicated formulas and notation, AI Crash Course gives you everything you need to build AI systems with reinforcement learning and deep learning. Five full working projects put the ideas into action, showing step-by-step how to build intelligent software using the best and easiest tools for AI programming, including Python, TensorFlow, Keras, and PyTorch. AI Crash Course teaches everyone to build an AI to work in their applications. Once you've read this book, you're only limited by your imagination.
Table of Contents (17 chapters)
16
Index

Summary

In this chapter, you learned the five fundamental principles of Artificial Intelligence from a Reinforcement Learning perspective. Firstly, an AI is a system that takes an observation (values, images, or any data) as input, and returns an action to perform as output (principle #1). Then, there is a reward system that helps it measure its performance. The AI will learn through trial and error based on the reward it gets over time (principle #2). The input (state), the output (action), and the reward system define the AI environment (principle #3). The AI interacts with this environment through the Markov decision process (principle #4). Finally, in training mode, the AI learns how to maximize its total reward by updating its parameters through the iterations, and in inference mode, the AI simply performs its actions over full episodes without updating any of its parameters – that is to say, without learning (principle #5).

In the next chapter, you will...