Book Image

Machine Learning Solutions

Book Image

Machine Learning Solutions

Overview of this book

Machine learning (ML) helps you find hidden insights from your data without the need for explicit programming. This book is your key to solving any kind of ML problem you might come across in your job. You’ll encounter a set of simple to complex problems while building ML models, and you'll not only resolve these problems, but you’ll also learn how to build projects based on each problem, with a practical approach and easy-to-follow examples. The book includes a wide range of applications: from analytics and NLP, to computer vision domains. Some of the applications you will be working on include stock price prediction, a recommendation engine, building a chat-bot, a facial expression recognition system, and many more. The problem examples we cover include identifying the right algorithm for your dataset and use cases, creating and labeling datasets, getting enough clean data to carry out processing, identifying outliers, overftting datasets, hyperparameter tuning, and more. Here, you'll also learn to make more timely and accurate predictions. In addition, you'll deal with more advanced use cases, such as building a gaming bot, building an extractive summarization tool for medical documents, and you'll also tackle the problems faced while building an ML model. By the end of this book, you'll be able to fine-tune your models as per your needs to deliver maximum productivity.
Table of Contents (19 chapters)
Machine Learning Solutions
Foreword
Contributors
Preface
Index

Building the Pong gaming bot


In this section, we will be looking at how we can build a gaming bot that can learn the game of Pong. Before we start, we will look at the approach and concepts that we will be using for building the Pong gaming bot.

Understanding the key concepts

In this section, we will be covering some aspects of building the Pong game bot, which are as follows:

  • Architecture of the gaming bot

  • Approach for the gaming bot

Architecture of the gaming bot

In order to develop the Pong gaming bot, we are choosing a neural-network-based approach. The architecture of our neural network is crucial. Let's look at the architectural components step by step:

  1. We take the gaming screen as the input and preprocess it as per the DQN algorithm.

  2. We pass this preprocessed screen to an neural network (NN.)

  3. We use a gradient descent to update the weights of the NN.

  4. Weight [1]: This matrix holds the weights of pixels passing into the hidden layer. The dimension will be [200 x 80 x 80] – [200 x 6400].

  5. Weight...