Book Image

Neural Networks with Keras Cookbook

By : V Kishore Ayyadevara
Book Image

Neural Networks with Keras Cookbook

By: V Kishore Ayyadevara

Overview of this book

This book will take you from the basics of neural networks to advanced implementations of architectures using a recipe-based approach. We will learn about how neural networks work and the impact of various hyper parameters on a network's accuracy along with leveraging neural networks for structured and unstructured data. Later, we will learn how to classify and detect objects in images. We will also learn to use transfer learning for multiple applications, including a self-driving car using Convolutional Neural Networks. We will generate images while leveraging GANs and also by performing image encoding. Additionally, we will perform text analysis using word vector based techniques. Later, we will use Recurrent Neural Networks and LSTM to implement chatbot and Machine Translation systems. Finally, you will learn about transcribing images, audio, and generating captions and also use Deep Q-learning to build an agent that plays Space Invaders game. By the end of this book, you will have developed the skills to choose and customize multiple neural network architectures for various deep learning problems you might encounter.
Table of Contents (18 chapters)

Deep Q-learning to play Space Invaders game

In the previous section, we used Deep Q-learning to play the Cart-Pole game. In this section, we will leverage Deep Q-learning to play Space Invaders, which is a more complex environment than Cart-Pole.

A sample screenshot of the Space Invaders game looks as follows:

source: https://gym.openai.com/envs/SpaceInvaders-v0/

The objective of this exercise is to maximize the score obtained in a single game.

Getting ready

The strategy that we'll adopt to build an agent that is able to maximize the score is as follows:

  • Initialize the environment of the Space Invaders-Atari2600 game.
  • Preprocess the image frame:
    • Remove pixels that do not necessarily impact the action prediction
      • For...