Book Image

TensorFlow 1.x Deep Learning Cookbook

Book Image

TensorFlow 1.x Deep Learning Cookbook

Overview of this book

Deep neural networks (DNNs) have achieved a lot of success in the field of computer vision, speech recognition, and natural language processing. This exciting recipe-based guide will take you from the realm of DNN theory to implementing them practically to solve real-life problems in the artificial intelligence domain. In this book, you will learn how to efficiently use TensorFlow, Google’s open source framework for deep learning. You will implement different deep learning networks, such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Deep Q-learning Networks (DQNs), and Generative Adversarial Networks (GANs), with easy-to-follow standalone recipes. You will learn how to use TensorFlow with Keras as the backend. You will learn how different DNNs perform on some popularly used datasets, such as MNIST, CIFAR-10, and Youtube8m. You will not only learn about the different mobile and embedded platforms supported by TensorFlow, but also how to set up cloud platforms for deep learning applications. You will also get a sneak peek at TPU architecture and how it will affect the future of DNNs. By using crisp, no-nonsense recipes, you will become an expert in implementing deep learning techniques in growing real-world applications and research areas such as reinforcement learning, GANs, and autoencoders.

Related Content you might be interested in

Current Title:

Small book image
TensorFlow 1.x Deep Learning Cookbook
Dec, 2017 | 536 pages
Small book image
Deep Learning with TensorFlow 2 and Keras
Sujit Pal | Amita Kapoor | Antonio Gulli
Dec, 2019 | 646 pages
Small book image
Deep Learning with Keras
Sujit Pal | Antonio Gulli
Apr, 2017 | 318 pages
Small book image
Deep Learning with TensorFlow and Keras
Sujit Pal | Amita Kapoor | Antonio Gulli
Oct, 2022 | 698 pages
Table of Contents (15 chapters)
Preface
Preface
What this book covers
What you need for this book
Who this book is for
Sections
Conventions
Reader feedback
Customer support
Free Chapter
1
TensorFlow - An Introduction
TensorFlow - An Introduction
Introduction
Installing TensorFlow
Hello world in TensorFlow
Understanding the TensorFlow program structure
Working with constants, variables, and placeholders
Performing matrix manipulations using TensorFlow
Using a data flow graph
Migrating from 0.x to 1.x
Using XLA to enhance computational performance
Invoking CPU/GPU devices
TensorFlow for Deep Learning
Different Python packages required for DNN-based problems
2
Regression
Regression
Introduction
Choosing loss functions
Optimizers in TensorFlow
Reading from CSV files and preprocessing data
House price estimation-simple linear regression
House price estimation-multiple linear regression
Logistic regression on the MNIST dataset
3
Neural Networks - Perceptron
Neural Networks - Perceptron
Introduction
Activation functions
Single layer perceptron
Calculating gradients of backpropagation algorithm
MNIST classifier using MLP
Function approximation using MLP-predicting Boston house prices
Tuning hyperparameters
Higher-level APIs-Keras
See also
4
Convolutional Neural Networks
Convolutional Neural Networks
Introduction
Creating a ConvNet to classify handwritten MNIST numbers
Creating a ConvNet to classify CIFAR-10
Transferring style with VGG19 for image repainting
Using a pretrained VGG16 net for transfer learning
Creating a DeepDream network
5
Advanced Convolutional Neural Networks
Advanced Convolutional Neural Networks
Introduction
Creating a ConvNet for Sentiment Analysis
Inspecting what filters a VGG pre-built network has learned
Classifying images with VGGNet, ResNet, Inception, and Xception
Recycling pre-built Deep Learning models for extracting features
Very deep InceptionV3 Net used for Transfer Learning
Generating music with dilated ConvNets, WaveNet, and NSynth
Answering questions about images (Visual Q&A)
Classifying videos with pre-trained nets in six different ways
6
Recurrent Neural Networks
Recurrent Neural Networks
Introduction
Neural machine translation - training a seq2seq RNN
Neural machine translation - inference on a seq2seq RNN
All you need is attention - another example of a seq2seq RNN
Learning to write as Shakespeare with RNNs
Learning to predict future Bitcoin value with RNNs
Many-to-one and many-to-many RNN examples
7
Unsupervised Learning
Unsupervised Learning
Introduction
Principal component analysis
k-means clustering
Self-organizing maps
Restricted Boltzmann Machine
Recommender system using RBM
DBN for Emotion Detection
8
Autoencoders
Autoencoders
Introduction
Vanilla autoencoders
Sparse autoencoder
Denoising autoencoder
Convolutional autoencoders
Stacked autoencoder
9
Reinforcement Learning
Reinforcement Learning
Introduction
Learning OpenAI Gym
Implementing neural network agent to play Pac-Man
Q learning to balance Cart-Pole
Game of Atari using Deep Q Networks
Policy gradients to play the game of Pong
10
Mobile Computation
Mobile Computation
Introduction
Installing TensorFlow mobile for macOS and Android
Playing with TensorFlow and Android examples
Installing TensorFlow mobile for macOS and iPhone
Optimizing a TensorFlow graph for mobile devices
Profiling a TensorFlow graph for mobile devices
Transforming a TensorFlow graph for mobile devices
11
Generative Models and CapsNet
Generative Models and CapsNet
Introduction
Learning to forge MNIST images with simple GANs
Learning to forge MNIST images with DCGANs
Learning to forge Celebrity Faces and other datasets with DCGAN
Implementing Variational Autoencoders
Learning to beat the previous MNIST state-of-the-art results with Capsule Networks
12
Distributed TensorFlow and Cloud Deep Learning
Distributed TensorFlow and Cloud Deep Learning
Introduction
Working with TensorFlow and GPUs
Playing with Distributed TensorFlow: multiple GPUs and one CPU
Playing with Distributed TensorFlow: multiple servers
Training a Distributed TensorFlow MNIST classifier
Working with TensorFlow Serving and Docker
Running Distributed TensorFlow on Google Cloud (GCP) with Compute Engine
Running Distributed TensorFlow on Google CloudML
Running Distributed TensorFlow on Microsoft Azure
Running Distributed TensorFlow on Amazon AWS
13
Learning to Learn with AutoML (Meta-Learning)
Learning to Learn with AutoML (Meta-Learning)
Meta-learning with recurrent networks and with reinforcement learning
Meta-learning blocks
Meta-learning novel tasks
Siamese Network
14
TensorFlow Processing Units
TensorFlow Processing Units
Components of TPUs

Introduction

TensorFlow is a powerful open source software library developed by the Google Brain team for deep neural networks (DNNs). It was first made available under the Apache 2.x License in November 2015; as of today, its GitHub repository (https://github.com/tensorflow/tensorflow) has more than 17,000 commits, with roughly 845 contributors in just two years. This by itself is a measure of both the popularity and performance of TensorFlow. The following graph shows a comparison of the popular deep learning frameworks where it is clearly visible that TensorFlow is the leader among them:

The Figure is based on data taken from the Github repositories of each as on 12 July 2017. Each Bubble has a legend: (Framework, contributors).

Let's first learn what exactly TensorFlow is and why is it so popular among DNN researchers and engineers. TensorFlow, the open source deep learning library allows one to deploy deep neural networks computation on one or more CPU, GPUs in a server, desktop or mobile using the single TensorFlow API. You might ask, there are so many other deep learning libraries such as Torch, Theano, Caffe, and MxNet; what makes TensorFlow special? Most of other deep learning libraries like TensorFlow have auto-differentiation, many are open source, most support CPU/GPU options, have pretrained models, and support commonly used NN architectures like recurrent neural networks (RNNs), convolutional neural networks (CNNs), and deep belief networks (DBNs). So, what more is there in TensorFlow? Let's list them for you:

  • It works with all the cool languages. TensorFlow works with Python, C++, Java, R, and Go.
  • TensorFlow works on multiple platforms, even mobile and distributed.
  • It is supported by all cloud providers--AWS, Google, and Azure.
  • Keras, a high-level neural network API, has been integrated with TensorFlow.
  • It has better computational graph visualizations because it is native while the equivalent in Torch/Theano is not nearly as cool to look at.
  • TensorFlow allows model deployment and ease of use in production.
  • TensorFlow has very good community support.
  • TensorFlow is more than a software library; it is a suite of software that includes TensorFlow, TensorBoard, and TensorServing.

The Google research blog (https://research.googleblog.com/2016/11/celebrating-tensorflows-first-year.html) lists some of the fascinating projects done by people around the world using TensorFlow:

  • Google Translate is using TensorFlow and tensor processing units (TPUs)
  • Project Magenta, which can produce melodies using reinforcement learning-based models, employs TensorFlow
  • Australian marine biologists are using TensorFlow to find and understand sea-cows, which are on the verge of extinction
  • A Japanese farmer used TensorFlow to develop an application to sort cucumbers using physical parameters like size and shape

The list is long, and the possibilities in which one can use TensorFlow are even greater. This book aims to provide you with an understanding of TensorFlow as applied to deep learning models such that you can adapt them to your dataset with ease and develop useful applications. Each chapter contains a set of recipes which deal with the technical issues, the dependencies, the actual code, and its understanding. We have built the recipes one on another such that, by the end of each chapter, you have a fully functional deep learning model.

Previous Section
End of Section 2
Next Section