Book Image

Hands-On Deep Learning with Apache Spark

By : Guglielmo Iozzia
Book Image

Hands-On Deep Learning with Apache Spark

By: Guglielmo Iozzia

Overview of this book

Deep learning is a subset of machine learning where datasets with several layers of complexity can be processed. Hands-On Deep Learning with Apache Spark addresses the sheer complexity of technical and analytical parts and the speed at which deep learning solutions can be implemented on Apache Spark. The book starts with the fundamentals of Apache Spark and deep learning. You will set up Spark for deep learning, learn principles of distributed modeling, and understand different types of neural nets. You will then implement deep learning models, such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), and long short-term memory (LSTM) on Spark. As you progress through the book, you will gain hands-on experience of what it takes to understand the complex datasets you are dealing with. During the course of this book, you will use popular deep learning frameworks, such as TensorFlow, Deeplearning4j, and Keras to train your distributed models. By the end of this book, you'll have gained experience with the implementation of your models on a variety of use cases.

Related Content you might be interested in

Current Title:

Small book image
Hands-On Deep Learning with Apache Spark
Guglielmo Iozzia
Jan, 2019 | 322 pages
Small book image
Java Deep Learning Cookbook
Rahul Raj
Nov, 2019 | 304 pages
Small book image
Deep Learning with Hadoop
Dipayan Dev
Feb, 2017 | 206 pages
Small book image
Java Deep Learning Projects
Md Rezaul Karim
Jun, 2018 | 436 pages
Table of Contents (19 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
The Apache Spark Ecosystem
The Apache Spark Ecosystem
Apache Spark fundamentals
Getting Spark
RDD programming
Spark SQL, Datasets, and DataFrames
Spark Streaming
Cluster mode using different managers
Summary
2
Deep Learning Basics
Deep Learning Basics
Introducing DL
DNNs overview
Practical applications of DL
Summary
3
Extract, Transform, Load
Extract, Transform, Load
Training data ingestion through Spark
Training data ingestion from a database with Spark
Data ingestion from S3
Raw data transformation with Spark
Summary
4
Streaming
Streaming
Streaming data with Apache Spark
Streaming data with Kafka and Spark
Streaming data with DL4J and Spark
Summary
5
Convolutional Neural Networks
Convolutional Neural Networks
Convolutional layers
Pooling layers
Fully connected layers
Weights
GoogleNet Inception V3 model
Hands-on CNN with Spark
Summary
6
Recurrent Neural Networks
Recurrent Neural Networks
LSTM
Use cases
Hands-on RNNs with Spark
Summary
7
Training Neural Networks with Spark
Training Neural Networks with Spark
Distributed network training with Spark and DeepLearning4j
Hyperparameter optimization
Summary
8
Monitoring and Debugging Neural Network Training
Monitoring and Debugging Neural Network Training
Monitoring and debugging neural networks during their training phases
Summary
9
Interpreting Neural Network Output
Interpreting Neural Network Output
Evaluation techniques with DL4J
Other types of evaluation
Summary
10
Deploying on a Distributed System
Deploying on a Distributed System
Setup of a distributed environment with DeepLearning4j
Spark distributed training architecture details
Importing Python models into the JVM with DL4J
Alternatives to DL4J for the Scala programming language
Summary
11
NLP Basics
NLP Basics
NLP
Hands-on NLP with Spark
Summary
12
Textual Analysis and Deep Learning
Textual Analysis and Deep Learning
Hands-on NLP with DL4J
Hands-on NLP with TensorFlow
Hand-on NLP with Keras and a TensorFlow backend
Hands-on NLP with Keras model import into DL4J
Summary
13
Convolution
Convolution
Convolution
Object recognition strategies
Convolution applied to image recognition
Summary
14
Image Classification
Image Classification
Implementing an end-to-end image classification web application
Summary
15
What's Next for Deep Learning?
What's Next for Deep Learning?
What to expect next for deep learning and AI
Topics to watch for
Is Spark ready for RL?
DeepLearning4J future support for GANs
Summary
16
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think
Appendix A: Functional Programming in Scala
Appendix A: Functional Programming in Scala
Functional programming (FP)
Appendix B: Image Data Preparation for Spark
Appendix B: Image Data Preparation for Spark
Image preprocessing

Hand-on NLP with Keras and a TensorFlow backend

As mentioned in Chapter 10, Deploying on a Distributed System, in the Importing Python Models in the JVM with DL4J section, when doing DL in Python, an alternative to TensorFlow is Keras. It can be used as a high-level API on top of a TensorFlow backed. In this section, we are going to learn how to do sentiment analysis in Keras, and finally we will make a comparison between this implementation and the previous one in TensorFlow.

We are going to use the exact same IMDB dataset (25,000 samples for training and 25,000 for test) as for the previous implementations through DL4J and TensorFlow. The prerequisites for this example are the same as for the TensorFlow example (Python 2.7.x, the PIP package manager, and Tensorflow), plus of course Keras. The Keras code module has that dataset built in:

from keras.datasets import imdb

So, we...

Previous Section
End of Section 4
Next Section