Machine Learning with Swift

Machine Learning with Swift

By : Jojo Moolayil, Alexander Sosnovshchenko, Oleksandr Baiev

Buy this Book

Machine Learning with Swift

By: Jojo Moolayil, Alexander Sosnovshchenko, Oleksandr Baiev

Buy this Book

Overview of this book

Machine learning as a field promises to bring increased intelligence to the software by helping us learn and analyse information efficiently and discover certain patterns that humans cannot. This book will be your guide as you embark on an exciting journey in machine learning using the popular Swift language. We’ll start with machine learning basics in the first part of the book to develop a lasting intuition about fundamental machine learning concepts. We explore various supervised and unsupervised statistical learning techniques and how to implement them in Swift, while the third section walks you through deep learning techniques with the help of typical real-world cases. In the last section, we will dive into some hard core topics such as model compression, GPU acceleration and provide some recommendations to avoid common mistakes during machine learning application development. By the end of the book, you'll be able to develop intelligent applications written in Swift that can learn for themselves.

Title Page

Packt Upsell

Contributors

Preface

Free Chapter

Getting Started with Machine Learning

What is AI?

The motivation behind ML

What is ML ?

Applications of ML

Using ML to build smarter iOS applications

Getting to know your data

Choosing a model

Summary

Bibliography

Classification – Decision Tree Learning

Machine learning toolbox

Prototyping the first machine learning app

IPython notebook crash course

Time to practice

Machine learning for extra-terrestrial life explorers

Loading the dataset

Exploratory data analysis

Data preprocessing

Decision trees everywhere

Training the decision tree classifier

How decision tree learning works

Implementing first machine learning app in Swift

Introducing Core ML

Summary

K-Nearest Neighbors Classifier

Calculating the distance

Using instance-based models for classification and clustering

People motion recognition using inertial sensors

Understanding the KNN algorithm

Recognizing human motion using KNN

Reasoning in high-dimensional spaces

KNN pros

KNN cons

Improving our solution

Summary

Bibliography

K-Means Clustering

Unsupervised learning

K-means clustering

Implementing k-means in Swift

Clustering objects on a map

Choosing the number of clusters

K-means clustering – problems

K-means++

Image segmentation using k-means

Summary

Association Rule Learning

Seeing association rules

Defining data structures

Using association measures to assess rules

Decomposing the problem

Generating all possible rules

Finding frequent item sets

The Apriori algorithm

Implementing Apriori in Swift

Running Apriori

Running Apriori on real-world data

The pros and cons of Apriori

Building an adaptable user experience

Summary

Bibliography

Linear Regression and Gradient Descent

Understanding the regression task

Introducing simple linear regression

Feature scaling

Feature standardization

Implementing multiple linear regression in Swift

Fixing linear regression problems with regularization

Summary

Bibliography

Linear Classifier and Logistic Regression

Revisiting the classification task

Implementing logistic regression in Swift

Predicting user intents

Choosing the regression model for your problem

Bias-variance trade-off

Summary

Neural Networks

What are artificial NNs anyway?

Building the neuron

Building the network

Building a neural layer in Swift

Using neurons to build logical functions

Implementing layers in Swift

Training the network

Basic neural network subroutines (BNNS)

Summary

Convolutional Neural Networks

Understanding users emotions

Introducing computer vision problems

Introducing convolutional neural networks

Pooling operation

Convolution operation

Building the network

Loss functions

Training the network

Training the CNN for facial expression recognition

Environment setup

Deep learning frameworks

Plotting the network structure

Training the network

Plotting loss

Making predictions

Saving the model in HDF5 format

Converting to Core ML format

Visualizing convolution filters

Deploying CNN to iOS

Summary

Bibliography

Natural Language Processing

NLP in the mobile development world

Word Association game

Python NLP libraries

Textual corpuses

Common NLP approaches and subtasks

Distributional semantics hypothesis

Word vector representations

Autoencoder neural networks

Word2Vec

Word2Vec in Gensim

Vector space properties

iOS application

Word2Vec friends and relatives

Where to go from here?

Summary

Machine Learning Libraries

Machine learning and AI APIs

Libraries

General-purpose machine learning libraries

Inference-only libraries

NLP libraries

Speech recognition

Computer vision

Low-level subroutine libraries

Choosing a deep learning framework

Summary

Optimizing Neural Networks for Mobile Devices

Delivering perfect user experience

Calculating the size of a convolutional neural network

Lossless compression

Compact CNN architectures

Preventing a neural network from growing big

Lossy compression

An example of the network compression

Summary

Bibliography

Best Practices

Mobile machine learning project life cycle

Best practices

Machine learning gremlins

Recommended learning resources

Summary

Index

Customer Reviews

5 star

4 star

3 star

2 star

1 star

Calculating the size of a convolutional neural network

Let's take some well-known CNN, say VGG16, and see in detail how exactly the memory is being spent. You can print the summary of it using Keras:

from keras.applications import VGG16
model = VGG16()
print(model.summary())

The network consists of 13 2D-convolutional layers (with 3×3 filters, stride 1 and pad 1) and 3 fully connected layers ("Dense"). Plus, there are an input layer, 5 max-pooling layers and a flatten layer, which do not hold parameters.

Layer	Output shape	Data memory	Parameters	Number of parameters
InputLayer	224×224×3	150528	0	0
Conv2D	224×224×64	3211264	3×3×3×64+64	1792
Conv2D	224×224×64	3211264	3×3×64×64+64	36928
MaxPool2D	112×112×64	802816	0	0
Conv2D	112×112×128	1605632	3×3×64×128+128	73856
Conv2D	112×112×128	1605632	3×3×128×128+128	147584
MaxPool2D	56×56×128	401408	0	0
Conv2D	56×56×256	802816	3×3×128×256+256	295168
Conv2D	56×56×256	802816	3×3×256×256+256	590080
Conv2D	56×56×256	802816	3×3×256×256+256	590080
MaxPool2D	28×28×256	200704	0	0
Conv2D	28×28×512	401408	3×3×256×512+512	1180160...

Machine Learning with Swift

By : Jojo Moolayil, Alexander Sosnovshchenko, Oleksandr Baiev

Machine Learning with Swift

By: Jojo Moolayil, Alexander Sosnovshchenko, Oleksandr Baiev

Overview of this book

Related Content you might be interested in

Current Title:

Machine Learning with Swift

Machine Learning with Core ML

Deep Learning with PyTorch Quick Start Guide

Machine Learning for Mobile

Calculating the size of a convolutional neural network