Book Image

Applied Unsupervised Learning with Python

By : Benjamin Johnston, Aaron Jones, Christopher Kruger
Book Image

Applied Unsupervised Learning with Python

By: Benjamin Johnston, Aaron Jones, Christopher Kruger

Overview of this book

Unsupervised learning is a useful and practical solution in situations where labeled data is not available. Applied Unsupervised Learning with Python guides you in learning the best practices for using unsupervised learning techniques in tandem with Python libraries and extracting meaningful information from unstructured data. The book begins by explaining how basic clustering works to find similar data points in a set. Once you are well-versed with the k-means algorithm and how it operates, you’ll learn what dimensionality reduction is and where to apply it. As you progress, you’ll learn various neural network techniques and how they can improve your model. While studying the applications of unsupervised learning, you will also understand how to mine topics that are trending on Twitter and Facebook and build a news recommendation engine for users. Finally, you will be able to put your knowledge to work through interesting activities such as performing a Market Basket Analysis and identifying relationships between different products. By the end of this book, you will have the skills you need to confidently build your own models using Python.

Related Content you might be interested in

Current Title:

Small book image
Applied Unsupervised Learning with Python
Benjamin Johnston | Aaron Jones | Christopher Kruger
May, 2019 | 482 pages
Small book image
Applied Unsupervised Learning with R
Bradford Tuckfield | Alok Malik
Mar, 2019 | 320 pages
Small book image
Hands-On Unsupervised Learning with Python
Giuseppe Bonaccorso
Feb, 2019 | 386 pages
Small book image
Data Science with Python
Mohamed Noordeen Alaudeen | Aaron England | Rohan Chopra
Jul, 2019 | 426 pages
Table of Contents (12 chapters)
Applied Unsupervised Learning with Python
Applied Unsupervised Learning with Python
Preface
Preface
Free Chapter
1
Introduction to Clustering
Introduction to Clustering
Introduction
Unsupervised Learning versus Supervised Learning
Clustering
Introduction to k-means Clustering
Activity 1: Implementing k-means Clustering
Summary
2
Hierarchical Clustering
Hierarchical Clustering
Introduction
Clustering Refresher
The Organization of Hierarchy
Introduction to Hierarchical Clustering
Linkage
Agglomerative versus Divisive Clustering
k-means versus Hierarchical Clustering
Summary
3
Neighborhood Approaches and DBSCAN
Neighborhood Approaches and DBSCAN
Introduction
Introduction to DBSCAN
DBSCAN Versus k-means and Hierarchical Clustering
Summary
4
Dimension Reduction and PCA
Dimension Reduction and PCA
Introduction
Overview of Dimensionality Reduction Techniques
PCA
Summary
5
Autoencoders
Autoencoders
Introduction
Fundamentals of Artificial Neural Networks
Autoencoders
Summary
6
t-Distributed Stochastic Neighbor Embedding (t-SNE)
t-Distributed Stochastic Neighbor Embedding (t-SNE)
Introduction
Stochastic Neighbor Embedding (SNE)
t-Distributed SNE
Interpreting t-SNE Plots
Summary
7
Topic Modeling
Topic Modeling
Introduction
Cleaning Text Data
Latent Dirichlet Allocation
Non-Negative Matrix Factorization
Summary
8
Market Basket Analysis
Market Basket Analysis
Introduction
Market Basket Analysis
Characteristics of Transaction Data
Apriori Algorithm
Association Rules
Summary
9
Hotspot Analysis
Hotspot Analysis
Introduction
Kernel Density Estimation
Hotspot Analysis
Summary
Appendix
Appendix
Chapter 1: Introduction to Clustering
Chapter 2: Hierarchical Clustering
Chapter 3: Neighborhood Approaches and DBSCAN
Chapter 4: Dimension Reduction and PCA
Chapter 5: Autoencoders
Chapter 6: t-Distributed Stochastic Neighbor Embedding (t-SNE)
Chapter 7: Topic Modeling
Chapter 8: Market Basket Analysis
Chapter 9: Hotspot Analysis

Latent Dirichlet Allocation

In 2003, David Biel, Andrew Ng, and Michael Jordan published their article on the topic modeling algorithm known as Latent Dirichlet Allocation (LDA). LDA is a generative probabilistic model. This means that we assume the process, which is articulated in terms of probabilities, by which the data was generated is known and then work backward from the data to the parameters that generated it. In this case, it is the topics that generated the data that are of interest. The process discussed here is the most basic form of LDA, but for learning, it is also the most comprehensible.

For each document in the corpus, the assumed generative process is:

  1. Select , where is the number of words.

  2. Select , where is the distribution of topics.

  3. For each of the words , select topic , and select word from .

Let's go through the generative process in a bit more detail. The preceding three steps repeat for every document in the corpus. The initial step is to choose the number of words...

Previous Section
End of Section 4
Next Section