Book Image

Applied Unsupervised Learning with R

By : Alok Malik, Bradford Tuckfield
Book Image

Applied Unsupervised Learning with R

By: Alok Malik, Bradford Tuckfield

Overview of this book

Starting with the basics, Applied Unsupervised Learning with R explains clustering methods, distribution analysis, data encoders, and features of R that enable you to understand your data better and get answers to your most pressing business questions. This book begins with the most important and commonly used method for unsupervised learning - clustering - and explains the three main clustering algorithms - k-means, divisive, and agglomerative. Following this, you'll study market basket analysis, kernel density estimation, principal component analysis, and anomaly detection. You'll be introduced to these methods using code written in R, with further instructions on how to work with, edit, and improve R code. To help you gain a practical understanding, the book also features useful tips on applying these methods to real business problems, including market segmentation and fraud detection. By working through interesting activities, you'll explore data encoders and latent variable models. By the end of this book, you will have a better understanding of different anomaly detection methods, such as outlier detection, Mahalanobis distances, and contextual and collective anomaly detection.

Related Content you might be interested in

Current Title:

Small book image
Applied Unsupervised Learning with R
Alok Malik | Bradford Tuckfield
Mar, 2019 | 320 pages
Small book image
Applied Unsupervised Learning with Python
Christopher Kruger | Aaron Jones | Benjamin Johnston
May, 2019 | 482 pages
Small book image
The Unsupervised Learning Workshop
Christopher Kruger | Aaron Jones | Benjamin Johnston
Jul, 2020 | 550 pages
Small book image
Machine Learning with R Cookbook
YuWei Chiu David Chiu | AshishSingh Bhatia
Oct, 2017 | 572 pages
Table of Contents (9 chapters)
Applied Unsupervised Learning with R
Applied Unsupervised Learning with R
Preface
Preface
Free Chapter
1
Introduction to Clustering Methods
Introduction to Clustering Methods
Introduction
Introduction to Clustering
Introduction to the Iris Dataset
Introduction to k-means Clustering
Introduction to k-means Clustering with Built-In Functions
Introduction to Market Segmentation
Introduction to k-medoids Clustering
Summary
2
Advanced Clustering Methods
Advanced Clustering Methods
Introduction
Introduction to k-modes Clustering
Introduction to Density-Based Clustering (DBSCAN)
Summary
3
Probability Distributions
Probability Distributions
Introduction
Basic Terminology of Probability Distributions
Introduction to Kernel Density Estimation
Introduction to the Kolmogorov-Smirnov Test
Summary
4
Dimension Reduction
Dimension Reduction
Introduction
Market Basket Analysis
Summary
5
Data Comparison Methods
Data Comparison Methods
Introduction
Analytic Signatures
Comparison of Signatures
Latent Variable Models – Factor Analysis
Summary
6
Anomaly Detection
Anomaly Detection
Introduction
Univariate Outlier Detection
Kernel Density
Summary
Appendix
Appendix
Chapter 1: Introduction to Clustering Methods
Chapter 2: Advanced Clustering Methods
Chapter 3: Probability Distributions
Chapter 4: Dimension Reduction
Chapter 5: Data Comparison Methods
Chapter 6: Anomaly Detection

Introduction to the Kolmogorov-Smirnov Test

Now that we’ve learned how to generate the probability density functions of datasets that don't closely resemble standard distributions, we’ll learn how to perform some tests to distinguish these nonstandard distributions from each other.

Sometimes, we're given multiple observed samples of data and we want to find out whether those samples belong to the same distribution or not. In the case of standard distributions, we have multiple tests, such as Student's t-test and z-test, to determine this. For non-standard distributions, or where we don't know the type of distribution, we use the Kolmogorov-Smirnov test. To understand the Kolmogorov-Smirnov test, you first need to understand a few terms:

  • Cumulative Distribution Function (CDF): This is a function whose value gives the probability of a random variable being less than or equal to the argument of the function.

  • Null Hypothesis: In hypothesis testing, a null hypothesis means there is no significant...

Previous Section
End of Section 5
Next Section