Book Image

Hands-On Exploratory Data Analysis with R

By : Radhika Datar, Harish Garg
Book Image

Hands-On Exploratory Data Analysis with R

By: Radhika Datar, Harish Garg

Overview of this book

Hands-On Exploratory Data Analysis with R will help you build a strong foundation in data analysis and get well-versed with elementary ways to analyze data. You will learn how to understand your data and summarize its characteristics. You'll also study the structure of your data, and you'll explore graphical and numerical techniques using the R language. This book covers the entire exploratory data analysis (EDA) process—data collection, generating statistics, distribution, and invalidating the hypothesis. As you progress through the book, you will set up a data analysis environment with tools such as ggplot2, knitr, and R Markdown, using DOE Scatter Plot and SML2010 for multifactor, optimization, and regression data problems. By the end of this book, you will be able to successfully carry out a preliminary investigation on any dataset, uncover hidden insights, and present your results in a business context.
Table of Contents (17 chapters)
Free Chapter
1
Section 1: Setting Up Data Analysis Environment
7
Section 2: Univariate, Time Series, and Multivariate Data
11
Section 3: Multifactor, Optimization, and Regression Data Problems
14
Section 4: Conclusions

Tietjen-Moore test

The Tietjen-Moore test algorithm is a generalization of the Grubbs' test algorithm, which is basically used for univariate datasets. The following algorithm depicts the detection of the multiple outliers in a univariate dataset by applying the Tietjen-Moore test algorithm. The following are the parameters used:

  • Input parameter: Input data, including outliers
  • Output parameters: Original data with outliers marked

The workflow is shown as follows:

The step-wise approach will help us to create the function in the desired way. We will carry out the following steps to implement the detection of outliers in R for the bank dataset:

  1. Create a function that assists in generating the outliers in R:
> TietjenMoore <- function(dataSeries,k)
+ {
+ n = length(dataSeries)
+ ## Compute the absolute residuals.
+ r = abs(dataSeries - mean(dataSeries))
+ ## Sort data...