Book Image

Data Forecasting and Segmentation Using Microsoft Excel

By : Fernando Roque

Book Image

Data Forecasting and Segmentation Using Microsoft Excel

By: Fernando Roque

Overview of this book

Data Forecasting and Segmentation Using Microsoft Excel guides you through basic statistics to test whether your data can be used to perform regression predictions and time series forecasts. The exercises covered in this book use real-life data from Kaggle, such as demand for seasonal air tickets and credit card fraud detection. You’ll learn how to apply the grouping K-means algorithm, which helps you find segments of your data that are impossible to see with other analyses, such as business intelligence (BI) and pivot analysis. By analyzing groups returned by K-means, you’ll be able to detect outliers that could indicate possible fraud or a bad function in network packets. By the end of this Microsoft Excel book, you’ll be able to use the classification algorithm to group data with different variables. You’ll also be able to train linear and time series models to perform predictions and forecasts based on past data.

Preface

Who this book is for

What this book covers

To get the most out of this book

Download the example code files

Download the color images

Conventions used

Share Your Thoughts

Part 1 – An Introduction to Machine Learning Functions

Part 1 – An Introduction to Machine Learning Functions

Free Chapter

Chapter 1: Understanding Data Segmentation

Chapter 1: Understanding Data Segmentation

Segmenting data concepts

Grouping data in segments of two and three variables

Further reading

Chapter 2: Applying Linear Regression

Chapter 2: Applying Linear Regression

Understanding the influence of variables in linear regression

Projecting values from predictor variables

Further reading

Chapter 3: What is Time Series?

Chapter 3: What is Time Series?

Technical requirements

Understanding time series data

Designing the time series data model

Doing the forecast

Further reading

Part 2 – Grouping Data to Find Segments and Outliers

Part 2 – Grouping Data to Find Segments and Outliers

Chapter 4: Introduction to Data Grouping

Chapter 4: Introduction to Data Grouping

Technical requirements

Grouping with the K-means machine learning function

Finding groups of multiple variables

Understanding outliers

Further reading

Chapter 5: Finding the Optimal Number of Single Variable Groups

Chapter 5: Finding the Optimal Number of Single Variable Groups

Technical requirements

Finding an optimal number of groups for one variable

Running the K-means function to get the centroids or group average

Finding the groups and centroids of one-variable data with K-means and Excel

Further reading

Chapter 6: Finding the Optimal Number of Multi-Variable Groups

Chapter 6: Finding the Optimal Number of Multi-Variable Groups

Technical requirements

Calculating the optimal number of groups for two and three variables

Determining the groups and average value (centroids) of two and three variables

Using the Elbow and K-means functions with four variables

Questions and answers

Further reading

Chapter 7: Analyzing Outliers for Data Anomalies

Chapter 7: Analyzing Outliers for Data Anomalies

Technical requirements

Representing the data in a 3D chart

K-means data grouping

Pivot analysis of the outliers

Further reading

Part 3 – Simple and Multiple Linear Regression Analysis

Part 3 – Simple and Multiple Linear Regression Analysis

Chapter 8: Finding the Relationship between Variables

Chapter 8: Finding the Relationship between Variables

Technical requirements

Charting the predictive model's regression variables

Calculating the linear model confidence percentage

Statistical significance of the slope

The regression model's value ranges

Further reading

Chapter 9: Building, Training, and Validating a Linear Model

Chapter 9: Building, Training, and Validating a Linear Model

Technical requirements

Calculating the intercept and slope with formulas

Computing coefficient significance – t-statistics and p-value

Getting the residual standard error

Calculating the r-squared

Calculating the f-statistics

Training and testing the model

Doing prediction scenarios with the regression model

Chapter 10: Building, Training, and Validating a Multiple Regression Model

Chapter 10: Building, Training, and Validating a Multiple Regression Model

Technical requirements

Exploring the variables with more influence

Calculating t-statistics and p-values

Calculating residuals standard error and f-statistics

Training and testing the model

Further reading

Part 4 – Predicting Values with Time Series

Part 4 – Predicting Values with Time Series

Chapter 11: Testing Data for Time Series Compliance

Chapter 11: Testing Data for Time Series Compliance

Technical requirements

Visualizing seasonal trends

Researching autocorrelation – past values' influence over present values

Performing the Durbin-Watson autocorrelation test

Questions and answers

Further reading

Chapter 12: Working with Time Series Using the Centered Moving Average and a Trending Component

Chapter 12: Working with Time Series Using the Centered Moving Average and a Trending Component

Technical requirements

Calculating the CMA

Producing the forecast – season and trend line

Further reading

Chapter 13: Training, Validating, and Running the Model

Chapter 13: Training, Validating, and Running the Model

Technical requirements

Training the model

Building and training the forecast model

Testing the forecast model

Doing the forecast

Other Books You May Enjoy

Other Books You May Enjoy

Packt is searching for authors like you

Share Your Thoughts

Customer Reviews

5 star

0

4 star

0

3 star

0

2 star

0

1 star

0

K-means data grouping

Before running the K-means function, we need to calculate the parameter of the optimal number of groups. In the last section, we saw that the first approach is to visualize the 2D and 3D charts. However, the best way to get the number of groups is by calculating the elbow function and choosing the number of groups when the curve of the elbow starts to flatten.

Running the elbow algorithm

Now that we have an idea of the number of groups for the credit card fraud dataset, we are ready to use the elbow K-means algorithm to get a statistical value of the optimal number of groups.

Kaggle credit card fraud dataset

Before we run the K-means function, we have to calculate the optimal number of groups for the V1, Time (seconds), and Amount fields of the credit card transactions.

We run the elbow algorithm, changing the range of data in line 3 of the kmeanselbow.r add-in, as you can see in Figure 7.4. Use the credicard01.xlsx file included in this chapter...