Book Image

Applied Supervised Learning with R

By : Karthik Ramasubramanian, Jojo Moolayil
Book Image

Applied Supervised Learning with R

By: Karthik Ramasubramanian, Jojo Moolayil

Overview of this book

R provides excellent visualization features that are essential for exploring data before using it in automated learning. Applied Supervised Learning with R helps you cover the complete process of employing R to develop applications using supervised machine learning algorithms for your business needs. The book starts by helping you develop your analytical thinking to create a problem statement using business inputs and domain research. You will then learn different evaluation metrics that compare various algorithms, and later progress to using these metrics to select the best algorithm for your problem. After finalizing the algorithm you want to use, you will study the hyperparameter optimization technique to fine-tune your set of optimal parameters. The book demonstrates how you can add different regularization terms to avoid overfitting your model. By the end of this book, you will have gained the advanced skills you need for modeling a supervised machine learning algorithm that precisely fulfills your business needs.
Table of Contents (12 chapters)
Applied Supervised Learning with R
Preface

Log Transformation


The most common technique to correct for skewed distribution is to find an appropriate mathematical function that has an inverse. One such function is a log, represented as follows:

In other words, is the of to the base . The inverse, to find the , can be computed as follows:

This transformation gives the ability to handle the skewness in the data; at the same time, the original value can be easily computed once the model is built. The most popular log transformation is the natural , where is the mathematical constant , which equals roughly 2.71828.

One useful property of the log function is that it handles the data skewness elegantly. For example, the following code demonstrates the difference between log(10000) and log(1000000) as just 4.60517. The number is 100 times bigger than . This reduces the skewness that we otherwise let the model handle, which it might not do sufficiently.

#Natural Log
log(10000)
## [1] 9.21034

# 10 times bigger value
log(100000)
## [1] 11...