Book Image

Data Analysis with R

Book Image

Data Analysis with R

Overview of this book

Frequently the tool of choice for academics, R has spread deep into the private sector and can be found in the production pipelines at some of the most advanced and successful enterprises. The power and domain-specificity of R allows the user to express complex analytics easily, quickly, and succinctly. With over 7,000 user contributed packages, it’s easy to find support for the latest and greatest algorithms and techniques. Starting with the basics of R and statistical reasoning, Data Analysis with R dives into advanced predictive analytics, showing how to apply those techniques to real-world data though with real-world examples. Packed with engaging problems and exercises, this book begins with a review of R and its syntax. From there, get to grips with the fundamentals of applied statistics and build on this knowledge to perform sophisticated and powerful analytics. Solve the difficulties relating to performing data analysis in practice and find solutions to working with “messy data”, large data, communicating results, and facilitating reproducibility. This book is engineered to be an invaluable resource through many stages of anyone’s career as a data analyst.
Table of Contents (20 chapters)
Data Analysis with R
Credits
About the Author
About the Reviewer
www.PacktPub.com
Preface
Index

Kitchen sink regression


When the goal of using regression is simply predictive modeling, we often don't care about which particular predictors go into our model, so long as the final model yields the best possible predictions.

A naïve (and awful) approach is to use all the independent variables available to try to model the dependent variable. Let's try this approach by trying to predict mpg from every other variable in the mtcars dataset:

  > # the period after the squiggly denotes all other variables
  > model <- lm(mpg ~ ., data=mtcars)
  > summary(model)

  Call:
  lm(formula = mpg ~ ., data = mtcars)

  Residuals:
      Min      1Q  Median      3Q     Max
  -3.4506 -1.6044 -0.1196  1.2193  4.6271

  Coefficients:
              Estimate Std. Error t value Pr(>|t|)
  (Intercept) 12.30337   18.71788   0.657   0.5181
  cyl         -0.11144    1.04502  -0.107   0.9161
  disp         0.01334    0.01786   0.747   0.4635
  hp          -0.02148    0.02177  -0.987   0.3350
  drat...