Book Image

Data Analysis with R, Second Edition - Second Edition

Book Image

Data Analysis with R, Second Edition - Second Edition

Overview of this book

Frequently the tool of choice for academics, R has spread deep into the private sector and can be found in the production pipelines at some of the most advanced and successful enterprises. The power and domain-specificity of R allows the user to express complex analytics easily, quickly, and succinctly. Starting with the basics of R and statistical reasoning, this book dives into advanced predictive analytics, showing how to apply those techniques to real-world data though with real-world examples. Packed with engaging problems and exercises, this book begins with a review of R and its syntax with packages like Rcpp, ggplot2, and dplyr. From there, get to grips with the fundamentals of applied statistics and build on this knowledge to perform sophisticated and powerful analytics. Solve the difficulties relating to performing data analysis in practice and find solutions to working with messy data, large data, communicating results, and facilitating reproducibility. This book is engineered to be an invaluable resource through many stages of anyone’s career as a data analyst.
Table of Contents (24 chapters)
Title Page
Copyright and Credits
Packt Upsell
Contributors
Preface
Index

Summary


In case you dozed off, this chapter addressed a fairly common problem in real-world data analysis—especially for data collected outside your control or organization: missing data.

We first learned how to visualize missing data patterns, and how to recognize different types of missing data. You saw a few unprincipled ways of tackling the problem, and learned why they were suboptimal solutions. Specifically, most of the naïve solutions produced biased estimates on at least some crucial statistics and, in particular, almost always underestimated the variance and would produce confidence intervals that were way too narrow.

Multiple imputation, so we learned, addresses the shortcomings of these approaches and, through its usage of several imputed datasets, correctly communicates our uncertainty surrounding the imputed values. We used mice to perform this procedure. We discussed the different imputation methods for different types of variables, like predictive mean matching for continuous...