Book Image

Clojure for Data Science

By : Henry Garner
Book Image

Clojure for Data Science

By: Henry Garner

Overview of this book

Related Content you might be interested in

Current Title:

Small book image
Clojure for Data Science
Henry Garner
Sep, 2015 | 608 pages
Small book image
Spring 5.0 Projects
Nilang Patel
Feb, 2019 | 442 pages
Table of Contents (18 chapters)
Clojure for Data Science
Clojure for Data Science
Credits
Credits
About the Author
About the Author
Acknowledgments
Acknowledgments
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Statistics
Statistics
Downloading the sample code
Running the examples
Downloading the data
Inspecting the data
Data scrubbing
Descriptive statistics
Variance
Quantiles
Binning data
Histograms
The normal distribution
Poincaré's baker
Skewness
Comparative visualizations
The importance of visualizations
Adding columns
Comparative visualizations of electorate data
Visualizing the Russian election data
Comparative visualizations
Summary
2
Inference
Inference
Introducing AcmeContent
Download the sample code
Load and inspect the data
Visualizing the dwell times
The exponential distribution
The central limit theorem
Standard error
Samples and populations
Confidence intervals
Visualizing different populations
Hypothesis testing
Testing a new site design
The t-statistic
Performing the t-test
One-sample t-test
Resampling
Testing multiple designs
Multiple comparisons
The browser simulation
jStat
B1
Plotting probability densities
State and Reagent
Simulating multiple tests
The Bonferroni correction
Analysis of variance
The F-distribution
The F-statistic
The F-test
Effect size
Summary
3
Correlation
Correlation
About the data
Inspecting the data
Visualizing the data
The log-normal distribution
Covariance
Pearson's correlation
Hypothesis testing
Confidence intervals
Regression
Ordinary least squares
Goodness-of-fit and R-square
Multiple linear regression
Matrices
The normal equation
Multiple R-squared
Adjusted R-squared
Collinearity
Prediction
Summary
4
Classification
Classification
About the data
Inspecting the data
Comparisons with relative risk and odds
The standard error of a proportion
The binomial distribution
Significance testing proportions
Chi-squared multiple significance testing
Classification with logistic regression
Implementing logistic regression with Incanter
Probability
Naive Bayes classification
Decision trees
Classification with clj-ml
Bias and variance
Ensemble learning and random forests
Saving the classifier to a file
Summary
5
Big Data
Big Data
Downloading the code and data
The reducers library
Mathematical folds with Tesser
Multiple regression with gradient descent
Scaling gradient descent with Hadoop
Stochastic gradient descent
Summary
6
Clustering
Clustering
Downloading the data
Extracting the data
Inspecting the data
Clustering text
Creating term frequency vectors
Clustering with k-means and Incanter
Better clustering with TF-IDF
Large-scale clustering with Mahout
Running k-means clustering with Mahout
Cluster evaluation measures
The drawbacks of k-means
The curse of dimensionality
Summary
7
Recommender Systems
Recommender Systems
Download the code and data
Inspect the data
Parse the data
Types of recommender systems
Item-based and user-based recommenders
Slope One recommenders
Building a user-based recommender with Mahout
k-nearest neighbors
Recommender evaluation with Mahout
Probabilistic methods for large sets
Jaccard similarity for large sets with MinHash
Dimensionality reduction
Large-scale machine learning with Apache Spark and MLlib
Machine learning on Spark with MLlib
Summary
8
Network Analysis
Network Analysis
Download the data
Graph traversal with Loom
Breadth-first and depth-first search
Finding the shortest path
Whole-graph analysis
Scale-free networks
Distributed graph computation with GraphX
Summary
9
Time Series
Time Series
About the data
Fitting curves with a linear model
Time series decomposition
Discrete time models
Maximum likelihood estimation
Time series forecasting
Summary
10
Visualization
Visualization
Download the code and data
Exploratory data visualization
Using Quil for visualization
Visualization for communication
Summary
Index
Index

B1

Now that we can generate samples of data in ClojureScript, we'd like to be able to plot them on a histogram. We need a pure Clojure alternative to Incanter that will draw histograms in a web-accessible format; the B1 library (https://github.com/henrygarner/b1) provides just this functionality. The name is derived from the fact that it is adapted and simplified from the ClojureScript library C2, which in turn is a simplification of the popular JavaScript data visualization framework D3.

We'll be using B1's simple utility functions in b1.charts to build histograms out of our data in ClojureScript. B1 does not mandate a particular display format; we could use it to draw on a canvas element or even to build diagrams directly out of the HTML elements. However, B1 does contain functions to convert charts to SVG in b1.svg and these can be displayed in all modern web browsers.

Scalable Vector Graphics

SVG stands for Scalable Vector Graphics and defines a set of tags that represent drawing instructions...

Previous Section
End of Section 22
Next Section