Book Image

Mastering Clojure Data Analysis

By : Eric Richard Rochester
Book Image

Mastering Clojure Data Analysis

By: Eric Richard Rochester

Overview of this book

Related Content you might be interested in

Current Title:

Small book image
Mastering Clojure Data Analysis
Eric Richard Rochester
May, 2014 | 340 pages
No titles found
Table of Contents (17 chapters)
Mastering Clojure Data Analysis
Mastering Clojure Data Analysis
Credits
Credits
About the Author
About the Author
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Network Analysis – The Six Degrees of Kevin Bacon
Network Analysis – The Six Degrees of Kevin Bacon
Analyzing social networks
Getting the data
Understanding graphs
Implementing the graphs
Measuring social network graphs
Visualizing the graph
Summary
2
GIS Analysis – Mapping Climate Change
GIS Analysis – Mapping Climate Change
Understanding GIS
Mapping the climate change
Working with map projections
Working with ArcGIS
Summary
3
Topic Modeling – Changing Concerns in the State of the Union Addresses
Topic Modeling – Changing Concerns in the State of the Union Addresses
Understanding data in the State of Union addresses
Understanding topic modeling
Preparing for visualizations
Setting up the project
Getting the data
Summary
4
Classifying UFO Sightings
Classifying UFO Sightings
Getting the data
Extracting the data
Dealing with messy data
Visualizing UFO data
Description
Topic modeling descriptions
Hoaxes
Summary
5
Benford's Law – Detecting Natural Progressions of Numbers
Benford's Law – Detecting Natural Progressions of Numbers
Learning about Benford's Law
Failing Benford's Law
Case studies
Summary
6
Sentiment Analysis – Categorizing Hotel Reviews
Sentiment Analysis – Categorizing Hotel Reviews
Understanding sentiment analysis
Getting hotel review data
Exploring the data
Preparing the data
Cross-validating the results
Calculating error rates
Using the Weka machine learning library
Running the experiment
Examining the results
Improving the results
Summary
7
Null Hypothesis Tests – Analyzing Crime Data
Null Hypothesis Tests – Analyzing Crime Data
Introducing confirmatory data analysis
Understanding null hypothesis testing
Understanding burglary rates
Exploring the data
Conducting the experiment
Interpreting the results
Summary
8
A/B Testing – Statistical Experiments for the Web
A/B Testing – Statistical Experiments for the Web
Defining A/B testing
Conducting an A/B test
Summary
9
Analyzing Social Data Participation
Analyzing Social Data Participation
Setting up the project
Summary
10
Modeling Stock Data
Modeling Stock Data
Learning about financial data analysis
Setting up the basics
Getting prepared with data
Analyzing the text
Inspecting the stock prices
Merging text and stock features
Analyzing both text and stock features together with neural nets
Predicting the future
Taking it with a grain of salt
Summary
Index
Index

Extracting the data

Before we go further, let's look at the following Leiningen 2 (http://leiningen.org/) project.clj file that we'll use for this chapter:

(defproject ufo-data "0.1.0-SNAPSHOT"
  :plugins [[lein-cljsbuild "0.3.2"]]
  :profiles {:dev {:plugins [[com.cemerick/austin "0.1.0"]]}}
  :dependencies [[org.clojure/clojure "1.5.1"]
                 [org.clojure/data.json "0.2.2"]
                 [org.clojure/data.csv "0.1.2"]
                 [clj-time "0.5.1"]
                 [incanter "1.5.2"]
                 [cc.mallet/mallet "2.0.7"]
                 [me.raynes/fs "1.4.4"]]
  :cljsbuild
    {:builds [{:source-paths ["src-cljs"],
               :compiler {:pretty-printer true,
                          :output-to "www/js/main.js",
                          :optimizations :whitespace}}]})

The preceding code shows that over the course of this chapter, we'll parse time with the clj-time library (https://github.com/clj-time/clj-time). This provides a rich, robust date and time library...

Previous Section
End of Section 3
Next Section