Book Image

Java Data Science Cookbook

By : Rushdi Shams
Book Image

Java Data Science Cookbook

By: Rushdi Shams

Overview of this book

If you are looking to build data science models that are good for production, Java has come to the rescue. With the aid of strong libraries such as MLlib, Weka, DL4j, and more, you can efficiently perform all the data science tasks you need to. This unique book provides modern recipes to solve your common and not-so-common data science-related problems. We start with recipes to help you obtain, clean, index, and search data. Then you will learn a variety of techniques to analyze, learn from, and retrieve information from data. You will also understand how to handle big data, learn deeply from data, and visualize data. Finally, you will work through unique recipes that solve your problems while taking data science to production, writing distributed data science applications, and much more - things that will come in handy at work.

Related Content you might be interested in

Current Title:

Small book image
Java Data Science Cookbook
Rushdi Shams
Mar, 2017 | 372 pages
Small book image
Machine Learning in Java
AshishSingh Bhatia | Bostjan Kaluza
Nov, 2018 | 300 pages
Small book image
Java for Data Science
Richard Reese | Jennifer L Reese
Jan, 2017 | 386 pages
Small book image
Mastering Java for Data Science
Alexey Grigorev
Apr, 2017 | 364 pages
Table of Contents (16 chapters)
Java Data Science Cookbook
Java Data Science Cookbook
Credits
Credits
About the Author
About the Author
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Customer Feedback
Customer Feedback
Preface
Preface
Free Chapter
1
Obtaining and Cleaning Data
Obtaining and Cleaning Data
Introduction
Retrieving all filenames from hierarchical directories using Java
Retrieving all filenames from hierarchical directories using Apache Commons IO
Reading contents from text files all at once using Java 8
Reading contents from text files all at once using Apache Commons IO
Extracting PDF text using Apache Tika
Cleaning ASCII text files using Regular Expressions
Parsing Comma Separated Value (CSV) Files using Univocity
Parsing Tab Separated Value (TSV) file using Univocity
Parsing XML files using JDOM
Writing JSON files using JSON.simple
Reading JSON files using JSON.simple
Extracting web data from a URL using JSoup
Extracting web data from a website using Selenium Webdriver
Reading table data from a MySQL database
2
Indexing and Searching Data
Indexing and Searching Data
Introduction
Indexing data with Apache Lucene
Searching indexed data with Apache Lucene
3
Analyzing Data Statistically
Analyzing Data Statistically
Introduction
Generating descriptive statistics
Generating summary statistics
Generating summary statistics from multiple distributions
Computing frequency distribution
Counting word frequency in a string
Counting word frequency in a string using Java 8
Computing simple regression
Computing ordinary least squares regression
Computing generalized least squares regression
Calculating covariance of two sets of data points
Calculating Pearson's correlation of two sets of data points
Conducting a paired t-test
Conducting a Chi-square test
Conducting the one-way ANOVA test
Conducting a Kolmogorov-Smirnov test
4
Learning from Data - Part 1
Learning from Data - Part 1
Introduction
Creating and saving an Attribute-Relation File Format (ARFF) file
Cross-validating a machine learning model
Classifying unseen test data
Classifying unseen test data with a filtered classifier
Generating linear regression models
Generating logistic regression models
Clustering data points using the KMeans algorithm
Clustering data from classes
Learning association rules from data
Selecting features/attributes using the low-level method, the filtering method, and the meta-classifier method
5
Learning from Data - Part 2
Learning from Data - Part 2
Introduction
Applying machine learning on data using Java Machine Learning (Java-ML) library
Classifying data points using the Stanford classifier
Classifying data points using Massive Online Analysis (MOA)
Classifying multilabeled data points using Mulan
6
Retrieving Information from Text Data
Retrieving Information from Text Data
Introduction
Detecting tokens (words) using Java
Detecting sentences using Java
Detecting tokens (words) and sentences using OpenNLP
Retrieving lemma, part-of-speech, and recognizing named entities from tokens using Stanford CoreNLP
Measuring text similarity with Cosine Similarity measure using Java 8
Extracting topics from text documents using Mallet
Classifying text documents using Mallet
Classifying text documents using Weka
7
Handling Big Data
Handling Big Data
Introduction
Training an online logistic regression model using Apache Mahout
Applying an online logistic regression model using Apache Mahout
Solving simple text mining problems with Apache Spark
Clustering using KMeans algorithm with MLib
Creating a linear regression model with MLib
Classifying data points with Random Forest model using MLib
8
Learn Deeply from Data
Learn Deeply from Data
Introduction
Creating a Word2vec neural net using Deep Learning for Java (DL4j)
Creating a Deep Belief neural net using Deep Learning for Java (DL4j)
Creating a deep autoencoder using Deep Learning for Java (DL4j)
9
Visualizing Data
Visualizing Data
Introduction
Plotting a 2D sine graph
Plotting histograms
Plotting a bar chart
Plotting box plots or whisker diagrams
Plotting scatter plots
Plotting donut plots
Plotting area graphs

Introduction

Every data scientist needs to deal with data that is stored on disks in several formats, such as ASCII text, PDF, XML, JSON, and so on. Also, data can be stored in database tables. The first and foremost task for a data scientist before doing any analysis is to obtain data from these data sources and of these formats, and apply data-cleaning techniques to get rid of noises present in them. In this chapter, we will see recipes to accomplish this important task.

We will be using external Java libraries (Java archive files or simply JAR files) not only for this chapter but throughout the book. These libraries are created by developers or organizations to make everybody's life easier. We will be using Eclipse IDE for code development, preferably on the Windows platform, and execution throughout the book. Here is how you can include any external JAR file, and in many recipes, where I instruct you to include external JAR files into your project, this is what you need to do.

You can add a JAR file in a project in Eclipse by right-clicking on the Project | Build Path | Configure Build Path. Under the Libraries tab, click on Add External JARs..., and select the external JAR file(s) that you are going to use for a particular project:

Previous Section
End of Section 2
Next Section