Book Image

Java Data Science Cookbook

By : Rushdi Shams
Book Image

Java Data Science Cookbook

By: Rushdi Shams

Overview of this book

If you are looking to build data science models that are good for production, Java has come to the rescue. With the aid of strong libraries such as MLlib, Weka, DL4j, and more, you can efficiently perform all the data science tasks you need to. This unique book provides modern recipes to solve your common and not-so-common data science-related problems. We start with recipes to help you obtain, clean, index, and search data. Then you will learn a variety of techniques to analyze, learn from, and retrieve information from data. You will also understand how to handle big data, learn deeply from data, and visualize data. Finally, you will work through unique recipes that solve your problems while taking data science to production, writing distributed data science applications, and much more - things that will come in handy at work.
Table of Contents (16 chapters)
Java Data Science Cookbook
Credits
About the Author
About the Reviewer
www.PacktPub.com
Customer Feedback
Preface

Conducting a paired t-test


Among the number of standard statistical significance test libraries offered by Apache Commons Math, we will be using only a few to demonstrate paired the t-test, Chi-square test, one-way ANOVA test, and the Kolmogorov-Smirnov test. Readers can carry out other significance tests as the codes will use the static methods in the TestUtils class to execute tests.

Apache Commons Math has support for both one-sample and two-sample t-tests. Besides, two sample tests can be either paired or unpaired. The unpaired two-sample tests can be conducted with and without the assumption that the subpopulation variances are equal.

How to do it...

  1. Create a method that takes two sets of double values as arguments. We will be conducting a paired t-test to find out any statistical significance between these two sets of values:

            public void getTtest(double[] sample1, double[] sample2){ 
    
  2. The t-statistic of the two distributions can be found using the pairedT() method:

            System...