Book Image

Scala for Machine Learning, Second Edition - Second Edition

Book Image

Scala for Machine Learning, Second Edition - Second Edition

Overview of this book

The discovery of information through data clustering and classification is becoming a key differentiator for competitive organizations. Machine learning applications are everywhere, from self-driving cars, engineering design, logistics, manufacturing, and trading strategies, to detection of genetic anomalies. The book is your one stop guide that introduces you to the functional capabilities of the Scala programming language that are critical to the creation of machine learning algorithms such as dependency injection and implicits. You start by learning data preprocessing and filtering techniques. Following this, you'll move on to unsupervised learning techniques such as clustering and dimension reduction, followed by probabilistic graphical models such as Naïve Bayes, hidden Markov models and Monte Carlo inference. Further, it covers the discriminative algorithms such as linear, logistic regression with regularization, kernelization, support vector machines, neural networks, and deep learning. You’ll move on to evolutionary computing, multibandit algorithms, and reinforcement learning. Finally, the book includes a comprehensive overview of parallel computing in Scala and Akka followed by a description of Apache Spark and its ML library. With updated codes based on the latest version of Scala and comprehensive examples, this book will ensure that you have more than just a solid fundamental knowledge in machine learning with Scala.
Table of Contents (27 chapters)
Scala for Machine Learning Second Edition
Credits
About the Author
About the Reviewers
www.PacktPub.com
Customer Feedback
Preface
Index

Chapter 14


[14:1] Introduction to Machine Learning §Reinforcement learning: Single State Case: K-Armed Bandit, E. Alpaydin - MIT Press 2007

[14:2] Algorithms for the multiarmed bandit problem V. Kuleshov, D. Precup McGill University – 2000, https://www.cs.mcgill.ca/~vkules/bandits.pdf

[14:3] Multiarmed Bandits and Exploration Strategies, S. Raja - https://sudeepraja.github.io/Bandits/

[14:4} A Tutorial on Thompson Sampling, D. Russo, B. Van Roy, A. Kazerouni, I. Osband, Z. Wen – Stanford University, Columbia University, Google Deepmind, Adobe Research 2017 - http://web.stanford.edu/~bvr/pubs/TS_Tutorial.pdf

[14:5] Analysis of Thompson Sampling for the Multiarmed Bandit Problem, S. Agrawal, N. Goyal – Microsoft Research India – 2012 - http://proceedings.mlr.press/v23/agrawal12/agrawal12.pdf

[14:6] Generalized Thompson Sampling for Contextual Bandits, L.Li Microsoft Research – 2013 - https://arxiv.org/pdf/1310.7163.pdf

[14: 7] Bandit Algorithms Continued: UCB1: N. Welsh – 2010 - https://www.cs.bham.ac.uk/internal/courses/robotics/lectures/ucb1.pdf