Book Image

Building Machine Learning Systems with Python

Book Image

Building Machine Learning Systems with Python

Overview of this book

Machine learning, the field of building systems that learn from data, is exploding on the Web and elsewhere. Python is a wonderful language in which to develop machine learning applications. As a dynamic language, it allows for fast exploration and experimentation and an increasing number of machine learning libraries are developed for Python.Building Machine Learning system with Python shows you exactly how to find patterns through raw data. The book starts by brushing up on your Python ML knowledge and introducing libraries, and then moves on to more serious projects on datasets, Modelling, Recommendations, improving recommendations through examples and sailing through sound and image processing in detail. Using open-source tools and libraries, readers will learn how to apply methods to text, images, and sounds. You will also learn how to evaluate, compare, and choose machine learning techniques. Written for Python programmers, Building Machine Learning Systems with Python teaches you how to use open-source libraries to solve real problems with machine learning. The book is based on real-world examples that the user can build on. Readers will learn how to write programs that classify the quality of StackOverflow answers or whether a music file is Jazz or Metal. They will learn regression, which is demonstrated on how to recommend movies to users. Advanced topics such as topic modeling (finding a text's most important topics), basket analysis, and cloud computing are covered as well as many other interesting aspects.Building Machine Learning Systems with Python will give you the tools and understanding required to build your own systems, which are tailored to solve your problems.

Related Content you might be interested in

Current Title:

Small book image
Building Machine Learning Systems with Python
Jul, 2013 | 290 pages
No titles found
Table of Contents (20 chapters)
Building Machine Learning Systems with Python
Building Machine Learning Systems with Python
Credits
Credits
About the Authors
About the Authors
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Getting Started with Python Machine Learning
Getting Started with Python Machine Learning
Machine learning and Python – the dream team
What the book will teach you (and what it will not)
What to do when you are stuck
Getting started
Our first (tiny) machine learning application
Summary
2
Learning How to Classify with Real-world Examples
Learning How to Classify with Real-world Examples
The Iris dataset
Building more complex classifiers
A more complex dataset and a more complex classifier
Binary and multiclass classification
Summary
3
Clustering – Finding Related Posts
Clustering – Finding Related Posts
Measuring the relatedness of posts
Preprocessing – similarity measured as similar number of common words
Clustering
Solving our initial challenge
Tweaking the parameters
Summary
4
Topic Modeling
Topic Modeling
Latent Dirichlet allocation (LDA)
Comparing similarity in topic space
Choosing the number of topics
Summary
5
Classification – Detecting Poor Answers
Classification – Detecting Poor Answers
Sketching our roadmap
Learning to classify classy answers
Fetching the data
Creating our first classifier
Deciding how to improve
Using logistic regression
Looking behind accuracy – precision and recall
Slimming the classifier
Ship it!
Summary
6
Classification II – Sentiment Analysis
Classification II – Sentiment Analysis
Sketching our roadmap
Fetching the Twitter data
Introducing the Naive Bayes classifier
Creating our first classifier and tuning it
Cleaning tweets
Taking the word types into account
Summary
7
Regression – Recommendations
Regression – Recommendations
Predicting house prices with regression
Penalized regression
P greater than N scenarios
Summary
8
Regression – Recommendations Improved
Regression – Recommendations Improved
Improved recommendations
Basket analysis
Summary
9
Classification III – Music Genre Classification
Classification III – Music Genre Classification
Sketching our roadmap
Fetching the music data
Looking at music
Using FFT to build our first classifier
Improving classification performance with Mel Frequency Cepstral Coefficients
Summary
10
Computer Vision – Pattern Recognition
Computer Vision – Pattern Recognition
Introducing image processing
Loading and displaying images
Classifying a harder dataset
Local feature representations
Summary
11
Dimensionality Reduction
Dimensionality Reduction
Sketching our roadmap
Selecting features
Other feature selection methods
Feature extraction
Multidimensional scaling (MDS)
Summary
12
Big(ger) Data
Big(ger) Data
Learning about big data
Using jug to break up your pipeline into tasks
Using Amazon Web Services (AWS)
Summary
Where to Learn More about Machine Learning
Where to Learn More about Machine Learning
Online courses
Books
What was left out
Summary
Index
Index

Selecting features

If we want to be nice to our machine learning algorithm, we will provide it with features that are not dependent on each other, yet highly dependent on the value to be predicted. It means that each feature adds some salient information. Removing any of the features will lead to a drop in performance.

If we have only a handful of features, we could draw a matrix of scatter plots – one scatter plot for every feature-pair combination. Relationships between the features could then be easily spotted. For every feature pair showing an obvious dependence, we would then think whether we should remove one of them or better design a newer, cleaner feature out of both.

Most of the time, however, we have more than a handful of features to choose from. Just think of the classification task where we had a bag-of-words to classify the quality of an answer, which would require a 1,000 by 1,000 scatter plot. In this case, we need a more automated way to detect the overlapping features and...

Previous Section
End of Section 3
Next Section