Book Image

Machine Learning with PyTorch and Scikit-Learn

By : Sebastian Raschka, Yuxi (Hayden) Liu, Vahid Mirjalili
5 (7)
Book Image

Machine Learning with PyTorch and Scikit-Learn

5 (7)
By: Sebastian Raschka, Yuxi (Hayden) Liu, Vahid Mirjalili

Overview of this book

Machine Learning with PyTorch and Scikit-Learn is a comprehensive guide to machine learning and deep learning with PyTorch. It acts as both a step-by-step tutorial and a reference you'll keep coming back to as you build your machine learning systems. Packed with clear explanations, visualizations, and examples, the book covers all the essential machine learning techniques in depth. While some books teach you only to follow instructions, with this machine learning book, we teach the principles allowing you to build models and applications for yourself. Why PyTorch? PyTorch is the Pythonic way to learn machine learning, making it easier to learn and simpler to code with. This book explains the essential parts of PyTorch and how to create models using popular libraries, such as PyTorch Lightning and PyTorch Geometric. You will also learn about generative adversarial networks (GANs) for generating new data and training intelligent agents with reinforcement learning. Finally, this new edition is expanded to cover the latest trends in deep learning, including graph neural networks and large-scale transformers used for natural language processing (NLP). This PyTorch book is your companion to machine learning with Python, whether you're a Python developer new to machine learning or want to deepen your knowledge of the latest developments.

Related Content you might be interested in

Current Title:

Small book image
Machine Learning with PyTorch and Scikit-Learn
Sebastian Raschka | Yuxi (Hayden) Liu | Vahid Mirjalili
Feb, 2022 | 774 pages
Small book image
Mastering Machine Learning with scikit-learn
Gavin Hackeling
Jul, 2017 | 254 pages
Small book image
Machine Learning for OpenCV
Michael Beyeler
Jul, 2017 | 382 pages
Small book image
Python Deep Learning
Ivan Vasilev
Nov, 2023 | 362 pages
Table of Contents (22 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Share your thoughts
Free Chapter
1
Giving Computers the Ability to Learn from Data
Giving Computers the Ability to Learn from Data
Building intelligent machines to transform data into knowledge
The three different types of machine learning
Introduction to the basic terminology and notations
A roadmap for building machine learning systems
Using Python for machine learning
Summary
2
Training Simple Machine Learning Algorithms for Classification
Training Simple Machine Learning Algorithms for Classification
Artificial neurons – a brief glimpse into the early history of machine learning
Implementing a perceptron learning algorithm in Python
Adaptive linear neurons and the convergence of learning
Summary
3
A Tour of Machine Learning Classifiers Using Scikit-Learn
A Tour of Machine Learning Classifiers Using Scikit-Learn
Choosing a classification algorithm
First steps with scikit-learn – training a perceptron
Modeling class probabilities via logistic regression
Maximum margin classification with support vector machines
Solving nonlinear problems using a kernel SVM
Decision tree learning
K-nearest neighbors – a lazy learning algorithm
Summary
4
Building Good Training Datasets – Data Preprocessing
Building Good Training Datasets – Data Preprocessing
Dealing with missing data
Handling categorical data
Partitioning a dataset into separate training and test datasets
Bringing features onto the same scale
Selecting meaningful features
Assessing feature importance with random forests
Summary
5
Compressing Data via Dimensionality Reduction
Compressing Data via Dimensionality Reduction
Unsupervised dimensionality reduction via principal component analysis
Supervised data compression via linear discriminant analysis
Nonlinear dimensionality reduction and visualization
Summary
6
Learning Best Practices for Model Evaluation and Hyperparameter Tuning
Learning Best Practices for Model Evaluation and Hyperparameter Tuning
Streamlining workflows with pipelines
Using k-fold cross-validation to assess model performance
Debugging algorithms with learning and validation curves
Fine-tuning machine learning models via grid search
Looking at different performance evaluation metrics
Summary
7
Combining Different Models for Ensemble Learning
Combining Different Models for Ensemble Learning
Learning with ensembles
Combining classifiers via majority vote
Bagging – building an ensemble of classifiers from bootstrap samples
Leveraging weak learners via adaptive boosting
Gradient boosting – training an ensemble based on loss gradients
Summary
8
Applying Machine Learning to Sentiment Analysis
Applying Machine Learning to Sentiment Analysis
Preparing the IMDb movie review data for text processing
Introducing the bag-of-words model
Training a logistic regression model for document classification
Working with bigger data – online algorithms and out-of-core learning
Topic modeling with latent Dirichlet allocation
Summary
9
Predicting Continuous Target Variables with Regression Analysis
Predicting Continuous Target Variables with Regression Analysis
Introducing linear regression
Exploring the Ames Housing dataset
Implementing an ordinary least squares linear regression model
Fitting a robust regression model using RANSAC
Evaluating the performance of linear regression models
Using regularized methods for regression
Turning a linear regression model into a curve – polynomial regression
Dealing with nonlinear relationships using random forests
Summary
10
Working with Unlabeled Data – Clustering Analysis
Working with Unlabeled Data – Clustering Analysis
Grouping objects by similarity using k-means
Organizing clusters as a hierarchical tree
Locating regions of high density via DBSCAN
Summary
11
Implementing a Multilayer Artificial Neural Network from Scratch
Implementing a Multilayer Artificial Neural Network from Scratch
Modeling complex functions with artificial neural networks
Classifying handwritten digits
Training an artificial neural network
About convergence in neural networks
A few last words about the neural network implementation
Summary
12
Parallelizing Neural Network Training with PyTorch
Parallelizing Neural Network Training with PyTorch
PyTorch and training performance
First steps with PyTorch
Building input pipelines in PyTorch
Building an NN model in PyTorch
Choosing activation functions for multilayer neural networks
Summary
13
Going Deeper – The Mechanics of PyTorch
Going Deeper – The Mechanics of PyTorch
The key features of PyTorch
PyTorch’s computation graphs
PyTorch tensor objects for storing and updating model parameters
Computing gradients via automatic differentiation
Simplifying implementations of common architectures via the torch.nn module
Project one – predicting the fuel efficiency of a car
Project two – classifying MNIST handwritten digits
Higher-level PyTorch APIs: a short introduction to PyTorch-Lightning
Summary
14
Classifying Images with Deep Convolutional Neural Networks
Classifying Images with Deep Convolutional Neural Networks
The building blocks of CNNs
Putting everything together – implementing a CNN
Implementing a deep CNN using PyTorch
Smile classification from face images using a CNN
Summary
15
Modeling Sequential Data Using Recurrent Neural Networks
Modeling Sequential Data Using Recurrent Neural Networks
Introducing sequential data
RNNs for modeling sequences
Implementing RNNs for sequence modeling in PyTorch
Summary
16
Transformers – Improving Natural Language Processing with Attention Mechanisms
Transformers – Improving Natural Language Processing with Attention Mechanisms
Adding an attention mechanism to RNNs
Introducing the self-attention mechanism
Attention is all we need: introducing the original transformer architecture
Building large-scale language models by leveraging unlabeled data
Fine-tuning a BERT model in PyTorch
Summary
17
Generative Adversarial Networks for Synthesizing New Data
Generative Adversarial Networks for Synthesizing New Data
Introducing generative adversarial networks
Implementing a GAN from scratch
Improving the quality of synthesized images using a convolutional and Wasserstein GAN
Other GAN applications
Summary
18
Graph Neural Networks for Capturing Dependencies in Graph Structured Data
Graph Neural Networks for Capturing Dependencies in Graph Structured Data
Introduction to graph data
Understanding graph convolutions
Implementing a GNN in PyTorch from scratch
Implementing a GNN using the PyTorch Geometric library
Other GNN layers and recent developments
Summary
19
Reinforcement Learning for Decision Making in Complex Environments
Reinforcement Learning for Decision Making in Complex Environments
Introduction – learning from experience
The theoretical foundations of RL
Reinforcement learning algorithms
Implementing our first RL algorithm
A glance at deep Q-learning
Chapter and book summary
20
Other Books You May Enjoy
Other Books You May Enjoy
21
Index
Index

Preface

Through exposure to the news and social media, you probably are familiar with the fact that machine learning has become one of the most exciting technologies of our time and age. Large companies, such as Microsoft, Google, Meta, Apple, Amazon, IBM, and many more, heavily invest in machine learning research and applications for good reasons. While it may seem that machine learning has become the buzzword of our time and age, it is certainly not hype. This exciting field opens the way to new possibilities and has become indispensable to our daily lives. Talking to the voice assistant on our smartphones, recommending the right product for our customers, preventing credit card fraud, filtering out spam from our e-mail inboxes, detecting and diagnosing medical diseases, the list goes on and on.

If you want to become a machine learning practitioner, a better problem solver, or even consider a career in machine learning research, then this book is for you! However, for a novice, the theoretical concepts behind machine learning can be quite overwhelming. Yet, many practical books that have been published in recent years will help you get started in machine learning by implementing powerful learning algorithms.

Getting exposed to practical code examples and working through example applications of machine learning is a great way to dive into this field. Concrete examples help to illustrate the broader concepts by putting the learned material directly into action. However, remember that with great power comes great responsibility! In addition to offering hands-on experience with machine learning using Python and Python-based machine learning libraries, this book also introduces the mathematical concepts behind machine learning algorithms, which is essential for using machine learning successfully. Thus, this book is different from a purely practical book; it is a book that discusses the necessary details regarding machine learning concepts, offers intuitive yet informative explanations on how machine learning algorithms work, how to use them, and most importantly, how to avoid the most common pitfalls.

In this book, we will embark on an exciting journey that covers all the essential topics and concepts to give you a head start in this field. If you find that your thirst for knowledge is not satisfied, this book references many useful resources that you can use to follow up on the essential breakthroughs in this field.

Previous Section
Next Section