Book Image

Interpretable Machine Learning with Python - Second Edition

By : Serg Masís
4 (4)
Book Image

Interpretable Machine Learning with Python - Second Edition

4 (4)
By: Serg Masís

Overview of this book

Interpretable Machine Learning with Python, Second Edition, brings to light the key concepts of interpreting machine learning models by analyzing real-world data, providing you with a wide range of skills and tools to decipher the results of even the most complex models. Build your interpretability toolkit with several use cases, from flight delay prediction to waste classification to COMPAS risk assessment scores. This book is full of useful techniques, introducing them to the right use case. Learn traditional methods, such as feature importance and partial dependence plots to integrated gradients for NLP interpretations and gradient-based attribution methods, such as saliency maps. In addition to the step-by-step code, you’ll get hands-on with tuning models and training data for interpretability by reducing complexity, mitigating bias, placing guardrails, and enhancing reliability. By the end of the book, you’ll be confident in tackling interpretability challenges with black-box models using tabular, language, image, and time series data.

Related Content you might be interested in

Current Title:

Small book image
Interpretable Machine Learning with Python - Second Edition
Serg Masís
Oct, 2023 | 606 pages
Small book image
Applied Machine Learning Explainability Techniques
Aditya Bhattacharya
Jul, 2022 | 306 pages
Small book image
Deep Learning and XAI Techniques for Anomaly Detection
Cher Simon
Jan, 2023 | 218 pages
Small book image
Responsible AI in the Enterprise
Adnan Masood | Heather Dawe
Jul, 2023 | 318 pages
Table of Contents (17 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
1
Interpretation, Interpretability, and Explainability; and Why Does It All Matter?
Interpretation, Interpretability, and Explainability; and Why Does It All Matter?
Technical requirements
What is machine learning interpretation?
Understanding the difference between interpretability and explainability
A business case for interpretability
Summary
Image sources
Dataset sources
Further reading
Free Chapter
2
Key Concepts of Interpretability
Key Concepts of Interpretability
Technical requirements
The mission
The approach
Preparations
Interpretation method types and scopes
Appreciating what hinders machine learning interpretability
Mission accomplished
Summary
Further reading
3
Interpretation Challenges
Interpretation Challenges
Technical requirements
The mission
The approach
The preparations
Loading the libraries
Reviewing traditional model interpretation methods
Understanding limitations of traditional model interpretation methods
Studying intrinsically interpretable (white-box) models
Recognizing the trade-off between performance and interpretability
Discovering newer interpretable (glass-box) models
Mission accomplished
Summary
Dataset sources
Further reading
4
Global Model-Agnostic Interpretation Methods
Global Model-Agnostic Interpretation Methods
Technical requirements
The mission
The approach
The preparations
Model training and evaluation
What is feature importance?
Assessing feature importance with model-agnostic methods
Visualize global explanations
Feature summary explanations
Feature interactions
Summary
Further reading
5
Local Model-Agnostic Interpretation Methods
Local Model-Agnostic Interpretation Methods
Technical requirements
The mission
The approach
The preparations
Leveraging SHAP’s KernelExplainer for local interpretations with SHAP values
Employing LIME
Using LIME for NLP
Trying SHAP for NLP
Comparing SHAP with LIME
Mission accomplished
Summary
Dataset sources
Further reading
6
Anchors and Counterfactual Explanations
Anchors and Counterfactual Explanations
Technical requirements
The mission
The approach
The preparations
Understanding anchor explanations
Exploring counterfactual explanations
Mission accomplished
Summary
Dataset sources
Further reading
7
Visualizing Convolutional Neural Networks
Visualizing Convolutional Neural Networks
Technical requirements
The mission
The approach
Preparations
Visualizing the learning process with activation-based methods
Evaluating misclassifications with gradient-based attribution methods
Understanding classifications with perturbation-based attribution methods
Mission accomplished
Summary
Further reading
8
Interpreting NLP Transformers
Interpreting NLP Transformers
Technical requirements
The mission
The approach
The preparations
Visualizing attention with BertViz
Interpreting token attributions with integrated gradients
LIME, counterfactuals, and other possibilities with the LIT
Mission accomplished
Summary
Further reading
9
Interpretation Methods for Multivariate Forecasting and Sensitivity Analysis
Interpretation Methods for Multivariate Forecasting and Sensitivity Analysis
Technical requirements
The mission
The approach
The preparation
Assessing time series models with traditional interpretation methods
Generating LSTM attributions with integrated gradients
Computing global and local attributions with SHAP’s KernelExplainer
Identifying influential features with factor prioritization
Quantifying uncertainty and cost sensitivity with factor fixing
Mission accomplished
Summary
Dataset and image sources
Further reading
10
Feature Selection and Engineering for Interpretability
Feature Selection and Engineering for Interpretability
Technical requirements
The mission
The approach
The preparations
Understanding the effect of irrelevant features
Reviewing filter-based feature selection methods
Exploring embedded feature selection methods
Discovering wrapper, hybrid, and advanced feature selection methods
Considering feature engineering
Mission accomplished
Summary
Dataset sources
Further reading
11
Bias Mitigation and Causal Inference Methods
Bias Mitigation and Causal Inference Methods
Technical requirements
The mission
The approach
The preparations
Detecting bias
Mitigating bias
Creating a causal model
Understanding heterogeneous treatment effects
Testing estimate robustness
Mission accomplished
Summary
Dataset sources
Further reading
12
Monotonic Constraints and Model Tuning for Interpretability
Monotonic Constraints and Model Tuning for Interpretability
Technical requirements
The mission
The approach
The preparations
Placing guardrails with feature engineering
Tuning models for interpretability
Implementing model constraints
Mission accomplished
Summary
Dataset sources
Further reading
13
Adversarial Robustness
Adversarial Robustness
Technical requirements
The mission
The approach
The preparations
Learning about evasion attacks
Defending against targeted attacks with preprocessing
Shielding against any evasion attack by adversarial training of a robust classifier
Evaluating adversarial robustness
Mission accomplished
Summary
Dataset sources
Further reading
14
What’s Next for Machine Learning Interpretability?
What’s Next for Machine Learning Interpretability?
Understanding the current landscape of ML interpretability
Speculating on the future of ML interpretability
Summary
Further reading
15
Other Books You May Enjoy
Other Books You May Enjoy
16
Index
Index

Get in touch

Feedback from our readers is always welcome.

General feedback: Email [email protected] and mention the book’s title in the subject of your message. If you have questions about any aspect of this book, please email us at [email protected].

Errata: Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you have found a mistake in this book, we would be grateful if you reported this to us. Please visit http://www.packtpub.com/submit-errata, click Submit Errata, and fill in the form.

Piracy: If you come across any illegal copies of our works in any form on the internet, we would be grateful if you would provide us with the location address or website name. Please contact us at [email protected] with a link to the material.

If you are interested in becoming an author: If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, please visit http://authors.packtpub.com.

Share your thoughts

Once you’ve read Interpretable Machine Learning with Python 2e, we’d love to hear your thoughts! Please click here to go straight to the Amazon review page for this book and share your feedback.

Your review is important to us and the tech community and will help us make sure we’re delivering excellent quality content.

Download a free PDF copy of this book

Thanks for purchasing this book!

Do you like to read on the go but are unable to carry your print books everywhere?

Is your eBook purchase not compatible with the device of your choice?

Don’t worry, now with every Packt book you get a DRM-free PDF version of that book at no cost.

Read anywhere, any place, on any device. Search, copy, and paste code from your favorite technical books directly into your application.

The perks don’t stop there, you can get exclusive access to discounts, newsletters, and great free content in your inbox daily

Follow these simple steps to get the benefits:

  1. Scan the QR code or visit the link below

https://packt.link/free-ebook/9781803235424

  1. Submit your proof of purchase
  2. That’s it! We’ll send your free PDF and other benefits to your email directly
Previous Section
Next Chapter