Book Image

Hands-On Explainable AI (XAI) with Python

By : Denis Rothman
Book Image

Hands-On Explainable AI (XAI) with Python

By: Denis Rothman

Overview of this book

Effectively translating AI insights to business stakeholders requires careful planning, design, and visualization choices. Describing the problem, the model, and the relationships among variables and their findings are often subtle, surprising, and technically complex. Hands-On Explainable AI (XAI) with Python will see you work with specific hands-on machine learning Python projects that are strategically arranged to enhance your grasp on AI results analysis. You will be building models, interpreting results with visualizations, and integrating XAI reporting tools and different applications. You will build XAI solutions in Python, TensorFlow 2, Google Cloud’s XAI platform, Google Colaboratory, and other frameworks to open up the black box of machine learning models. The book will introduce you to several open-source XAI tools for Python that can be used throughout the machine learning project life cycle. You will learn how to explore machine learning model results, review key influencing variables and variable relationships, detect and handle bias and ethics issues, and integrate predictions using Python along with supporting the visualization of machine learning models into user explainable interfaces. By the end of this AI book, you will possess an in-depth understanding of the core concepts of XAI.

Related Content you might be interested in

Current Title:

Small book image
Hands-On Explainable AI (XAI) with Python
Denis Rothman
Jul, 2020 | 454 pages
Small book image
Artificial Intelligence By Example.
Denis Rothman
Feb, 2020 | 578 pages
Small book image
Applied Machine Learning Explainability Techniques
Aditya Bhattacharya
Jul, 2022 | 306 pages
Small book image
Deep Learning and XAI Techniques for Anomaly Detection
Cher Simon
Jan, 2023 | 218 pages
Table of Contents (16 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
1
Explaining Artificial Intelligence with Python
Explaining Artificial Intelligence with Python
Defining explainable AI
Designing and extracting
The XAI medical diagnosis timeline
Summary
Questions
References
Further reading
Free Chapter
2
White Box XAI for AI Bias and Ethics
White Box XAI for AI Bias and Ethics
Moral AI bias in self-driving cars
Standard explanation of autopilot decision trees
XAI applied to an autopilot decision tree
Using XAI and ethics to control a decision tree
Summary
Questions
References
Further reading
3
Explaining Machine Learning with Facets
Explaining Machine Learning with Facets
Getting started with Facets
Facets Overview
Sorting the Facets statistics overview
Facets Dive
Summary
Questions
References
Further reading
4
Microsoft Azure Machine Learning Model Interpretability with SHAP
Microsoft Azure Machine Learning Model Interpretability with SHAP
Introduction to SHAP
Getting started with SHAP
Linear models and logistic regression
Summary
Questions
References
Further reading
5
Building an Explainable AI Solution from Scratch
Building an Explainable AI Solution from Scratch
Moral, ethical, and legal perspectives
The U.S. census data problem
The machine learning perspective
WIT applied to a transformed dataset
Summary
Questions
References
Further reading
6
AI Fairness with Google's What-If Tool (WIT)
AI Fairness with Google's What-If Tool (WIT)
Interpretability and explainability from an ethical AI perspective
Getting started with WIT
Creating a DNN model
Creating a SHAP explainer
Model outputs and SHAP values
The WIT datapoint explorer and editor
Summary
Questions
References
Further reading
7
A Python Client for Explainable AI Chatbots
A Python Client for Explainable AI Chatbots
The Python client for Dialogflow
Enhancing the Google Dialogflow Python client
A CUI XAI dialog using Google Dialogflow
Summary
Questions
Further reading
8
Local Interpretable Model-Agnostic Explanations (LIME)
Local Interpretable Model-Agnostic Explanations (LIME)
Introducing LIME
Getting started with LIME
An experimental AutoML module
Interpreting the scores
Training the model and making predictions
The LIME explainer
Summary
Questions
References
Further reading
9
The Counterfactual Explanations Method
The Counterfactual Explanations Method
The counterfactual explanations method
The choice of distance functions
The architecture of the deep learning model
Summary
Questions
References
Further reading
10
Contrastive XAI
Contrastive XAI
The contrastive explanations method
Getting started with the CEM applied to MNIST
Defining and training the CNN model
Defining and training the autoencoder
Pertinent negatives
Summary
Questions
References
Further reading
11
Anchors XAI
Anchors XAI
Anchors AI explanations
Anchor explanations for ImageNet
Summary
Questions
References
Further reading
12
Cognitive XAI
Cognitive XAI
Cognitive rule-based explanations
A cognitive approach to vectorizers
Human cognitive input for the CEM
Summary
Questions
Further reading
13
Answers to the Questions
Chapter 1, Explaining Artificial Intelligence with Python
Chapter 2, White Box XAI for AI Bias and Ethics
Chapter 3, Explaining Machine Learning with Facets
Chapter 4, Microsoft Azure Machine Learning Model Interpretability with SHAP
Chapter 5, Building an Explainable AI Solution from Scratch
Chapter 6, AI Fairness with Google's What-If Tool (WIT)
Chapter 7, A Python Client for Explainable AI Chatbots
Chapter 8, Local Interpretable Model-Agnostic Explanations (LIME)
Chapter 9, The Counterfactual Explanations Method
Chapter 10, Contrastive XAI
Chapter 11, Anchors XAI
Chapter 12, Cognitive XAI
14
Other Books You May Enjoy
Other Books You May Enjoy
15
Index
Index

Facets Dive

The ability to verify the ground truth of data distributions is critical in supervised learning. Supervised ML involves training datasets with labels. These labels constitute the target values. An ML algorithm will be trained to predict them. However, some or all of the labels might be wrong. The accuracy of the predictions might not be sufficient.

With Facets Dive, we can explore a large number of data points interactively and analyze their relationships.

Building the Facets Dive display code

We first import the display and HTML modules from IPython:

# Display the Dive visualization for the training data
from IPython.core.display import display, HTML

The next step is to convert a pandas DataFrame containing the training or testing data into JSON. You can run an example that was inserted in the notebook before continuing:

# @title Python to_json example {display-mode: "form"}
from IPython.core.display import display, HTML
jsonstr = train_data...
Previous Section
End of Section 5
Next Section