Book Image

Applied Machine Learning Explainability Techniques

By : Aditya Bhattacharya
Book Image

Applied Machine Learning Explainability Techniques

By: Aditya Bhattacharya

Overview of this book

Explainable AI (XAI) is an emerging field that brings artificial intelligence (AI) closer to non-technical end users. XAI makes machine learning (ML) models transparent and trustworthy along with promoting AI adoption for industrial and research use cases. Applied Machine Learning Explainability Techniques comes with a unique blend of industrial and academic research perspectives to help you acquire practical XAI skills. You'll begin by gaining a conceptual understanding of XAI and why it's so important in AI. Next, you'll get the practical experience needed to utilize XAI in AI/ML problem-solving processes using state-of-the-art methods and frameworks. Finally, you'll get the essential guidelines needed to take your XAI journey to the next level and bridge the existing gaps between AI and end users. By the end of this ML book, you'll be equipped with best practices in the AI/ML life cycle and will be able to implement XAI methods and approaches using Python to solve industrial problems, successfully addressing key pain points encountered.
Table of Contents (16 chapters)
1
Section 1 – Conceptual Exposure
5
Section 2 – Practical Problem Solving
12
Section 3 –Taking XAI to the Next Level

Model-agnostic explainability using KernelExplainer

In the previous sections, we have discussed three model-specific explainers available in SHAP – TreeExplainer, GradientExplainer, and DeepExplainer. The KernelExplainer in SHAP actually makes SHAP a model-agnostic explainability approach. However, unlike the previous methods, KernelExplainer based on the Kernel SHAP algorithm is much slower, especially for large and high dimensional datasets. Kernel SHAP tries to combine ideas from Shapley values and Local Interpretable Model-agnostic Explanations (LIME) for both global and local interpretability of black-box models. Similar to the approach followed in LIME, the Kernel SHAP algorithm also creates locally linear perturbed samples and computes Shapley values of the same to identify features contributing to or against the model prediction.

KernelExplainer is the practical implementation of the Kernel SHAP algorithm. The complete tutorial demonstrating the application of SHAP...