Book Image

Mastering Probabilistic Graphical Models with Python

By : Ankur Ankan
Book Image

Mastering Probabilistic Graphical Models with Python

By: Ankur Ankan

Overview of this book

Related Content you might be interested in

Current Title:

Small book image
Mastering Probabilistic Graphical Models with Python
Ankur Ankan
Aug, 2015 | 284 pages
No titles found
Table of Contents (14 chapters)
Mastering Probabilistic Graphical Models Using Python
Mastering Probabilistic Graphical Models Using Python
Credits
Credits
About the Authors
About the Authors
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Bayesian Network Fundamentals
Bayesian Network Fundamentals
Probability theory
Installing tools
Representing independencies using pgmpy
Representing joint probability distributions using pgmpy
Conditional probability distribution
Graph theory
Bayesian models
Relating graphs and distributions
CPD representations
Summary
2
Markov Network Fundamentals
Markov Network Fundamentals
Introducing the Markov network
The factor graph
Independencies in Markov networks
Constructing graphs from distributions
Bayesian and Markov networks
Summary
3
Inference – Asking Questions to Models
Inference – Asking Questions to Models
Inference
Variable elimination
Belief propagation
MAP using variable elimination
Factor maximization
MAP using belief propagation
Finding the most probable assignment
Predictions from the model using pgmpy
A comparison of variable elimination and belief propagation
Summary
4
Approximate Inference
Approximate Inference
The optimization problem
The energy function
Exact inference as an optimization
The propagation-based approximation algorithm
Propagation with approximate messages
Sampling-based approximate methods
Forward sampling
Conditional probability distribution
Likelihood weighting and importance sampling
Importance sampling
Importance sampling in Bayesian networks
Markov chain Monte Carlo methods
Gibbs sampling
The multiple transitioning model
Using a Markov chain
Collapsed particles
Collapsed importance sampling
Summary
5
Model Learning – Parameter Estimation in Bayesian Networks
Model Learning – Parameter Estimation in Bayesian Networks
General ideas in learning
Learning as an optimization
Discriminative versus generative training
Parameter learning
Bayesian parameter estimation
Structure learning in Bayesian networks
The Bayesian score for Bayesian networks
Summary
6
Model Learning – Parameter Estimation in Markov Networks
Model Learning – Parameter Estimation in Markov Networks
Maximum likelihood parameter estimation
Summary
7
Specialized Models
Specialized Models
The Naive Bayes model
Dynamic Bayesian networks
The Hidden Markov model
Applications
Summary
Index
Index

Chapter 2. Markov Network Fundamentals

In the previous chapter, we saw how we can represent a joint probability distribution (JPD) using a directed graph and a set of conditional probability distributions (CPDs). However, it's not always possible to capture the independencies of a distribution using a Bayesian model. In this chapter, we will introduce undirected models, also known as Markov networks. We generally use Markov networks when we can't naturally define directionality in the interaction between random variables.

In this chapter, we will cover:

  • The basics of factors and their operations

  • The Markov model and Gibbs distribution

  • The factor graph

  • Independencies in the Markov model

  • Conversion of the Bayesian model to the Markov model and vice versa

  • Chordal graphs and triangulation heuristics

Previous Section
End of Section 1
Next Section