Book Image

Building Probabilistic Graphical Models with Python

By : Kiran R Karkera
Book Image

Building Probabilistic Graphical Models with Python

By: Kiran R Karkera

Overview of this book

<p>With the increasing prominence in machine learning and data science applications, probabilistic graphical models are a new tool that machine learning users can use to discover and analyze structures in complex problems. The variety of tools and algorithms under the PGM framework extend to many domains such as natural language processing, speech processing, image processing, and disease diagnosis.</p> <p>You've probably heard of graphical models before, and you're keen to try out new landscapes in the machine learning area. This book gives you enough background information to get started on graphical models, while keeping the math to a minimum.</p>
Table of Contents (15 chapters)
Building Probabilistic Graphical Models with Python
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Index

The factorization-independence tango


In the previous chapter, we understood that the two concepts of a graph and a distribution are both encoded in a graphical model. We now turn to the equivalence of factorization and independence, and we would like to know whether they are both respected in both the views, in the context of Markov nets.

The following are the questions that we wish to address:

  • The first one is if the two nodes are conditionally independent in the graph, does the distribution respect that independence?

  • The second one is that is the factorization (or decomposition) of a distribution into a graph a valid decomposition?

This is a theorem that has parallels from Bayesian networks. If a distribution P factorizes over a graph G, and suppose that two random variables X and Y are separated (in the graph G) given , then the distribution P satisfies the independence statement, and X is conditionally independent of Y given Z.

In other words, the independence defined by the graph H by the...