Book Image

Python: Advanced Guide to Artificial Intelligence

By : Giuseppe Bonaccorso, Rajalingappaa Shanmugamani
Book Image

Python: Advanced Guide to Artificial Intelligence

By: Giuseppe Bonaccorso, Rajalingappaa Shanmugamani

Overview of this book

This Learning Path is your complete guide to quickly getting to grips with popular machine learning algorithms. You'll be introduced to the most widely used algorithms in supervised, unsupervised, and semi-supervised machine learning, and learn how to use them in the best possible manner. Ranging from Bayesian models to the MCMC algorithm to Hidden Markov models, this Learning Path will teach you how to extract features from your dataset and perform dimensionality reduction by making use of Python-based libraries. You'll bring the use of TensorFlow and Keras to build deep learning models, using concepts such as transfer learning, generative adversarial networks, and deep reinforcement learning. Next, you'll learn the advanced features of TensorFlow1.x, such as distributed TensorFlow with TF clusters, deploy production models with TensorFlow Serving. You'll implement different techniques related to object classification, object detection, image segmentation, and more. By the end of this Learning Path, you'll have obtained in-depth knowledge of TensorFlow, making you the go-to person for solving artificial intelligence problems This Learning Path includes content from the following Packt products: • Mastering Machine Learning Algorithms by Giuseppe Bonaccorso • Mastering TensorFlow 1.x by Armando Fandango • Deep Learning for Computer Vision by Rajalingappaa Shanmugamani
Table of Contents (31 chapters)
Title Page
About Packt
Contributors
Preface
19
Tensor Processing Units
Index

TensorFlow clusters


A TensorFlow (TF) cluster is one mechanism that implements the distributed strategies that we have just discussed. At the logical level, a TF cluster runs one or more jobs, and each job consists of one or more tasks. Thus a job is just a logical grouping of the tasks. At the process level, each task runs as a TF server. At the machine level, each physical machine or node can run more than one task by running more than one server, one server per task. The client creates the graph on different servers and starts the execution of the graph on one server by calling the remote session.

As an example, the following diagram depicts two clients connected to two jobs named m1:

The two nodes are running three tasks each, and the job w1 is spread across two nodes while the other jobs are contained within the nodes.

Note

A TF server is implemented as two processes: master and worker. The master coordinates the computation with other tasks and the worker is the one actually running the...