Book Image

Learn TensorFlow Enterprise

By : KC Tung
Book Image

Learn TensorFlow Enterprise

By: KC Tung

Overview of this book

TensorFlow as a machine learning (ML) library has matured into a production-ready ecosystem. This beginner’s book uses practical examples to enable you to build and deploy TensorFlow models using optimal settings that ensure long-term support without having to worry about library deprecation or being left behind when it comes to bug fixes or workarounds. The book begins by showing you how to refine your TensorFlow project and set it up for enterprise-level deployment. You’ll then learn how to choose a future-proof version of TensorFlow. As you advance, you’ll find out how to build and deploy models in a robust and stable environment by following recommended practices made available in TensorFlow Enterprise. This book also teaches you how to manage your services better and enhance the performance and reliability of your artificial intelligence (AI) applications. You’ll discover how to use various enterprise-ready services to accelerate your ML and AI workflows on Google Cloud Platform (GCP). Finally, you’ll scale your ML models and handle heavy workloads across CPUs, GPUs, and Cloud TPUs. By the end of this TensorFlow book, you’ll have learned the patterns needed for TensorFlow Enterprise model development, data pipelines, training, and deployment.
Table of Contents (15 chapters)
1
Section 1 – TensorFlow Enterprise Services and Features
4
Section 2 – Data Preprocessing and Modeling
7
Section 3 – Scaling and Tuning ML Works
10
Section 4 – Model Optimization and Deployment

Understanding TensorFlow Serving with Docker

At the core of TFS is actually a TensorFlow model server that runs a model Protobuf file. Installing the model server is not straightforward, as there are many dependencies. As a convenience, the TensorFlow team also provides this model server in a Docker container, which is a platform that uses virtualization at the operating system level, and it is self-contained with all the necessary dependencies (that is, libraries or modules) to run in an isolated environment.

Therefore, the easiest way to deploy a TensorFlow SavedModel is by means of TFS with a Docker container. To install Docker, you can refer to the Docker site (https://docs.docker.com/install/), along with the instructions for Mac, Windows, or Linux installations. For our chapter, a community version will suffice. We will be using Docker Desktop 2.4 running in macOS Catalina 10.15.6 with specs as indicated in Figure 9.1:

Figure 9.1 – The Docker...