Book Image

Learn TensorFlow Enterprise

By : KC Tung
Book Image

Learn TensorFlow Enterprise

By: KC Tung

Overview of this book

TensorFlow as a machine learning (ML) library has matured into a production-ready ecosystem. This beginner’s book uses practical examples to enable you to build and deploy TensorFlow models using optimal settings that ensure long-term support without having to worry about library deprecation or being left behind when it comes to bug fixes or workarounds. The book begins by showing you how to refine your TensorFlow project and set it up for enterprise-level deployment. You’ll then learn how to choose a future-proof version of TensorFlow. As you advance, you’ll find out how to build and deploy models in a robust and stable environment by following recommended practices made available in TensorFlow Enterprise. This book also teaches you how to manage your services better and enhance the performance and reliability of your artificial intelligence (AI) applications. You’ll discover how to use various enterprise-ready services to accelerate your ML and AI workflows on Google Cloud Platform (GCP). Finally, you’ll scale your ML models and handle heavy workloads across CPUs, GPUs, and Cloud TPUs. By the end of this TensorFlow book, you’ll have learned the patterns needed for TensorFlow Enterprise model development, data pipelines, training, and deployment.
Table of Contents (15 chapters)
1
Section 1 – TensorFlow Enterprise Services and Features
4
Section 2 – Data Preprocessing and Modeling
7
Section 3 – Scaling and Tuning ML Works
10
Section 4 – Model Optimization and Deployment

Submitting tuning jobs in Google's AI Platform

Now we are ready to use Google's AI Platform to perform hyperparameter training. You may download everything you need from the GitHub repository for this chapter. For the AI Platform code in this section, you can refer to the gcptuningwork file in this chapter's folder in the GitHub repository for the book.

In the cloud, we have access to powerful machines that can speed up our search process. Overall, the approach we will leverage is very similar to what we saw in the previous section about submitting a local Python script training job. We will use the tf.compat.v1.flag method to handle user input or flags. The rest of the script follows a similar structure, with the exception of data handling, because we will use TFRecord instead of ImageGenerator and a conditional flag for the distributed training strategy.

Since the tuning job is submitted to AI Platform from a remote node (that is, your local compute environment...