Book Image

Google Cloud Platform for Architects

By : Vitthal Srinivasan, Loonycorn , Judy Raj
Book Image

Google Cloud Platform for Architects

By: Vitthal Srinivasan, Loonycorn , Judy Raj

Overview of this book

Using a public cloud platform was considered risky a decade ago, and unconventional even just a few years ago. Today, however, use of the public cloud is completely mainstream - the norm, rather than the exception. Several leading technology firms, including Google, have built sophisticated cloud platforms, and are locked in a fierce competition for market share. The main goal of this book is to enable you to get the best out of the GCP, and to use it with confidence and competence. You will learn why cloud architectures take the forms that they do, and this will help you become a skilled high-level cloud architect. You will also learn how individual cloud services are configured and used, so that you are never intimidated at having to build it yourself. You will also learn the right way and the right situation in which to use the important GCP services. By the end of this book, you will be able to make the most out of Google Cloud Platform design.
Table of Contents (19 chapters)
13
Logging and Monitoring

Use case – offline ingestion options

Say you have a few hundred TB of on-premise data and a really slow network connection. Getting the data onto the cloud is a formidable task—particularly if you are using a VPN to connect on-premise to the cloud, further slowing your connectivity. To make things easier in such situations, Google offers offline ingestion options that roughly correspond to Snowball and Snowmobile from AWS.

It may be sufficient for you to merely know that such options exist, if you care about the fine print, please read on, otherwise feel free to skip to the end of the chapter:

  • Data Preparation: Store and/or prepare your data. This can mean arranging it in servers, creating backup images, network settings, or even databases for machine learning:
    • The data should be arranged in the form of non-nested directories (in case of GCS), which then would...