Book Image

Protocol Buffers Handbook

By : Clément Jean
Book Image

Protocol Buffers Handbook

By: Clément Jean

Overview of this book

Explore how Protocol Buffers (Protobuf) serialize structured data and provides a language-neutral, platform-neutral, and extensible solution. With this guide to mastering Protobuf, you'll build your skills to effectively serialize, transmit, and manage data across diverse platforms and languages. This book will help you enter the world of Protocol Buffers by unraveling the intricate nuances of Protobuf syntax and showing you how to define complex data structures. As you progress, you’ll learn schema evolution, ensuring seamless compatibility as your projects evolve. The book also covers advanced topics such as custom options and plugins, allowing you to tailor validation processes to your specific requirements. You’ll understand how to automate project builds using cutting-edge tools such as Buf and Bazel, streamlining your development workflow. With hands-on projects in Go and Python programming, you’ll learn how to practically apply Protobuf concepts. Later chapters will show you how to integrate data interchange capabilities across different programming languages, enabling efficient collaboration and system interoperability. By the end of this book, you’ll have a solid understanding of Protobuf internals, enabling you to discern when and how to use and redefine your approach to data serialization.
Table of Contents (13 chapters)

Why use the text format?

During the primer on serialization, we said that the main reason for using Protobuf is that it reduces the payload by serializing to binary. But remember that we also said that the very binary that saves us a lot of bandwidth can cost us in terms of readability. This is because it would take way more human effort to read the binary than to read the text directly.

To solve this problem, Protobuf can also serialize data to text. It can serialize data to JSON, for example, but for this book, the most interesting text format that it can serialize to is its own text format. There are several advantages to this text format, but let us first describe what the use cases are for having a text representation of your data.

The most obvious use case is for debugging. This is a stressful and not-so-enjoyable part of our job. We do not want to add extra complexity on top of the already complex process. As such, we try to make each payload clear by making them readable...