Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Data Engineering with Google Cloud Platform
  • Table Of Contents Toc
Data Engineering with Google Cloud Platform

Data Engineering with Google Cloud Platform - Second Edition

By : Adi Wijaya
4.5 (6)
close
close
Data Engineering with Google Cloud Platform

Data Engineering with Google Cloud Platform

4.5 (6)
By: Adi Wijaya

Overview of this book

The second edition of Data Engineering with Google Cloud builds upon the success of the first edition by offering enhanced clarity and depth to data professionals navigating the intricate landscape of data engineering. Beyond its foundational lessons, this new edition delves into the essential realm of data governance within Google Cloud, providing you with invaluable insights into managing and optimizing data resources effectively. Written by a Data Strategic Cloud Engineer at Google, this book helps you stay ahead of the curve by guiding you through the latest technological advancements in the Google Cloud ecosystem. You’ll cover essential aspects, from exploring Cloud Composer 2 to the evolution of Airflow 2.5. Additionally, you’ll explore how to work with cutting-edge tools like Dataform, DLP, Dataplex, Dataproc Serverless, and Datastream to perform data governance on datasets. By the end of this book, you'll be equipped to navigate the ever-evolving world of data engineering on Google Cloud, from foundational principles to cutting-edge practices.
Table of Contents (19 chapters)
close
close
Lock Free Chapter
1
Part 1: Getting Started with Data Engineering with GCP
4
Part 2: Build Solutions with GCP Components
11
Part 3: Key Strategies for Architecting Top-Notch Solutions

Building a Data Warehouse in BigQuery

The power of a data warehouse is that organizations can combine multiple sources of information into a single place that becomes a single source of truth. The dream of data analytics is the time when every single business aspect of an organization relies on data. That condition can be met when all business decision-makers know how to access data, trust the data, and can make decisions based on it.

Unfortunately, most of the time, dreams are far removed from reality. There are many challenges along the way. Based on my experience, there are three main challenges – technology bottlenecks, data consistency, and the ability to serve multiple business purposes.

The preceding challenges are natural when we build a data warehouse. They’re not limited to certain technologies and organizations. In this chapter, we will learn about those challenges through two hands-on scenarios. We will mainly use BigQuery as the GCP data warehouse cloud...

CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Data Engineering with Google Cloud Platform
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon