Book Image

Connecting the Data: Data Integration Techniques for Building an Operational Data Store (ODS)

By : Angelo Bobak

Book Image

Connecting the Data: Data Integration Techniques for Building an Operational Data Store (ODS)

By: Angelo Bobak

Overview of this book

When organizations change or enhance their internal structures, business data integration is a complex problem that they must resolve. This book describes the common hurdles you might face while working with data integration and shows you various ways to overcome these challenges. The book begins by explaining the foundational concepts of ODS. Once familiar with schema integration, you?ll learn how to reverse engineer each data source for creating a set of data dictionary reports. These reports will provide you with the metadata necessary to apply the schema integration process. As you progress through the chapters, you will learn how to write scripts for populating the source databases and spreadsheets, as well as how to use reports to create Extract, Transform, and Load (ETL) specifications. By the end of the book, you will have the knowledge necessary to design and build a small ODS.

Preface

Who this book is for

What this book covers

To get the most out of this book

Download the example code files

Download the color images

Conventions used

Free Chapter

Section 1: Site Reliability Engineering – A Prescriptive Way to Implement DevOps

Section 1: Site Reliability Engineering – A Prescriptive Way to Implement DevOps

Chapter 1: DevOps, SRE, and Google Cloud Services for CI/CD

Chapter 1: DevOps, SRE, and Google Cloud Services for CI/CD

Understanding DevOps, its evolution, and life cycle

SRE's evolution; technical and cultural practices

Cloud-native approach to implementing DevOps using Google Cloud

Points to remember

Further reading

Chapter 2: SRE Technical Practices – Deep Dive

Chapter 2: SRE Technical Practices – Deep Dive

Defining reliability expectations via SLOs

Understanding error budgets

Eliminating toil through automation

Illustrating the impact of SLAs, SLOs, and error budgets relative to SLI

Points to remember

Further reading

Chapter 3: Understanding Monitoring and Alerting to Target Reliability

Chapter 3: Understanding Monitoring and Alerting to Target Reliability

Understanding monitoring

Points to remember

Further reading

Chapter 4: Building SRE Teams and Applying Cultural Practices

Chapter 4: Building SRE Teams and Applying Cultural Practices

Building SRE teams

Incident management

Psychological safety

Sharing vision and knowledge and fostering collaboration

Points to remember

Further reading

Section 2: Google Cloud Services to Implement DevOps via CI/CD

Section 2: Google Cloud Services to Implement DevOps via CI/CD

Chapter 5: Managing Source Code Using Cloud Source Repositories

Chapter 5: Managing Source Code Using Cloud Source Repositories

Technical requirements

Introducing the key features

One-way sync from GitHub/Bitbucket to CSR

Common operations in CSR

Hands-on lab – integrating with Cloud Functions

Further reading

Chapter 6: Building Code Using Cloud Build, and Pushing to Container Registry

Chapter 6: Building Code Using Cloud Build, and Pushing to Container Registry

Technical requirements

Key terminology (prerequisites)

Understanding the need for automation

Building and creating container images – Cloud Build

Managing build artifacts – Container Registry

Hands-on lab – building, creating, pushing, and deploying a container to Cloud Run using Cloud Build triggers

Points to remember

Further reading

Chapter 7: Understanding Kubernetes Essentials to Deploy Containerized Applications

Chapter 7: Understanding Kubernetes Essentials to Deploy Containerized Applications

Technical requirements

Kubernetes – a quick introduction

Kubernetes cluster anatomy

Kubernetes objects

Scheduling and interacting with Pods

Kubernetes deployment strategies

Points to remember

Further reading

Chapter 8: Understanding GKE Essentials to Deploy Containerized Applications

Chapter 8: Understanding GKE Essentials to Deploy Containerized Applications

Technical requirements

Google Kubernetes Engine (GKE) – introduction

GKE – core features

GKE Autopilot – hands-on lab

Points to remember

Further reading

Chapter 9: Securing the Cluster Using GKE Security Constructs

Chapter 9: Securing the Cluster Using GKE Security Constructs

Technical requirements

Essential security patterns in Kubernetes

Hardening cluster security in GKE

Points to remember

Further reading

Chapter 10: Exploring GCP Cloud Operations

Chapter 10: Exploring GCP Cloud Operations

Cloud Monitoring

Binding SRE and Cloud Operations

Points to remember

Further reading

Mock Exam 1

Total Number of Questions: 50

Mock Exam 2

Total Number of Questions: 50

Other Books You May Enjoy

Other Books You May Enjoy

Packt is searching for authors like you

Leave a review - let other readers know what you think

Appendix: Getting Ready for Professional Cloud DevOps Engineer Certification

Appendix: Getting Ready for Professional Cloud DevOps Engineer Certification

Cloud Deployment Manager

Customer Reviews

5 star

0

4 star

0

3 star

0

2 star

0

1 star

0

Hardening cluster security in GKE

Securing the Kubernetes cluster should be your topmost priority when it comes to securing applications running inside your cluster. GKE supports many such features to harden the cluster. For example, the GKE control plane is patched and upgraded automatically as part of the shared responsibility model. In addition, node auto-upgrades are also enabled for a newly created GKE cluster.

The following are some key additional GKE features that can be used to secure and harden clusters. Some of these features are enabled by default while you're creating a GKE cluster:

GKE supports a cluster type called Private Cluster, which provides options to restrict access to control planes and nodes. This needs to be specified at the time of cluster creation.
GKE supports container-optimized OS images. It is a container-optimized OS that has been custom-built, optimized, and hardened specifically for running containers.
GKE supports shielded GKE...