Book Image

Scalable Data Architecture with Java

By : Sinchan Banerjee
Book Image

Scalable Data Architecture with Java

By: Sinchan Banerjee

Overview of this book

Java architectural patterns and tools help architects to build reliable, scalable, and secure data engineering solutions that collect, manipulate, and publish data. This book will help you make the most of the architecting data solutions available with clear and actionable advice from an expert. You’ll start with an overview of data architecture, exploring responsibilities of a Java data architect, and learning about various data formats, data storage, databases, and data application platforms as well as how to choose them. Next, you’ll understand how to architect a batch and real-time data processing pipeline. You’ll also get to grips with the various Java data processing patterns, before progressing to data security and governance. The later chapters will show you how to publish Data as a Service and how you can architect it. Finally, you’ll focus on how to evaluate and recommend an architecture by developing performance benchmarks, estimations, and various decision metrics. By the end of this book, you’ll be able to successfully orchestrate data architecture solutions using Java and related technologies as well as to evaluate and present the most suitable solution to your clients.
Table of Contents (19 chapters)
1
Section 1 – Foundation of Data Systems
5
Section 2 – Building Data Processing Pipelines
11
Section 3 – Enabling Data as a Service
14
Section 4 – Choosing Suitable Data Architecture

Enabling API management over the DaaS API using AWS API Gateway

In this section, we will discuss how to set up API management using AWS API Gateway. We will use the REST DaaS API that we developed and deployed in ECS earlier in this chapter. Follow these steps to set up an API management layer for our REST DaaS API:

  1. In the AWS Management Console, search for AWS API Gateway and navigate to the AWS API Gateway service dashboard. From here, select REST API and click Build, as shown in the following screenshot:

Figure 9.25 – The AWS API Gateway dashboard

  1. A new window will open, as shown in the following screenshot. Select REST as the protocol and then select New API under Create new API. Fill in the API’s name and a description and click Create API:

Figure 9.26 – Creating a REST API

  1. Once the resource has been created, we will be taken to the details of the API. We can add resources or methods...