Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Scalable Data Streaming with Amazon Kinesis
  • Table Of Contents Toc
Scalable Data Streaming with Amazon Kinesis

Scalable Data Streaming with Amazon Kinesis

By : Makota, Brian Maguire, Gagne, Chakrabarti
5 (4)
close
close
Scalable Data Streaming with Amazon Kinesis

Scalable Data Streaming with Amazon Kinesis

5 (4)
By: Makota, Brian Maguire, Gagne, Chakrabarti

Overview of this book

Amazon Kinesis is a collection of secure, serverless, durable, and highly available purpose-built data streaming services. This data streaming service provides APIs and client SDKs that enable you to produce and consume data at scale. Scalable Data Streaming with Amazon Kinesis begins with a quick overview of the core concepts of data streams, along with the essentials of the AWS Kinesis landscape. You'll then explore the requirements of the use case shown through the book to help you get started and cover the key pain points encountered in the data stream life cycle. As you advance, you'll get to grips with the architectural components of Kinesis, understand how they are configured to build data pipelines, and delve into the applications that connect to them for consumption and processing. You'll also build a Kinesis data pipeline from scratch and learn how to implement and apply practical solutions. Moving on, you'll learn how to configure Kinesis on a cloud platform. Finally, you’ll learn how other AWS services can be integrated into Kinesis. These services include Redshift, Dynamo Database, AWS S3, Elastic Search, and third-party applications such as Splunk. By the end of this AWS book, you’ll be able to build and deploy your own Kinesis data pipelines with Kinesis Data Streams (KDS), Kinesis Data Firehose (KFH), Kinesis Video Streams (KVS), and Kinesis Data Analytics (KDA).
Table of Contents (13 chapters)
close
close
1
Section 1: Introduction to Data Streaming and Amazon Kinesis
5
Section 2: Deep Dive into Kinesis
10
Section 3: Integrations

Summary

In this chapter, we reviewed the features of Amazon KDF and how it can be used in data pipelines in common multi-account enterprise architectures. We saw how to do encryption, networking, authentication, and authorization with multiple Amazon and third-party services and software. We saw how Amazon KDF can be an integral part of any data analytics pipeline or data-lake architecture with its ability to easily ingest data from other AWS services including AWS IoT, Amazon CloudWatch Logs, Amazon CloudWatch Events, and KDS, do inline transformations using Lambda functions, and deliver to Amazon S3, Amazon Redshift, Amazon Elasticsearch, HTTP endpoints, and other third-party destinations. We also looked at the SmartCity bikes example and saw how to deliver records to Amazon S3 in a columnar Parquet format. It should now be clear how you can configure Amazon KDF for your use cases.

In the next chapter, we will look at other services under the Kinesis umbrella of services.

...
CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Scalable Data Streaming with Amazon Kinesis
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon