Book Image

DynamoDB Cookbook

By : Tanmay Deshpande
Book Image

DynamoDB Cookbook

By: Tanmay Deshpande

Overview of this book

Table of Contents (18 chapters)
DynamoDB Cookbook
Credits
About the Author
Acknowledgments
About the Reviewers
www.PacktPub.com
Preface
Index

Exporting data from AWS S3 to DynamoDB using AWS Data Pipeline


In this recipe, we will see how to export data from the DynamoDB table to S3 using the AWS Pipeline.

Getting ready

To get started, you need to have a table created and add a few entries to it.

How to do it…

Let's start with creating a pipeline that accepts the details, which can be used anytime we want to execute the export operation:

  1. Go to the AWS Data Pipeline console (https://console.aws.amazon.com/datapipeline/).

  2. Click on the Create Pipeline button. Enter the details of the data pipeline configurations in the form, as shown in the following screenshot. Here, we will add details, such as the pipeline name, description, source DynamoDB table name, target S3 folder, and so on. We select a built-in template to export the DynamoDB data to S3:

  3. Next, we need to provide the details of enabling the logging. Here, we need to provide the S3 folder location so that if there are any errors and issues, we should be able to debug them from the...