Book Image

DynamoDB Cookbook

By : Tanmay Deshpande
Book Image

DynamoDB Cookbook

By: Tanmay Deshpande

Overview of this book

Related Content you might be interested in

Current Title:

Small book image
DynamoDB Cookbook
Tanmay Deshpande
Sep, 2015 | 266 pages
No titles found
Table of Contents (18 chapters)
DynamoDB Cookbook
DynamoDB Cookbook
Credits
Credits
About the Author
About the Author
Acknowledgments
Acknowledgments
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Taking Your First Steps with DynamoDB
Taking Your First Steps with DynamoDB
Introduction
Signing up to the DynamoDB console
Creating the DynamoDB table using the console
Loading data into the table using the console
Querying data using the DynamoDB console
Deleting the DynamoDB table using the console
Analyzing DynamoDB metric on CloudWatch
Downloading and setting up DynamoDB Local
Using DynamoDB Local JavaScript Shell
Setting up AWS Command Line Interface for DynamoDB
Setting up the Eclipse IDE
2
Operating with DynamoDB Tables
Operating with DynamoDB Tables
Introduction
Creating a table using the AWS SDK for Java
Creating a table using the AWS SDK for .Net
Creating a table using the AWS SDK for PHP
Updating a table using the AWS SDK for Java
Updating a table using the AWS SDK for .Net
Updating a table using the AWS SDK for PHP
Listing tables using the AWS SDK for Java
Listing tables using the AWS SDK for .Net
Listing tables using the AWS SDK for PHP
Deleting a table using the AWS SDK for Java
Deleting a table using the AWS SDK for .Net
Deleting a table using the AWS SDK for PHP
3
Manipulating DynamoDB Items
Manipulating DynamoDB Items
Introduction
Putting an item into the DynamoDB table using the AWS SDK for Java
Putting an item into the DynamoDB table using the AWS SDK for .Net
Putting an item into the DynamoDB table using the AWS SDK for PHP
Getting an item from the DynamoDB table using the AWS SDK for Java
Getting an item from the DynamoDB table using the AWS SDK for .Net
Getting an item from the DynamoDB table using the AWS SDK for PHP
Updating an item in the DynamoDB table using the AWS SDK for Java
Updating an item in the DynamoDB table using the AWS SDK for .Net
Updating an item in the DynamoDB table using the AWS SDK for PHP
Deleting an item from the DynamoDB table using the AWS SDK for Java
Deleting an item from the DynamoDB table using the AWS SDK for .Net
Deleting an item from the DynamoDB table using the AWS SDK for PHP
Getting multiple items using the AWS SDK for Java
Getting multiple items using the AWS SDK for .Net
Getting multiple items using the AWS SDK for PHP
Batch write operations using the AWS SDK for Java
Batch write operations using the AWS SDK for .Net
Batch write operations using the AWS SDK for PHP
4
Managing DynamoDB Indexes
Managing DynamoDB Indexes
Introduction
Creating a DynamoDB table with a Global Secondary Index using the AWS SDK for Java
Creating a DynamoDB table with a Global Secondary Index using the AWS SDK for .Net
Creating a DynamoDB table with a Global Secondary Index using the AWS SDK for PHP
Querying a Global Secondary Index using the AWS SDK for Java
Querying a Global Secondary Index using the AWS SDK for .Net
Querying a Global Secondary Index using the AWS SDK for PHP
Creating a DynamoDB table with a Local Secondary Index using the AWS SDK for Java
Creating a DynamoDB table with a Local Secondary Index using the AWS SDK for .Net
Creating a DynamoDB table with a Local Secondary Index using the AWS SDK for PHP
Querying a Local Secondary Index using the AWS SDK for Java
Querying a Local Secondary Index using the AWS SDK for .Net
Querying a Local Secondary Index using the AWS SDK for PHP
Using a Global Secondary Index for quick lookups
5
Exploring Higher Level Programming Interfaces for DynamoDB
Exploring Higher Level Programming Interfaces for DynamoDB
Introduction
Creating a data model for the DynamoDB item using the object persistence model in Java
Putting items into the DynamoDB table using the object persistence model in Java
Retrieving items from the DynamoDB table using the object persistence model in Java
Creating a custom object for the DynamoDB table using the object persistence model in Java
Querying items from the DynamoDB table using the object persistence model in Java
Scanning items from the DynamoDB table using the object persistence model in Java
Saving items into the DynamoDB table using the object persistence model in .Net
Retrieving items from the DynamoDB table using the object persistence model in .Net
Creating a custom object for the DynamoDB table using the object persistence model in .Net
Querying items from the DynamoDB table using the object persistence model in .Net
Scanning items from the DynamoDB table using the object persistence model in .Net
6
Securing DynamoDB
Securing DynamoDB
Introduction
Creating users using AWS IAM
Creating a DynamoDB full access group using AWS IAM
Creating a DynamoDB read-only group using AWS IAM
Validating the DynamoDB access controls using the AWS IAM policy simulator
Creating the custom policy to allow the DynamoDB console access using AWS IAM
Creating a fine-grained access control policy using AWS IAM
Implementing the client-side encryption for the DynamoDB data
Implementing the client-side masking for the DynamoDB data
7
DynamoDB Best Practices
DynamoDB Best Practices
Introduction
Using a standalone cache for frequently accessed items
Using the AWS ElastiCache for frequently accessed items
Compressing large data before storing it in DynamoDB
Using AWS S3 for storing large items
Catching DynamoDB errors
Performing auto-retries on DynamoDB errors
Performing atomic transactions on DynamoDB tables
Performing asynchronous requests to DynamoDB
8
Integrating DynamoDB with other AWS Services
Integrating DynamoDB with other AWS Services
Introduction
Importing data from AWS S3 to DynamoDB using AWS Data Pipeline
Exporting data from AWS S3 to DynamoDB using AWS Data Pipeline
Accessing the DynamoDB data using AWS EMR
Querying the DynamoDB data using AWS EMR
Performing join operations on the DynamoDB data using AWS EMR
Exporting data to AWS S3 from DynamoDB using AWS EMR
Logging DynamoDB operations using AWS CloudTrail
Exporting the DynamoDB data to AWS Redshift
Importing the DynamoDB data to AWS CloudSearch
Performing a full text search on the DynamoDB data using CloudSearch
9
Developing Web Applications using DynamoDB
Developing Web Applications using DynamoDB
Introduction
Performing data modeling and table creations
Developing services for the sign-up activity for web applications
Developing services for the sign-in activity for web applications
Developing services for the Address Book application
Deploying web applications on AWS Elastic Beanstalk
10
Developing Mobile Applications using DynamoDB
Developing Mobile Applications using DynamoDB
Introduction
Performing data modeling and table creation
Creating an identity pool using AWS Cognito
Creating the access policy and applying it to the AWS Cognito role
Implementing user registration services
Implementing user login services
Implementing add new contact services
Implementing view contacts services
Index
Index

Exporting data to AWS S3 from DynamoDB using AWS EMR

In the first recipe of this chapter, we saw how to use the AWS Pipeline to export the DynamoDB data to S3. The AWS Pipeline creation and execution is easy and quick, but we have very little control on things that happen in the pipeline, so we now are going to talk about one recipe that will explain how to export the DynamoDB data to S3 using EMR.

Getting ready

To perform this recipe, you should have performed the earlier recipe and have your EMR cluster still running.

How to do it…

Let's export data to AWS S3 from DynamoDB:

  1. To perform this recipe, we need to create two tables. In the earlier recipes, we have already created productHiveTable, as shown in the following code:

    CREATE EXTERNAL TABLE productHiveTable (
id string, type string, mnfr string, name string,
price bigint, stock bigint)
STORED BY 'org.apache.hadoop.hive.dynamodb.DynamoDBStorageHandler'
TBLPROPERTIES ("dynamodb.table.name" = "product","dynamodb.column.mapping" = "id:id,type...
Previous Section
End of Section 8
Next Section