Book Image

DynamoDB Cookbook

By : Tanmay Deshpande
Book Image

DynamoDB Cookbook

By: Tanmay Deshpande

Overview of this book

Related Content you might be interested in

Current Title:

Small book image
DynamoDB Cookbook
Tanmay Deshpande
Sep, 2015 | 266 pages
No titles found
Table of Contents (18 chapters)
DynamoDB Cookbook
DynamoDB Cookbook
Credits
Credits
About the Author
About the Author
Acknowledgments
Acknowledgments
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Taking Your First Steps with DynamoDB
Taking Your First Steps with DynamoDB
Introduction
Signing up to the DynamoDB console
Creating the DynamoDB table using the console
Loading data into the table using the console
Querying data using the DynamoDB console
Deleting the DynamoDB table using the console
Analyzing DynamoDB metric on CloudWatch
Downloading and setting up DynamoDB Local
Using DynamoDB Local JavaScript Shell
Setting up AWS Command Line Interface for DynamoDB
Setting up the Eclipse IDE
2
Operating with DynamoDB Tables
Operating with DynamoDB Tables
Introduction
Creating a table using the AWS SDK for Java
Creating a table using the AWS SDK for .Net
Creating a table using the AWS SDK for PHP
Updating a table using the AWS SDK for Java
Updating a table using the AWS SDK for .Net
Updating a table using the AWS SDK for PHP
Listing tables using the AWS SDK for Java
Listing tables using the AWS SDK for .Net
Listing tables using the AWS SDK for PHP
Deleting a table using the AWS SDK for Java
Deleting a table using the AWS SDK for .Net
Deleting a table using the AWS SDK for PHP
3
Manipulating DynamoDB Items
Manipulating DynamoDB Items
Introduction
Putting an item into the DynamoDB table using the AWS SDK for Java
Putting an item into the DynamoDB table using the AWS SDK for .Net
Putting an item into the DynamoDB table using the AWS SDK for PHP
Getting an item from the DynamoDB table using the AWS SDK for Java
Getting an item from the DynamoDB table using the AWS SDK for .Net
Getting an item from the DynamoDB table using the AWS SDK for PHP
Updating an item in the DynamoDB table using the AWS SDK for Java
Updating an item in the DynamoDB table using the AWS SDK for .Net
Updating an item in the DynamoDB table using the AWS SDK for PHP
Deleting an item from the DynamoDB table using the AWS SDK for Java
Deleting an item from the DynamoDB table using the AWS SDK for .Net
Deleting an item from the DynamoDB table using the AWS SDK for PHP
Getting multiple items using the AWS SDK for Java
Getting multiple items using the AWS SDK for .Net
Getting multiple items using the AWS SDK for PHP
Batch write operations using the AWS SDK for Java
Batch write operations using the AWS SDK for .Net
Batch write operations using the AWS SDK for PHP
4
Managing DynamoDB Indexes
Managing DynamoDB Indexes
Introduction
Creating a DynamoDB table with a Global Secondary Index using the AWS SDK for Java
Creating a DynamoDB table with a Global Secondary Index using the AWS SDK for .Net
Creating a DynamoDB table with a Global Secondary Index using the AWS SDK for PHP
Querying a Global Secondary Index using the AWS SDK for Java
Querying a Global Secondary Index using the AWS SDK for .Net
Querying a Global Secondary Index using the AWS SDK for PHP
Creating a DynamoDB table with a Local Secondary Index using the AWS SDK for Java
Creating a DynamoDB table with a Local Secondary Index using the AWS SDK for .Net
Creating a DynamoDB table with a Local Secondary Index using the AWS SDK for PHP
Querying a Local Secondary Index using the AWS SDK for Java
Querying a Local Secondary Index using the AWS SDK for .Net
Querying a Local Secondary Index using the AWS SDK for PHP
Using a Global Secondary Index for quick lookups
5
Exploring Higher Level Programming Interfaces for DynamoDB
Exploring Higher Level Programming Interfaces for DynamoDB
Introduction
Creating a data model for the DynamoDB item using the object persistence model in Java
Putting items into the DynamoDB table using the object persistence model in Java
Retrieving items from the DynamoDB table using the object persistence model in Java
Creating a custom object for the DynamoDB table using the object persistence model in Java
Querying items from the DynamoDB table using the object persistence model in Java
Scanning items from the DynamoDB table using the object persistence model in Java
Saving items into the DynamoDB table using the object persistence model in .Net
Retrieving items from the DynamoDB table using the object persistence model in .Net
Creating a custom object for the DynamoDB table using the object persistence model in .Net
Querying items from the DynamoDB table using the object persistence model in .Net
Scanning items from the DynamoDB table using the object persistence model in .Net
6
Securing DynamoDB
Securing DynamoDB
Introduction
Creating users using AWS IAM
Creating a DynamoDB full access group using AWS IAM
Creating a DynamoDB read-only group using AWS IAM
Validating the DynamoDB access controls using the AWS IAM policy simulator
Creating the custom policy to allow the DynamoDB console access using AWS IAM
Creating a fine-grained access control policy using AWS IAM
Implementing the client-side encryption for the DynamoDB data
Implementing the client-side masking for the DynamoDB data
7
DynamoDB Best Practices
DynamoDB Best Practices
Introduction
Using a standalone cache for frequently accessed items
Using the AWS ElastiCache for frequently accessed items
Compressing large data before storing it in DynamoDB
Using AWS S3 for storing large items
Catching DynamoDB errors
Performing auto-retries on DynamoDB errors
Performing atomic transactions on DynamoDB tables
Performing asynchronous requests to DynamoDB
8
Integrating DynamoDB with other AWS Services
Integrating DynamoDB with other AWS Services
Introduction
Importing data from AWS S3 to DynamoDB using AWS Data Pipeline
Exporting data from AWS S3 to DynamoDB using AWS Data Pipeline
Accessing the DynamoDB data using AWS EMR
Querying the DynamoDB data using AWS EMR
Performing join operations on the DynamoDB data using AWS EMR
Exporting data to AWS S3 from DynamoDB using AWS EMR
Logging DynamoDB operations using AWS CloudTrail
Exporting the DynamoDB data to AWS Redshift
Importing the DynamoDB data to AWS CloudSearch
Performing a full text search on the DynamoDB data using CloudSearch
9
Developing Web Applications using DynamoDB
Developing Web Applications using DynamoDB
Introduction
Performing data modeling and table creations
Developing services for the sign-up activity for web applications
Developing services for the sign-in activity for web applications
Developing services for the Address Book application
Deploying web applications on AWS Elastic Beanstalk
10
Developing Mobile Applications using DynamoDB
Developing Mobile Applications using DynamoDB
Introduction
Performing data modeling and table creation
Creating an identity pool using AWS Cognito
Creating the access policy and applying it to the AWS Cognito role
Implementing user registration services
Implementing user login services
Implementing add new contact services
Implementing view contacts services
Index
Index

Importing data from AWS S3 to DynamoDB using AWS Data Pipeline

In this recipe, we will see how to import data from AWS S3 and insert it into the DynamoDB table using AWS Data Pipeline. AWS Data Pipeline helps us create various workflows that can be used to manage the data flow between various AWS services. You can read more about AWS pipeline at https://aws.amazon.com/datapipeline/.

Getting ready

To get started with this recipe, you should know how to use the DynamoDB console. Also, you should have created a table called productTable, and you should also have an AWS S3 bucket containing the data to be imported to DynamoDB. The data needs to be in a special format so that the process should be able to identify the attributes and its data types easily. Here is the sample data:

features{"m":{"screen":{"s":"4.7\" LED-backlit IPS LCD Multi-Touchscreen Shatter proof glass"},"camera":{"s":"8MP"},"intMem":{"s":"128GB"},"processor":{"s":"Dual-Core 1.4 GHz Cyclone (ARM v8-based)"}}}id{"s":"2"}price{...
Previous Section
End of Section 3
Next Section