Book Image

Geospatial Data Analytics on AWS

By : Scott Bateman, Janahan Gnanachandran, Jeff DeMuth
Book Image

Geospatial Data Analytics on AWS

By: Scott Bateman, Janahan Gnanachandran, Jeff DeMuth

Overview of this book

Managing geospatial data and building location-based applications in the cloud can be a daunting task. This comprehensive guide helps you overcome this challenge by presenting the concept of working with geospatial data in the cloud in an easy-to-understand way, along with teaching you how to design and build data lake architecture in AWS for geospatial data. You’ll begin by exploring the use of AWS databases like Redshift and Aurora PostgreSQL for storing and analyzing geospatial data. Next, you’ll leverage services such as DynamoDB and Athena, which offer powerful built-in geospatial functions for indexing and querying geospatial data. The book is filled with practical examples to illustrate the benefits of managing geospatial data in the cloud. As you advance, you’ll discover how to analyze and visualize data using Python and R, and utilize QuickSight to share derived insights. The concluding chapters explore the integration of commonly used platforms like Open Data on AWS, OpenStreetMap, and ArcGIS with AWS to enable you to optimize efficiency and provide a supportive community for continuous learning. By the end of this book, you’ll have the necessary tools and expertise to build and manage your own geospatial data lake on AWS, along with the knowledge needed to tackle geospatial data management challenges and make the most of AWS services.
Table of Contents (23 chapters)
1
Part 1: Introduction to the Geospatial Data Ecosystem
4
Part 2: Geospatial Data Lakes using Modern Data Architecture
10
Part 3: Analyzing and Visualizing Geospatial Data in AWS
16
Part 4: Accessing Open Source and Commercial Platforms and Services

Accessing OSM from AWS

There are several ways that the AWS platform can integrate nicely with OSM. Current planet data can be accessed and filtered, while changesets showing historical modifications provide additional insight into how geospatial data has changed over time. Thanks to numerous white papers and blog posts on the topic since the AWS Public Datasets program released access in 2017, accessing OSM from within AWS is surprisingly simple.

As with many other data exploration examples in this book, Amazon Athena will be used. Athena is a great AWS service for exploring geospatial data since it can access a wide range of source data. Unstructured, semi-structured, and structured data stored in S3 or other formats can be structured into tables and views that query the data from the source location. Because OSM data is hosted on S3, Athena integrates well with OSM. If you plan to follow along with these examples, make sure Athena is configured with an S3 bucket for the results...