Book Image

Mastering Geospatial Analysis with Python

By : Silas Toms, Paul Crickard, Eric van Rees
Book Image

Mastering Geospatial Analysis with Python

By: Silas Toms, Paul Crickard, Eric van Rees

Overview of this book

Python comes with a host of open source libraries and tools that help you work on professional geoprocessing tasks without investing in expensive tools. This book will introduce Python developers, both new and experienced, to a variety of new code libraries that have been developed to perform geospatial analysis, statistical analysis, and data management. This book will use examples and code snippets that will help explain how Python 3 differs from Python 2, and how these new code libraries can be used to solve age-old problems in geospatial analysis. You will begin by understanding what geoprocessing is and explore the tools and libraries that Python 3 offers. You will then learn to use Python code libraries to read and write geospatial data. You will then learn to perform geospatial queries within databases and learn PyQGIS to automate analysis within the QGIS mapping suite. Moving forward, you will explore the newly released ArcGIS API for Python and ArcGIS Online to perform geospatial analysis and create ArcGIS Online web maps. Further, you will deep dive into Python Geospatial web frameworks and learn to create a geospatial REST API.
Table of Contents (23 chapters)
Title Page
Copyright and Credits
Packt Upsell
Contributors
Preface
7
Geoprocessing with Geodatabases
Index

Chapter 16. Python Geoprocessing with Hadoop

Most of the examples in this book worked with relatively small datasets using a single computer. But as data gets larger, the datasets and even individual files may be spread out over a cluster of machines. Working with big data requires different tools. In this chapter, you will learn how to use Apache Hadoop to work with big data, and the Esri GIS tools for Hadoop to work with the big data spatially.

This chapter will teach you how to:

  • Install Linux
  • Install and run Docker
  • Install and configure a Hadoop environment
  • Work with files in HDFS
  • Basic queries using Hive
  • Install the Esri GIS tools for Hadoop
  • Perform spatial queries in Hive