Book Image

Data Engineering with Alteryx

By : Paul Houghton
Book Image

Data Engineering with Alteryx

By: Paul Houghton

Overview of this book

Alteryx is a GUI-based development platform for data analytic applications. Data Engineering with Alteryx will help you leverage Alteryx’s code-free aspects which increase development speed while still enabling you to make the most of the code-based skills you have. This book will teach you the principles of DataOps and how they can be used with the Alteryx software stack. You’ll build data pipelines with Alteryx Designer and incorporate the error handling and data validation needed for reliable datasets. Next, you’ll take the data pipeline from raw data, transform it into a robust dataset, and publish it to Alteryx Server following a continuous integration process. By the end of this Alteryx book, you’ll be able to build systems for validating datasets, monitoring workflow performance, managing access, and promoting the use of your data sources.
Table of Contents (18 chapters)
Part 1: Introduction
Part 2: Functional Steps in DataOps
Part 3: Governance of DataOps

Publishing the external data to a Snowflake destination

In this section, we will take the places data that we downloaded in Chapter 5, Data Processing and Transformations, and upload it to a Snowflake database using the bulk loader. We chose a Snowflake account for two reasons. First, as a Premier Alteryx Technology partner, they are committed to creating and maintaining connections and tools to use with Alteryx. Secondly, they offer a trial account allowing anyone to try the database for free and have an account set up in minutes.

To achieve this, we will need to do the following:

  • Ensure we have the drivers for our database installed.
  • Configure the DSN connection.
  • Configure the output bulk load options.

These three are all that we need to complete the upload of our places dataset.

Installing the drivers

The drivers for Snowflake can be found in two ways. The first way is from the Alteryx Data Sources page seen in the following screenshot and which can...