Book Image

Data Engineering with Alteryx

By : Paul Houghton
Book Image

Data Engineering with Alteryx

By: Paul Houghton

Overview of this book

Alteryx is a GUI-based development platform for data analytic applications. Data Engineering with Alteryx will help you leverage Alteryx’s code-free aspects which increase development speed while still enabling you to make the most of the code-based skills you have. This book will teach you the principles of DataOps and how they can be used with the Alteryx software stack. You’ll build data pipelines with Alteryx Designer and incorporate the error handling and data validation needed for reliable datasets. Next, you’ll take the data pipeline from raw data, transform it into a robust dataset, and publish it to Alteryx Server following a continuous integration process. By the end of this Alteryx book, you’ll be able to build systems for validating datasets, monitoring workflow performance, managing access, and promoting the use of your data sources.
Table of Contents (18 chapters)
1
Part 1: Introduction
5
Part 2: Functional Steps in DataOps
11
Part 3: Governance of DataOps

Chapter 6: Destination Management

After creating a dataset, we need to persist it to a location. The simplest place to save a dataset is as a local file, often an Excel or CSV file, but in business environments, storing the dataset in a database is a better solution.

In this chapter, we will explore the output options. We will investigate saving to a data source from the local Designer testing and what the differences are when publishing to the server.

In this chapter, we will cover the following topics:

  • Connecting to destinations locally
  • The process for integrating workflows across environments
  • Completing an example process to publish to a Snowflake destination