Book Image

Data Engineering with Alteryx

By : Paul Houghton
Book Image

Data Engineering with Alteryx

By: Paul Houghton

Overview of this book

Alteryx is a GUI-based development platform for data analytic applications. Data Engineering with Alteryx will help you leverage Alteryx’s code-free aspects which increase development speed while still enabling you to make the most of the code-based skills you have. This book will teach you the principles of DataOps and how they can be used with the Alteryx software stack. You’ll build data pipelines with Alteryx Designer and incorporate the error handling and data validation needed for reliable datasets. Next, you’ll take the data pipeline from raw data, transform it into a robust dataset, and publish it to Alteryx Server following a continuous integration process. By the end of this Alteryx book, you’ll be able to build systems for validating datasets, monitoring workflow performance, managing access, and promoting the use of your data sources.
Table of Contents (18 chapters)
1
Part 1: Introduction
5
Part 2: Functional Steps in DataOps
11
Part 3: Governance of DataOps

Summary

In this chapter, we investigated the different methods for testing a workflow and the data outputs. We learned how the Message and Test tools could be used to identify exceptions in your workflows. We also saw how those Test tools had been used in the CREW macros to extend the messaging capability for workflow analysis.

We then learned how to automate the validation of data outputs and generate a notification based on the results. We also used our skills to apply an outlier monitoring process to a dataset.

Finally, we learned how to centralize the monitoring of a workflow process and generate an insights dashboard. We learned how publishing that insight and the associated workflow could make the monitoring process available for other people to access.

In the next chapter, we will learn how to apply the DataOps principles to the workflow publication process. We will learn the methods for monitoring the Alteryx Server environment and create a monitoring insights dashboard...