Book Image

Data Engineering with Alteryx

By : Paul Houghton
Book Image

Data Engineering with Alteryx

By: Paul Houghton

Overview of this book

Alteryx is a GUI-based development platform for data analytic applications. Data Engineering with Alteryx will help you leverage Alteryx’s code-free aspects which increase development speed while still enabling you to make the most of the code-based skills you have. This book will teach you the principles of DataOps and how they can be used with the Alteryx software stack. You’ll build data pipelines with Alteryx Designer and incorporate the error handling and data validation needed for reliable datasets. Next, you’ll take the data pipeline from raw data, transform it into a robust dataset, and publish it to Alteryx Server following a continuous integration process. By the end of this Alteryx book, you’ll be able to build systems for validating datasets, monitoring workflow performance, managing access, and promoting the use of your data sources.
Table of Contents (18 chapters)
1
Part 1: Introduction
5
Part 2: Functional Steps in DataOps
11
Part 3: Governance of DataOps

Syncing the Connect data dictionary with other data catalogs

While populating your data dictionary gives you a single location to reference your organization's knowledge, not all the users in your company will use Connect, and, as we mentioned in Chapter 3, DataOps and Its Benefits, we know that the specific tool you use is of secondary importance. Making sure the data assets you have created can be used again will allow you to extract the most value from your data assets. We can synchronize our Connect data dictionary into other data management platforms using the Connect APIs to achieve this.

Using the Connect API methods

The Connect API uses a cycle of logging in to the server, performing your actions, and then logging out. An example process for this activity is shown in the following screenshot:

Figure 12.17 – An example cycle for using the Alteryx Connect API

In the diagram, we can see a cycle where you do the following:

  1. Log...