Book Image

Data Engineering with Alteryx

By : Paul Houghton
Book Image

Data Engineering with Alteryx

By: Paul Houghton

Overview of this book

Alteryx is a GUI-based development platform for data analytic applications. Data Engineering with Alteryx will help you leverage Alteryx’s code-free aspects which increase development speed while still enabling you to make the most of the code-based skills you have. This book will teach you the principles of DataOps and how they can be used with the Alteryx software stack. You’ll build data pipelines with Alteryx Designer and incorporate the error handling and data validation needed for reliable datasets. Next, you’ll take the data pipeline from raw data, transform it into a robust dataset, and publish it to Alteryx Server following a continuous integration process. By the end of this Alteryx book, you’ll be able to build systems for validating datasets, monitoring workflow performance, managing access, and promoting the use of your data sources.
Table of Contents (18 chapters)
1
Part 1: Introduction
5
Part 2: Functional Steps in DataOps
11
Part 3: Governance of DataOps

Conventions used

There are a number of text conventions used throughout this book.

Code in text: Indicates code words in the text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles. Here is an example: "This means we can create a testing_workflow_validation.py file with the test_description function inside it."

A block of code is set as follows:

from os import listdir
import os
import xml.etree.ElementTree as ET
ayx_file = ('.yxmd', '.yxmc', '.yxwz')
files = [f for f in listdir(os.getcwd()) if f.endswith(ayx_file)]

Any command-line input or output is written as follows:

ALTER TABLE "Users" ADD PRIMARY KEY ("UserId");

Bold: Indicates a new term, an important word, or words that you see on screen. For instance, words in menus or dialog boxes appear in bold. Here is an example: "In the final workflow, we can use the Output tool's Update: Insert if New option, which will keep all our records updated."

Tips or Important Notes

Appear like this.