Book Image

Data Engineering with Alteryx

By : Paul Houghton
Book Image

Data Engineering with Alteryx

By: Paul Houghton

Overview of this book

Alteryx is a GUI-based development platform for data analytic applications. Data Engineering with Alteryx will help you leverage Alteryx’s code-free aspects which increase development speed while still enabling you to make the most of the code-based skills you have. This book will teach you the principles of DataOps and how they can be used with the Alteryx software stack. You’ll build data pipelines with Alteryx Designer and incorporate the error handling and data validation needed for reliable datasets. Next, you’ll take the data pipeline from raw data, transform it into a robust dataset, and publish it to Alteryx Server following a continuous integration process. By the end of this Alteryx book, you’ll be able to build systems for validating datasets, monitoring workflow performance, managing access, and promoting the use of your data sources.
Table of Contents (18 chapters)
1
Part 1: Introduction
5
Part 2: Functional Steps in DataOps
11
Part 3: Governance of DataOps

Integrating data pipelines across environments

When considering how to integrate your workflows across environments, there are two major factors to be aware of:

  • Connection compatibility
  • Target environment

The connection compatibility consideration is about whether the environments will recognize the connections. We have spoken about connection strings as the first method for managing the connection across environments, but it is a simple method for ensuring that the connection will work across the environments.

The target environment consideration is about how you target different database connections across the desktop, development, and production environments. Commonly, you will have a production environment that is the primary system that supports your company. To make changes to your production environment directly is very risky if you do not test the impact the changes might have. Those impacts may concern the sequencing of other processes or how the overall...