Book Image

Microsoft SQL Server 2012 Integration Services: An Expert Cookbook

Book Image

Microsoft SQL Server 2012 Integration Services: An Expert Cookbook

Overview of this book

SQL Server Integration Services (SSIS) is a leading tool in the data warehouse industry - used for performing extraction, transformation, and load operations. This book is aligned with the most common methodology associated with SSIS known as Extract Transform and Load (ETL); ETL is responsible for the extraction of data from several sources, their cleansing, customization, and loading into a central repository normally called Data Warehouse or Data Mart.Microsoft SQL Server 2012 Integration Services: An Expert Cookbook covers all the aspects of SSIS 2012 with lots of real-world scenarios to help readers understand usages of SSIS in every environment. Written by two SQL Server MVPs who have in-depth knowledge of SSIS having worked with it for many years.This book starts by creating simple data transfer packages with wizards and illustrates how to create more complex data transfer packages, troubleshoot packages, make robust SSIS packages, and how to boost the performance of data consolidation with SSIS. It then covers data flow transformations and advanced transformations for data cleansing, fuzzy and term extraction in detail. The book then dives deep into making a dynamic package with the help of expressions and variables, and performance tuning and consideration.
Table of Contents (23 chapters)
Microsoft SQL Server 2012 Integration Services: An Expert Cookbook
Credits
Foreword
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Index

Audit Transformation: logging in Data Flow


When you run SSIS packages through the SSDT environment it's possible to see any unexpected errors, the tasks and components that are currently executing, and the data that is moving within the pipeline, all in real time. All this gives us the impression that everything is under control. In the real world, however, SSIS packages run in batch mode and it's very difficult to know what is happening if the logs are not activated and used.

SSIS provides an automatic logging system that is shown in Chapter 11, Event Handling and Logging, and also provides several system variables that could be used to store extra information about the tasks that are running!

Getting ready

To get ready for this recipe, use the following steps:

  1. Open SQL Server Data Tools (SSDT) and create a new SSIS project.

  2. Provide a name and a location for the SSIS project and proceed.

  3. Select the package created by default and rename it to P01_Audit.dtsx.

How to do it...

Consider a Data Warehousing...