Book Image

Microsoft SQL Server 2012 Integration Services: An Expert Cookbook

Book Image

Microsoft SQL Server 2012 Integration Services: An Expert Cookbook

Overview of this book

SQL Server Integration Services (SSIS) is a leading tool in the data warehouse industry - used for performing extraction, transformation, and load operations. This book is aligned with the most common methodology associated with SSIS known as Extract Transform and Load (ETL); ETL is responsible for the extraction of data from several sources, their cleansing, customization, and loading into a central repository normally called Data Warehouse or Data Mart.Microsoft SQL Server 2012 Integration Services: An Expert Cookbook covers all the aspects of SSIS 2012 with lots of real-world scenarios to help readers understand usages of SSIS in every environment. Written by two SQL Server MVPs who have in-depth knowledge of SSIS having worked with it for many years.This book starts by creating simple data transfer packages with wizards and illustrates how to create more complex data transfer packages, troubleshoot packages, make robust SSIS packages, and how to boost the performance of data consolidation with SSIS. It then covers data flow transformations and advanced transformations for data cleansing, fuzzy and term extraction in detail. The book then dives deep into making a dynamic package with the help of expressions and variables, and performance tuning and consideration.
Table of Contents (23 chapters)
Microsoft SQL Server 2012 Integration Services: An Expert Cookbook
Credits
Foreword
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Index

There's more...


There are some options that are very useful while working with the Lookup Transform; using them will help use the Lookup Transform to its full potential with improved performance in most situations. The next two options reveal these advanced properties.

Cache mode

As Lookup Transform looks for every record from source input inside the reference table, there should be performance tweaks to use during this lookup. SSIS provides a way to use the Cache option and cache the lookup table.

There are three options in the General tab of the Lookup Transform Editor's Cache mode setting:

  • Full Cache: The lookup table will be fully loaded in the cache memory.

  • This option will be optimal if the lookup table is not very large.

  • Partial Cache: The lookup table will be loaded in cache memory, but not fully.

    When you select this option, the size of cache can be defined in the Advanced tab with the Cache Size option.

  • No Cache: The lookup table doesn't cache in memory.

Connection type

The Lookup Transform...