Book Image

SQL Server 2017 Integration Services Cookbook

By : Christian Cote, Dejan Sarka, David Peter Hansen, Matija Lah, Samuel Lester, Christo Olivier
Book Image

SQL Server 2017 Integration Services Cookbook

By: Christian Cote, Dejan Sarka, David Peter Hansen, Matija Lah, Samuel Lester, Christo Olivier

Overview of this book

SQL Server Integration Services is a tool that facilitates data extraction, consolidation, and loading options (ETL), SQL Server coding enhancements, data warehousing, and customizations. With the help of the recipes in this book, you’ll gain complete hands-on experience of SSIS 2017 as well as the 2016 new features, design and development improvements including SCD, Tuning, and Customizations. At the start, you’ll learn to install and set up SSIS as well other SQL Server resources to make optimal use of this Business Intelligence tools. We’ll begin by taking you through the new features in SSIS 2016/2017 and implementing the necessary features to get a modern scalable ETL solution that fits the modern data warehouse. Through the course of chapters, you will learn how to design and build SSIS data warehouses packages using SQL Server Data Tools. Additionally, you’ll learn to develop SSIS packages designed to maintain a data warehouse using the Data Flow and other control flow tasks. You’ll also be demonstrated many recipes on cleansing data and how to get the end result after applying different transformations. Some real-world scenarios that you might face are also covered and how to handle various issues that you might face when designing your packages. At the end of this book, you’ll get to know all the key concepts to perform data integration and transformation. You’ll have explored on-premises Big Data integration processes to create a classic data warehouse, and will know how to extend the toolbox with custom tasks and transforms.
Table of Contents (18 chapters)
Title Page
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Customer Feedback
Preface

Installing SQL Server 2016


This section will go through the installation of SQL Server engine, which will host the database objects used throughout this book.

These are the features available for SQL Server setup:

  • Database engine: It is the core of SQL Server. It manages the various database objects such as tables, views, stored procedures, and so on.
  • Analysis services: It allows us to create a data semantic layer that eases data consumption by users.
  • Reporting services (native): It allow us to create various reports, paginated, mobile, and KPI's for data consumption.
  • Integration services: It is the purpose of this book, SQL Server data movement service.
  • Management tools: We'll talk about these in the next section.
  • SQL Server Data Tools: We'll talk about these in the next section.

Getting ready

This recipe assumes that you have downloaded SQL Server 2016 Developer Edition and you have installed Oracle JRE.

How to do it...

  1. The first step is to open the ISO file that you downloaded from the Microsoft Visual Studio Dev Essentials website as described in the SQL Server 2016 download recipe. If you're using Windows 7, you'll need to extract the ISO file into a folder. Third-party file compression utilities such as WinRAR, WinZip, or 7-Zip (and there are many more) can handle ISO file decompression. The setup files will be uncompressed in the folder of your choice. In other versions of Windows such as Windows 8.1, Windows 10, or Windows Server 2012 and beyond, simply double-click on the ISO file that you have downloaded previously and a new drive will appear in Windows Explorer.
  2. Double-click on the file named Setup.exe to start the SQL Server installation utility. The features we're going to install are as follows:
    • New SQL Server stand-alone installation or adding features to an existing installation: This will install a local instance (service) of SQL Server on your PC
    • SQL Server Management Tools: The tools used to create, query, and manage SQL Server objects
    • Install SQL Server Data Tools: This contains Visual Studio templates to develop and deploy SQL Server databases, integration services packages, analysis service cubes, and reporting services

  1. From the installation utility, select the New SQL Server stand-alone installation... option as shown in the following screenshot. A new SQL Server setup window opens.

  1. The Product Key page allows us to specify an edition to install. Since we're going to use the free Developer Edition, click Next to go to the next page, as shown in the following screenshot:

  1. Accept the license terms and click Next to go to the next page, as shown in the following screenshot:

  1. In this step, the SQL Server setup will check for product updates and will integrate itself into Windows update checks that are done regularly on your machine. This step is not mandatory but it's better to use the latest code. Check Use Microsoft Update... and click Next, as shown in the following screenshot:

  1. Some updates might be found during setup. You can get more information on these updates by clicking the link in the More Information column. Click Next to install the updates, as shown in the following screenshot:

  1. This step simply checks to make sure that the latest version of SQL Server is installed. Click Next once the setup files are installed, as shown in the following screenshot:

  1. SQL Server setup will check several rules to ensure that the computer where we want to install it is setup properly. You might get a warning due to Windows firewall rules. This tells you that the port (1433 by default) is not open and SQL Server won't be available from outside your PC. Don't worry about it. Since we'll be using SQL Server from our PC only, we do not need to open any ports for now. Click Next to advance to the feature selection page, as shown in the following screenshot:

  1. Select all features checked in the preceding screenshot and click Next, as shown in the following screenshot:

  1. Instance configuration allows to specify a name for the SQL Server service. This is done by selecting the Named instance radio button. Since we'll only use one SQL Server instance, leave Default instance selected and click Next, as shown in the following screenshot:

  1. This page allows SQL Server to be part of a PolyBase scale out group. Since we're only setting up SQL Server PolyBase to be used by one instance, leave the default Use this SQL Server as standalone PolyBase-enabled instance and click Next, as shown in the following screenshot:

  1. Now for server configuration. This step allows us to specify distinct or specific service accounts. Since we're installing SQL Server on a single development machine, we'll use the default accounts, as shown in the following screenshot:

  1. Click on the Collation tab as highlighted on the preceding screenshot. The default collation used by SQL server is SQL Latin1_General_CP1_CI_AS. This is a legacy collation. The choice of the collation is important for character string columns. The latest (fewer bugs) collation is Latin1_General_100. The last characters CI and AS are for case-insensitive and accent-sensitive, respectively.
  2. We'll change the collation defaults. Click Customize... at the end of SQL Latin1_General_CP1_CI_AI, as shown in the following screenshot:

  1. As stated previously, we'll use the Windows collation designator Latin1_General_100. Uncheck Accent-sensitive. This allows SQL Server to sort character columns without using accentuated characters. For example, suppose that our application has a FirstName column and we have the following first names:
    • Joel
    • Joël
  1. If we query SQL Server filtering on FirstName = 'Joel' with the Accent-sensitive collation option, we end up retrieving the value Joel only. If we do not select the Accent-sensitive collation option, we will get both values.
  2. Click OK when done to return to the previous screen. We'll do the same for analysis services; click Customize... to customize analysis service collation, as shown in the following screenshot:

  1. Again, choose Latin1_General_100 in Collation designator and uncheck the Accent-sensitive checkbox. Click OK to return to the previous screen. Click on Next, as shown in the following screenshot:

  1. This will direct you to the following screen. For the database engine configuration, we'll use Mixed Mode to allow us to use SQL Server logins and Windows logins. The default authentication is Windows authentication mode, which is more secure than SQL Server authentication because it uses the Kerberos security protocol, password, and account lockout policies, and password expiration. Make sure you use strong passwords for SQL Server logins. By default, password policy, password expiration, and user must change password at next login are turned on also for SQL Server login. You should not disable the password policy and the password expiration. Select the Mixed Mode radio box and enter a password for the SA account. Click on Add Current User as shown in the screenshot to add your Windows account as an administrator of the instance. You'll have all rights on it. Click Next, which will direct you to the Analysis Services Configuration window, as shown in the following screenshot:

  1. For analysis services configuration, the Server Mode we'll use is Tabular Mode and again click on Add Current User as shown in the following screenshot to add your Windows account as an administrator of the service. Click Next.

  1. For the Reporting services configuration, leave the default values and click Next, as shown in the following screenshot:

  1. We're finally ready to install. Click Install to start the installation process, as shown in the following screenshot:

  1. The following screenshot shows the installation progress:

  1. Once the installation is complete, you get the following screen:

We're done. We just installed SQL Server 2016! In the next section, we'll install SQL Server Management Studio.

Note

The number, the order, and the appearance of the setup screens change slightly with every version of SQL Server, or even with a service pack. If you encounter a new screen not mentioned here, just use the default settings and proceed with the installation.