-
Book Overview & Buying
-
Table Of Contents
ETL with Azure Cookbook
By :
To do ETL, we need to have a source to query data and a target (often called a sink) to land the transformed data. Our first recipe will create a simple SQL Azure database that will be used as both the source and sink in all recipes of this chapter.
In Chapter 1, Getting Started with Azure and SSIS 2019, you were shown how to install SQL Server on-premises, SQL Server Management Studio (SSMS), and Visual Studio 2019 with the SSIS extension. This chapter will show you how to set up SQL Server in Azure and the recipes will use this version of SQL Server.
In a browser, go to the Microsoft Azure portal using the following URL: https://portal.azure.com/#home.
On the main portal page, we'll create a resource group to group all Azure services together. It's much easier to find and manage them later.:

Figure 2.1 – Create a resource in Azure
resource. Click on the search result Resource group that appears, as in the following screenshot:
Figure 2.2 – Choose Resource group from the search list

Figure 2.3 – Create a resource group after selection

Figure 2.4 – New resource group properties
The region you select here will be the default for all the resources you create in the resource group in the future. Ideally, you should choose a location not too far from where you live. We can always override this setting in each resource we create in the future.
Click on Review + create at the bottom left of the blade to validate the entries we made. Once validated, click Create to create the resource group.

Figure 2.5 – Add a resource to a resource group

Figure 2.6 – Select SQL Database

Figure 2.7 – Database properties
Let's look at the database properties:
a) Subscription: Your subscription.
b) Resource group: EtLInAzureCookBook or the resource group created before.
c) Database name: We're going to restore a sample database that will be used in future recipes. We'll name it AdventureWorksLT.
d) Server: Click on Create new below the combo list. The New server blade appears:

Figure 2.8 – New server properties
Let's look at the server properties:
a) Server name: You should use something like <yourname> etlinazurecookbook all in lower case. Here's the reference from Microsoft for SQL Server naming: https://docs.microsoft.com/en-us/azure/azure-resource-manager/management/resource-name-rules#microsoftsql.
b) Server admin login: ETLAdmin.
c) Password: Create a password.
d) Confirm password: Confirm the password created.
e) Location: Select an Azure location. You should use the same region as the resource group created before.
f) Click on OK to create the server.
g) Back in the database creation blade, set the SQL elastic pool option to No.
h) Compute + Storage: Click on the Configure database link. We'll select the Basic configuration for now.
i) From the Configure blade, click on the Looking for basic, standard, premium? link as shown in the following screenshot:

Figure 2.9 – Change server capacity
Figure 2.10 – Server Networking blade
Figure 2.11 – Server Additional settings

Figure 2.12 – Database query editor
Enter the login and password. The query editor opens. Expand the Tables folder, right-click on any table, and click Select Top 1000 Rows from the submenu that appears, as shown in the following screenshot:

Figure 2.13 – Database Select Top 1000 Rows
Let's move on to the next section!
We created a SQL server in Azure and we stored a sample database on it: AdventureWorksLT. Everything was done using a web browser, with no need to install anything on a PC. The next recipes will show how to use that database with on-premises software.
Change the font size
Change margin width
Change background colour