Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying SAP Data Services 4.x Cookbook
  • Table Of Contents Toc
  • Feedback & Rating feedback
SAP Data Services 4.x Cookbook

SAP Data Services 4.x Cookbook

By : Shomnikov
4 (1)
Buy this Book
close
close
SAP Data Services 4.x Cookbook

SAP Data Services 4.x Cookbook

4 (1)
By: Shomnikov
Buy this Book

Overview of this book

Want to cost effectively deliver trusted information to all of your crucial business functions? SAP Data Services delivers one enterprise-class solution for data integration, data quality, data profiling, and text data processing. It boosts productivity with a single solution for data quality and data integration. SAP Data Services also enables you to move, improve, govern, and unlock big data. This book will lead you through the SAP Data Services environment to efficiently develop ETL processes. To begin with, you’ll learn to install, configure, and prepare the ETL development environment. You will get familiarized with the concepts of developing ETL processes with SAP Data Services. Starting from smallest unit of work- the data flow, the chapters will lead you to the highest organizational unit—the Data Services job, revealing the advanced techniques of ETL design. You will learn to import XML files by creating and implementing real-time jobs. It will then guide you through the ETL development patterns that enable the most effective performance when extracting, transforming, and loading data. You will also find out how to create validation functions and transforms. Finally, the book will show you the benefits of data quality management with the help of another SAP solution—Information Steward.
Table of Contents (14 chapters)
close
close
close
Preface
chevron up
Icon
Preface
Icon
What this book covers
Icon
What you need for this book
Icon
Who this book is for
Icon
Sections
Icon
Conventions
Icon
Reader feedback
Icon
Customer support
Lock Free Chapter
1
1. Introduction to ETL Development
Icon
1. Introduction to ETL Development
Icon
Introduction
Icon
Preparing a database environment
Icon
Creating a source system database
Icon
Defining and creating staging area structures
Icon
Creating a target data warehouse
2
2. Configuring the Data Services Environment
Icon
2. Configuring the Data Services Environment
Icon
Introduction
Icon
Creating IPS and Data Services repositories
Icon
Installing and configuring Information Platform Services
Icon
Installing and configuring Data Services
Icon
Configuring user access
Icon
Starting and stopping services
Icon
Administering tasks
Icon
Understanding the Designer tool
3
3. Data Services Basics – Data Types, Scripting Language, and Functions
Icon
3. Data Services Basics – Data Types, Scripting Language, and Functions
Icon
Introduction
Icon
Creating variables and parameters
Icon
Creating a script
Icon
Using string functions
Icon
Using date functions
Icon
Using conversion functions
Icon
Using database functions
Icon
Using aggregate functions
Icon
Using math functions
Icon
Using miscellaneous functions
Icon
Creating custom functions
4
4. Dataflow – Extract, Transform, and Load
Icon
4. Dataflow – Extract, Transform, and Load
Icon
Introduction
Icon
Creating a source data object
Icon
Creating a target data object
Icon
Loading data into a flat file
Icon
Loading data from a flat file
Icon
Loading data from table to table – lookups and joins
Icon
Using the Map_Operation transform
Icon
Using the Table_Comparison transform
Icon
Exploring the Auto correct load option
Icon
Splitting the flow of data with the Case transform
Icon
Monitoring and analyzing dataflow execution
5
5. Workflow – Controlling Execution Order
Icon
5. Workflow – Controlling Execution Order
Icon
Introduction
Icon
Creating a workflow object
Icon
Nesting workflows to control the execution order
Icon
Using conditional and while loop objects to control the execution order
Icon
Using the bypassing feature
Icon
Controlling failures – try-catch objects
Icon
Use case example – populating dimension tables
6
6. Job – Building the ETL Architecture
Icon
6. Job – Building the ETL Architecture
Icon
Introduction
Icon
Projects and jobs – organizing ETL
Icon
Using object replication
Icon
Migrating ETL code through the central repository
Icon
Migrating ETL code with export/import
Icon
Debugging job execution
Icon
Monitoring job execution
Icon
Building an external ETL audit and audit reporting
Icon
Using built-in Data Services ETL audit and reporting functionality
Icon
Auto Documentation in Data Services
7
7. Validating and Cleansing Data
Icon
7. Validating and Cleansing Data
Icon
Introduction
Icon
Creating validation functions
Icon
Using validation functions with the Validation transform
Icon
Reporting data validation results
Icon
Using regular expression support to validate data
Icon
Enabling dataflow audit
Icon
Data Quality transforms – cleansing your data
8
8. Optimizing ETL Performance
Icon
8. Optimizing ETL Performance
Icon
Introduction
Icon
Optimizing dataflow execution – push-down techniques
Icon
Optimizing dataflow execution – the SQL transform
Icon
Optimizing dataflow execution – the Data_Transfer transform
Icon
Optimizing dataflow readers – lookup methods
Icon
Optimizing dataflow loaders – bulk-loading methods
Icon
Optimizing dataflow execution – performance options
9
9. Advanced Design Techniques
Icon
9. Advanced Design Techniques
Icon
Introduction
Icon
Change Data Capture techniques
Icon
Automatic job recovery in Data Services
Icon
Simplifying ETL execution with system configurations
Icon
Transforming data with the Pivot transform
10
10. Developing Real-time Jobs
Icon
10. Developing Real-time Jobs
Icon
Introduction
Icon
Working with nested structures
Icon
The XML_Map transform
Icon
The Hierarchy_Flattening transform
Icon
Configuring Access Server
Icon
Creating real-time jobs
11
11. Working with SAP Applications
Icon
Introduction
Icon
Loading data into SAP ERP
12
12. Introduction to Information Steward
Icon
12. Introduction to Information Steward
Icon
Introduction
Icon
Exploring Data Insight capabilities
Icon
Performing Metadata Management tasks
Icon
Working with the Metapedia functionality
Icon
Creating a custom cleansing package with Cleansing Package Builder
13
Index
Icon
Index

Conventions

In this book, you will find a number of text styles that distinguish between different kinds of information. Here are some examples of these styles and an explanation of their meaning.

Code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles are shown as follows: "We can include other contexts through the use of the include directive."

A block of code is set as follows:

select * 
from dbo.al_langtext txt
  JOIN dbo.al_parent_child pc
  on txt.parent_objid = pc.descen_obj_key
where  
  pc.descen_obj = 'WF_continuous';

When we wish to draw your attention to a particular part of a code block, the relevant lines or items are set in bold:

AlGUIComment ("ActaName_1" = 'RSavedAfterCheckOut', "ActaName_2" = 'RDate_created', "ActaName_3" = 'RDate_modified', "ActaValue_1" = 'YES', "ActaValue_2" = 'Sat Jul 04 16:52:33 2015', "ActaValue_3" = 'Sun Jul 05 11:18:02 2015', "x" = '-1', "y" = '-1')
CREATE PLAN WF_continuous::'7bb26cd4-3e0c-412a-81f3-b5fdd687f507'( )
DECLARE
  $l_Directory VARCHAR(255) ;
  $l_File VARCHAR(255) ;
BEGIN
 AlGUIComment ("UI_DATA_XML" = '<UIDATA><MAINICON><LOCATION><X>0</X><Y>0</Y></LOCATION><SIZE><CX>216</CX><CY>-179</CY></SIZE></MAINICON><DESCRIPTION><LOCATION><X>0</X><Y>-190</Y></LOCATION><SIZE><CX>200</CX><CY>200</CY></SIZE><VISIBLE>0</VISIBLE></DESCRIPTION></U
IDATA>', "ui_display_name" = 'script', "ui_script_text" = '$l_Directory = \'C:\\\\AW\\\\Files\\\\\';
$l_File = \'flag.txt\';

$g_count = $g_count + 1;

print(\'Execution #\'||$g_count);
print(\'Starting  \'||workflow_name()||\' ...\');
sleep(10000);
print(\'Finishing \'||workflow_name()||\' ...\');', "x" = '116', "y" = '-175')
BEGIN_SCRIPT
$l_Directory = 'C:\\AW\\Files\\';$l_File = 'flag.txt';$g_count = ($g_count + 1);print(('Execution #' || $g_count));print((('Starting  ' || workflow_name()) || ' ...'));sleep(10000);print((('Finishing ' || workflow_name()) || ' ...'));END
END
 SET ("loop_exit" = 'fn_check_flag($l_Directory, $l_File)', "loop_exit
_option" = 'yes', "restart_condition" = 'no', "restart_count" = '10', "restart_count_option" = 'yes', "workflow_type" = 'Continuous')

Any command-line input or output is written as follows:

setup.exe SERVERINSTALL=Yes

New terms and important words are shown in bold. Words that you see on the screen, for example, in menus or dialog boxes, appear in the text like this: "Open the workflow properties again to edit the continuous options using the Continuous Options tab."

Note

Warnings or important notes appear in a box like this.

Tip

Tips and tricks appear like this.

Visually different images
CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
SAP Data Services 4.x Cookbook
Next Section
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options
font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful
Order Page Read Now

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon