Index
A
- Access Server
- configuring / Configuring Access Server, How to do it…
- administrative tasks
- Repository Manager, using / How to do it…
- Server Manager, using / How to do it…
- CMC, used for registering new repository / How to do it…
- License Manager, using / How to do it…
- aggregate functions
- audit reporting
- Auto correct load option
B
- blob data type / How it works…
- bulk-load
- bulk-loading methods
- bypassing feature
C
- Case transform
- used, for splitting data flow / Splitting the flow of data with the Case transform, How to do it…, How it works…
- Central Configuration Management
- about / How to do it…
- Central Management Console
- about / Introduction, How to do it…
- Central Management Console (CMC) / Getting ready
- Central Object Library
- objects, assigning to and from / Adding objects to and from the Central Object Library
- central repository
- ETL code, migrating through / Migrating ETL code through the central repository, Getting ready
- objects, comparing between Local and Central / Comparing objects between the Local and Central repositories
- Change Data Capture (CDC)
- about / Change Data Capture techniques
- No history SCD (Type 1) / No history SCD (Type 1)
- limited history SCD (Type 3) / Limited history SCD (Type 3)
- unlimited history SCD (Type 2) / Unlimited history SCD (Type 2)
- process, building / How to do it…, How it works…
- source-based ETL CDC / Source-based ETL CDC
- target-based ETL CDC / Target-based ETL CDC
- native / Native CDC
- Cleansing Package Builder
- used, for creating custom cleansing package / Creating a custom cleansing package with Cleansing Package Builder, Getting ready, How to do it…, How it works…
- client tools
- about / Introduction
- Designer tool / Introduction
- Repository Manager / Introduction
- CodePlex
- URL / How to do it…
- command line (cmd)
- about / How to do it…
- conditional and while loop objects
- used, for controlling execution order / Using conditional and while loop objects to control the execution order, Getting ready, How to do it…, There is more…
- connection object, Data Insight
- creating / Creating a connection object
- continuous workflow
- conversion functions
- custom functions
- creating / Creating custom functions, How to do it…, How it works…
D
- data
- loading, into flat file / Loading data into a flat file, How to do it…, How it works…, There's more…
- loading, from flat file / Loading data from a flat file, How to do it…, How it works…, There's more…
- loading, from table to table / Loading data from table to table – lookups and joins, How to do it…, How it works…
- flow splitting, Case transform used / Splitting the flow of data with the Case transform, How to do it…, How it works…
- flow execution, monitoring / Monitoring and analyzing dataflow execution, Getting ready, How to do it…, How it works…
- flow execution, analyzing / Monitoring and analyzing dataflow execution, Getting ready, How to do it…, How it works…
- cleansing / Data Quality transforms – cleansing your data, How to do it…, How it works…, There's more…
- transforming, Pivot transform used / Transforming data with the Pivot transform, Getting ready, How to do it…, How it works…
- loading, into SAP ERP / Loading data into SAP ERP, Getting ready, How to do it…, How it works…
- database environment
- preparing / Preparing a database environment, How it works…
- database functions
- using / Using database functions
- key_generation() function / key_generation()
- total_rows() function / total_rows()
- sql() function / sql(), How it works…
- dataflow audit
- enabling / Enabling dataflow audit, How to do it…, How it works…, There's more…
- dataflow execution, optimizing
- SQL transform / Optimizing dataflow execution – the SQL transform, How to do it…, How it works…
- Data_Transfer transform / Optimizing dataflow execution – the Data_Transfer transform, How to do it…, How it works…
- Data_Transfer transform, usage / When to use Data_Transfer transform, There's more…
- performance options / Optimizing dataflow execution – performance options, How to do it…
- dataflow performance options / Dataflow performance options
- source table performance options / Source table performance options
- query transform performance options / Query transform performance options
- lookup_ext() performance options / lookup_ext() performance options
- target table performance options / Target table performance options
- dataflow flow, optimizing
- push-down techniques / Optimizing dataflow execution – push-down techniques, How to do it…, How it works…
- dataflow loaders, optimizing
- bulk-loading methods / Optimizing dataflow loaders – bulk-loading methods, How to do it…, How it works…
- bulk loading, enabling / When to enable bulk loading?
- dataflow performance options
- about / Dataflow performance options
- dataflow readers, optimizing
- lookup methods / Optimizing dataflow readers – lookup methods
- Query transform join, lookup with / Lookup with the Query transform join
- lookup_ext() function, lookup with / Lookup with the lookup_ext() function
- sql() function, lookup with / Lookup with the sql() function
- Query transform join, advantages / Query transform joins
- lookup_ext() function / lookup_ext()
- sql() function / sql()
- performance review / Performance review
- Data Insight
- capabilities, exploring / Exploring Data Insight capabilities, Getting ready, How to do it…
- connection object, creating / Creating a connection object
- data, profiling / Profiling the data
- profiling results, viewing / Viewing profiling results
- validation rule, creating / Creating a validation rule
- scorecard, creating / Creating a scorecard, How it works…
- profiling / Profiling
- rules / Rules
- scorecards / Scorecards
- Data Modification Language (DML) operation / Using the Map_Operation transform
- Data Quality transforms
- Data Services
- client tools / Introduction
- server-based components / Introduction
- installing / Installing and configuring Data Services, How to do it…, How it works…
- configuring / Installing and configuring Data Services, How to do it…, How it works…
- reference guide, URL / How to do it…
- auto documentation / Auto Documentation in Data Services, How to do it…, How it works…
- automatic job recovery / Automatic job recovery in Data Services, Getting ready, How to do it…, How it works…, There's more…
- Data Services objects
- and parent-child relationships / Peeking inside the repository – parent-child relationships between Data Services objects, How it works…
- object types list, getting in Data Services repository / Get a list of object types and their codes in the Data Services repository
- DF_Transform_DimGeography dataflow information, displaying / Display information about the DF_Transform_DimGeography dataflow
- SalesTerritory table object information, displaying / Display information about the SalesTerritory table object
- script object content, displaying / See the contents of the script object
- Data Services repository
- creating / Creating IPS and Data Services repositories, How to do it…, How it works…
- database, creating / How to do it…
- ODBC layer, configuring / How to do it…
- data validation
- validation functions, creating / Creating validation functions, How to do it…, How it works…
- results, reporting / Reporting data validation results, How to do it…, How it works…
- regular expression support used / Using regular expression support to validate data, Getting ready, How to do it…, How it works…
- Data_Transfer transform
- date functions
- using / Using date functions
- current date and time, generating / Generating current date and time
- parts, extracting from dates / Extracting parts from dates, How it works…, There's more…
- Designer tool
- about / Understanding the Designer tool
- setting / How to do it…
- default options, setting / How to do it…
- ETL code, executing / Executing ETL code in Data Services
- ETL code, validating / Validating ETL code
- template tables, using / Template tables
- query transform / Query transform basics
- HelloWorld example / The HelloWorld example
- Drop and re-create table option / There's more…
- DS Management Console
- about / Introduction
E
- ETL
- organizing / Projects and jobs – organizing ETL, How to do it…, How it works…
- projects / Projects and jobs – organizing ETL, How to do it…, How it works…
- hierarchical object view / Hierarchical object view
- history execution log files / History execution log files
- jobs, scheduling from Management console / Executing/scheduling jobs from the Management Console
- jobs, executing from Management console / Executing/scheduling jobs from the Management Console
- ETL audit
- external ETL audit, building / Building an external ETL audit and audit reporting, How to do it…, How it works…
- built-in, using / Using built-in Data Services ETL audit and reporting functionality, How to do it…, How it works…
- ETL code
- migrating, through central repository / Migrating ETL code through the central repository, Getting ready, How to do it…
- migrating, with export/import / Migrating ETL code with export/import, How to do it…
- ETL execution
- simplifying, with system configurations / Simplifying ETL execution with system configurations, Getting ready, How to do it…, How it works…
- ETL job
- dimension tables, populating / Use case example – populating dimension tables, How to do it…
- building / Use case example – populating dimension tables, How to do it…
- mapping, defining / Mapping
- dependencies, defining / Dependencies
- development / Development
- execution order / Execution order
- testing / Testing ETL
- test data, preparing to populate DimSalesTerritory / Preparing test data to populate DimSalesTerritory
- test data, preparing to populate DimGeography / Preparing test data to populate DimGeography
- execution order
- controlling, by nesting workflows / Nesting workflows to control the execution order, How to do it, How it works…
- controlling, conditional and while loops objects used / Using conditional and while loop objects to control the execution order, Getting ready, How to do it…, How it works…, There is more…
- export/import
- ETL code, migrating with / Migrating ETL code with export/import, Getting ready
- ATL files used / Import/Export using ATL files
- to local repository / Direct export to another local repository, How it works…
- Extract-Transform-Load (ETL)
- about / Introduction
- advantages / Introduction
F
- failures
- controlling / Controlling failures – try-catch objects, How to do it…, How it works…
- flat file
- data, loading in / Loading data into a flat file, How to do it…, How it works…, There's more…
- data, loading from / Loading data from a flat file, How to do it…, How it works…
- full pushdown / Getting ready
H
- Hierarchy_Flattening transform
- about / The Hierarchy_Flattening transform, Getting ready
- horizontal hierarchy flattening, performing / Horizontal hierarchy flattening
- vertical hierarchy flattening / Vertical hierarchy flattening, How it works…
- result tables, querying / Querying result tables
- horizontal hierarchy flattening
- about / Horizontal hierarchy flattening
I
- IDoc
- about / IDoc
- load, monitoring on SAP side / Monitoring IDoc load on the SAP side
- loaded data, post-load validation / Post-load validation of loaded data
- Information Platform Services (IPS)
- configuring / Installing and configuring Information Platform Services, How to do it…, How it works…
- installing / Installing and configuring Information Platform Services, How to do it…, How it works…
- IPS repository
J
- job execution
- debugging / Debugging job execution, How to do it…, How it works…
- monitoring / Monitoring job execution, How to do it…
- job recovery, automatic
- in Data Services / Automatic job recovery in Data Services, How to do it…, How it works…, There's more…
- join operations
- *-cross-join operation / How it works…
- ||-parallel-join operation / How it works…
- INNER JOIN / How it works…
- LEFT OUTER JOIN / How it works…
K
- key_generation() function / key_generation()
L
- long data type / How it works…
- lookup methods
- with Query transform join / Lookup with the Query transform join
- with lookup_ext() function / Lookup with the lookup_ext() function
- with sql() function / Lookup with the sql() function
- lookup_ext() function
- lookup with / Lookup with the lookup_ext() function
- advantages / lookup_ext()
- lookup_ext() performance options
- about / lookup_ext() performance options
M
- Map_Operation transform
- math functions
- using / Using math functions, How to do it…, There's more…
- Metadata Management tasks
- performing / Performing Metadata Management tasks, Getting ready, How to do it…, How it works…
- Metapedia
- working with / Working with the Metapedia functionality, How to do it…, How it works…
- Microsoft SQL Server 2012
- URL / How to do it…
- miscellaneous functions
N
- nested structures
- working with / Working with nested structures, How to do it…, How it works…, There is more…
O
- object replication
- using / Using object replication, How it works…
- OLTP datastore / How to do it…
P
- parameters
- creating / Creating variables and parameters, How to do it…, How it works…
- parent-child relationships
- between Data Services objects / Peeking inside the repository – parent-child relationships between Data Services objects, Getting ready
- partial pushdown / Getting ready
- performance options
- Pivot transform
- used, for transforming data / Transforming data with the Pivot transform, Getting ready, How to do it…, How it works…
- profiling data / Profiling
- profiling results, Data Insight
- viewing / Viewing profiling results
- push-down operations
- about / Optimizing dataflow execution – push-down techniques, How it works…
- partial pushdown / Getting ready
- full pushdown / Getting ready
Q
- Query transform join
- lookup with / Lookup with the Query transform join
- query transform joins
- advantages / Query transform joins
- Query transform performance options
R
- real-time jobs
- creating / Creating real-time jobs
- SoapUI, installing / Installing SoapUI, How to do it…, How it works…
- regular expression support
- used, for validating data / Using regular expression support to validate data, Getting ready, How to do it…, How it works…
- replication process
- about / How it works…
- rules / Rules
S
- SAP ERP
- data, loading into / Loading data into SAP ERP, Getting ready, How to do it…, How it works…
- URL / Loading data into SAP ERP
- SAP Information Steward
- about / Introduction
- URL / Introduction
- scorecard, Data Insight
- creating / Creating a scorecard, How it works…
- scorecards / Scorecards
- script
- creating / Creating a script, How to do it…, How it works…
- string functions, using / Using string functions in the script, How it works…
- server-based components
- IPS Services / Introduction
- Job Server / Introduction
- access server / Introduction
- web application server / Introduction
- services
- starting / Starting and stopping services, How to do it…, See also
- stopping / Starting and stopping services, How to do it…, See also
- web application server / How to do it…
- Data Services Job Server / How to do it…
- Information Platform Services / How to do it…
- Slowly Changing Dimensions (SCD)
- about / Getting ready
- SoapUI
- installing / Installing SoapUI, How to do it…, How it works…
- URL / Installing SoapUI
- source data object
- creating / Creating a source data object, How to do it…, How it works…
- source system database
- creating / Creating a source system database, There's more…
- source table performance options
- about / Source table performance options
- sql() function / sql(), How it works…
- lookup with / Lookup with the sql() function
- about / sql()
- SQL transform
- staging area structures
- defining / Defining and creating staging area structures
- creating / Defining and creating staging area structures
- flat files / Flat files
- RDBMS tables / RDBMS tables, How it works…
- string functions
- using / Using string functions, How to do it…
- using, in script / Using string functions in the script, How it works…
- system configurations
- used, for simplifying ETL execution / Simplifying ETL execution with system configurations, How to do it…, How it works…
T
- Table_Comparison transform
- target data object
- creating / Creating a target data object, How to do it…, There's more…
- target data warehouse
- creating / Creating a target data warehouse, How it works…, There's more…
- target table performance options
- about / Target table performance options
- tasks
- administering / Administering tasks, How to do it…, See also
- total_rows() function / total_rows()
- try-catch objects
U
- user access
- configuring / Configuring user access, How to do it…, How it works…
V
- validation functions
- creating / Creating validation functions, How to do it…, How it works…
- using, with validation transform / Using validation functions with the Validation transform, How to do it…, How it works…
- validation rule, Data Insight
- creating / Creating a validation rule
- validation transform
- validation functions, using with / Using validation functions with the Validation transform, How to do it…, How it works…
- variables
- creating / Creating variables and parameters, How to do it…, How it works…
- vertical hierarchy flattening
W
- workflow object
- creating / Creating a workflow object, How to do it…, How it works…
- workflows
- nesting, to control execution order / Nesting workflows to control the execution order, How to do it, How it works…
X
- XML_Map transform
- about / The XML_Map transform, How to do it…, How it works…