Book Image

Getting Started with Oracle Data Integrator 11g: A Hands-On Tutorial

Book Image

Getting Started with Oracle Data Integrator 11g: A Hands-On Tutorial

Overview of this book

Oracle Data Integrator (ODI) is Oracle's strategic data integration platform for high-speed data transformation and movement between different systems. From high-volume, SOA-enabled data services, to trickle operations ñ ODI is a cutting-edge platform that offers heterogeneous connectivity, enterprise-level deployment, and strong administrative, diagnostic, and management capabilities. "Getting Started with Oracle Data Integrator 11g: A Hands-On Tutorial" provides you with everything you to get up and running with Oracle Data Integrator, and more! Following an example scenario, the book covers essential information about the ODI architecture and using ODI across different databases (Oracle, Microsoft SQL Server and MySQL), and file types such as XML, before covering Orchestrating Data Integration Workflows, Error Management, Operational Management and Monitoring, and beyond. "Getting Started with Oracle Data Integrator 11g: A Hands-On Tutorial" begins by describing the Oracle Data Integrator architecture and teaching you to install the product following best practices. You'll then be introduced to some of the key concepts of ODI such as the Knowledge Modules. Later topics include moving and transforming data from sources to targets including the Oracle Database, Microsoft SQL Server, MySQL, Flat files, and XML files, each with illustrated hands-on examples for the different technologies. Your learning experience will be made all the more rich with chapters introducing, explaining and leveraging additional ODI functionality such as variables, reusable procedures, temporary indexes and more. Finally ODI's workflow and task orchestration capabilities are explained before introducing you to Error Management with ODI's built-in 'error hospital' and 'error recycling' capabilities for non-compliant data, not to mention tackling ODI Studio, ODI Console and Enterprise Manager Fusion Middleware Control.
Table of Contents (21 chapters)
Getting Started with Oracle Data Integrator 11g: A Hands-On Tutorial
Credits
Foreword
About the Authors
About the Reviewers
www.PacktPub.com
Preface
10
Creating Workflows—Packages and Load Plans
13
Concluding Remarks
Index

Working with flat files


In this example we'll be adding partner information into our data mart from flat files.

Scope

Briefly put, this example will perform the initial data loads of the Partner data. ODI also has built-in capabilities for using FTP and SFTP as well as sophisticated file and folder management functionality—files can be gathered securely from remote hosts, marshaled and processed by ODI, then archived locally or once more transferred to a remote storage location. ODI can even wait for "trigger files" to be detected at any stage before proceeding with the next phase of data integration processing. However, to keep things simple and to comply with our "Getting Started…" flavor, we're only going to be dealing with locally hosted files in a fixed folder location.

Prerequisites for flat files

There are no additional system elements that need to be installed to enable ODI to work with file data; it comes with its own JDBC driver for flat files.

ODI can also leverage database utilities...