Unlike the simple CDC method demonstrated in the previous section, the use of consistent set CDC does address the problem of how to coordinate the flow of data into a target system when there are explicitly defined foreign key relationships between one or more target tables. One possible problem with simple CDC is that while you are processing changes for the parent records, more data can arrive, possibly including both parent and child records. In this case, once you are done processing the parents, you want to make sure that the children records that you will process belong only to these parents, and that the children that have arrived in the middle of your processing will only be processed with the next round of processing. The KMs for consistent CDC will solve this problem by allowing us to mark all the records that are ready for processing before we start processing any of them through a windowing strategy. The essence of consistent...
Oracle Data Integrator 11g Cookbook
Oracle Data Integrator 11g Cookbook
Overview of this book
Oracle Data Integrator (ODI) is Oracle's strategic data integration platform for high-speed data transformation and movement between different systems. From high-volume batches, to SOA-enabled data services, to trickle operations, ODI is a cutting-edge platform that offers heterogeneous connectivity, enterprise-level deployment, and strong administrative, diagnostic, and management capabilities."Oracle Data Integrator 11g Cookbook" will take you on a journey past your first steps with ODI to a new level of proficiency, lifting the cover on many of the internals of the product to help you better leverage the most advanced features.The first part of this book will focus on the administrative tasks required for a successful deployment, moving on to showing you how to best leverage Knowledge Modules with explanations of their internals and focus on specific examples. Next we will look into some advanced coding techniques for interfaces, packages, models, and a focus on XML. Finally the book will lift the cover on web services as well as the ODI SDK, along with additional advanced techniques that may be unknown to many users.Throughout "Oracle Data Integrator 11g Cookbook", the authors convey real-world advice and best practices learned from their extensive hands-on experience.
Table of Contents (19 chapters)
Oracle Data Integrator 11g Cookbook
Credits
Foreword
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Free Chapter
Installation, Deployment, and Configuration
Defining the Oracle Data Integrator Security
Advanced Topology
Using Variables
Knowledge Module Internals
Inside Knowledge Modules – SCD and CDC
Advanced Coding Techniques
Package Loops and File Processing
XML and Web Services
Advanced Coding Techniques Using the ODI SDK
More on ODI
Index
Customer Reviews