Book Image

Oracle Goldengate 11g Complete Cookbook

By : Ankur Gupta
Book Image

Oracle Goldengate 11g Complete Cookbook

By: Ankur Gupta

Overview of this book

Oracle Goldengate 11g Complete Cookbook is your complete guide to all aspects of Goldengate administration. The recipes in this book will teach you how to setup Goldengate configurations for simple and complex environments requiring various filtering and transformations. It also covers various aspects of tuning and troubleshooting the replication setups using exception handling, custom fields, and logdump utility.The book begins by explaining some basic tasks like Installation and Process groups setup. You will then be introduced to some further topics including DDL replication and various options to perform Initial Loads. You will then learn some advanced administration tasks such as Multi Master replication setup and conflict resolution. Further recipes, contain the cross platform replication and high availability options for Goldengate.

Related Content you might be interested in

Current Title:

Small book image
Oracle Goldengate 11g Complete Cookbook
Ankur Gupta
Sep, 2013 | 362 pages
No titles found
Table of Contents (16 chapters)
Oracle GoldenGate 11g Complete Cookbook
Oracle GoldenGate 11g Complete Cookbook
Credits
Credits
About the Author
About the Author
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Installation and Initial Setup
Installation and Initial Setup
Introduction
Installing Oracle GoldenGate in a x86_64 Linux-based environment
Installing Oracle GoldenGate in a Windows environment
Enabling supplemental logging in the source database
Supported datatypes in Oracle GoldenGate
Preparing the source database for GoldenGate setup
Preparing the target database for GoldenGate setup
Setting up a Manager process
Setting up a Classic Capture Extract process
Setting up an Integrated Capture Extract process
Setting up a Datapump process
Setting up a Replicat process
2
Setting up GoldenGate Replication
Setting up GoldenGate Replication
Introduction
Setting up a simple GoldenGate replication configuration between two single node databases
Setting up a GoldenGate replication with multiple process groups
Configuring an Extract process to read from an Oracle ASM instance
Setting up a GoldenGate replication between Oracle RAC databases
Determining the size of trail file areas
Verifying the data transfer on the target system
Generating encryption keys
Encrypting database user passwords
Encrypting the trail files
Setting up a GoldenGate replication between tables with different structures using defgen
3
DDL Replication and Initial Load
DDL Replication and Initial Load
Introduction
Performing an initial setup required for GoldenGate DDL replication
Setting up a GoldenGate DDL replication and verifying the changes
Performing an initial load using GoldenGate
Performing an initial load using an extract file to the GoldenGate's replicat method
Loading data using trail files to the Replicat process method
Loading data with files to the database utility method
Loading data with the GoldenGate direct load method
Loading data with bulk load to the SQL loader method
4
Mapping and Manipulating Data
Mapping and Manipulating Data
Introduction
Setting up a GoldenGate replication with mapping between different columns
Adding custom fields for a replicated record using tokens
Adding custom fields to a replicated record using SQLEXEC
Filtering the records using the FILTER and WHERE clause
Mapping the changes to a target table and storing the transaction history in a history table
Creating a GoldenGate configuration to run a Shell script when an end-of-day processing record is replicated
Creating an exception handler to record the erroneous transactions in a GoldenGate configuration
5
Oracle GoldenGate High Availability
Oracle GoldenGate High Availability
Introduction
Choosing a GoldenGate high availability option
Creating a highly available GoldenGate configuration using Oracle Clusterware and ACFS
Creating a highly available GoldenGate configuration using Oracle Clusterware and OCFS2
Creating a highly available GoldenGate configuration using Oracle Clusterware and DBFS
Manually switching over Oracle Clusterware-based configuration to the other node
Automatic failover of a DBFS-based configuration
Creating a set of parallel load balanced, highly available GoldenGate configurations using Oracle Clusterware and DBFS
6
Monitoring, Tuning, and Troubleshooting GoldenGate
Monitoring, Tuning, and Troubleshooting GoldenGate
Introduction
Steps to configure a BATCHSQL mode
Splitting the replication load into multiple process groups for optimal performance
Optimizing the network settings for a GoldenGate configuration
Performing a healthcheck of a live GoldenGate configuration
Script to perform a regular scheduled healthcheck of a live GoldenGate configuration
Steps to measure throughput of a GoldenGate configuration
Steps to re-instantiate a failed GoldenGate configuration
Steps to implement a Heartbeat mechanism for the GoldenGate replication
7
Advanced Administration Tasks – I
Advanced Administration Tasks – I
Introduction
Upgrading Oracle GoldenGate binaries
Table structure changes in GoldenGate environments with similar table definitions
Table structure changes in GoldenGate environments with different table definitions
Resolving GoldenGate errors using the logdump utility
Undoing the applied changes using the reverse utility
Creating an Integrated Capture with a downstream database for compressed tables
8
Advanced Administration Tasks – Part II
Advanced Administration Tasks – Part II
Introduction
Creating a GoldenGate configuration with a consistent state behind the target database
Replicating data from an active standby database in Archivelog mode only
Migrating from an Oracle Streams environment to Oracle GoldenGate
GoldenGate Administration role separation from the DBA team
Cross RDBMS replication using GoldenGate
Creating a multimaster GoldenGate replication configuration
9
GoldenGate Veridata, Director, and Monitor
GoldenGate Veridata, Director, and Monitor
Introduction
Setting up the Oracle GoldenGate Monitor server
Setting up Oracle GoldenGate Monitor Agents
Installing Oracle GoldenGate Director
Installing and using Oracle GoldenGate Director Client to manage the GoldenGate instances
Steps to set up the GoldenGate monitoring using OEM 12c
Steps to install Oracle GoldenGate Veridata
Steps to compare data between the source and target environment using Oracle GoldenGate Veridata
Index
Index

Loading data with files to the database utility method

In this recipe we will look into the detailed steps of instantiating a target database from a source database using the GoldenGate extract file to the database utility method. Although this method can be used to load the data into a variety of databases, for example, Microsoft SQL Server and Oracle DB2, we will focus on loading the data into the target Oracle database using the SQL * Loader. For this, we will instantiate the EMP table with 1 million rows to the target database while it gets updated with various transactions. We will also verify at the end of the initial load that all of these changes have been applied to the target as well.

Getting ready

For this recipe we will use the following setup:

  1. Create a modified version of the EMP table that is delivered in the SCOTT demo schema with Oracle binaries in the source and target databases. You can use the following DDL statement to create the EMP table:

    CREATE TABLE EMP (
EMPNO NUMBER...
Previous Section
End of Section 8
Next Section