There are a few techniques for data loading that you need to spend some time learning to be a true master of the subject. We will have a look at some examples of them in this section.
It has already been mentioned that there is an excellent article on incremental load in both the help file and the reference manual. We will work through some examples here to help give you a good grounding in the subject. We will also look at a couple of other load techniques that will be very useful in your arsenal—binary load and partial load.
The basic process of an incremental load is to have most of the data stored in QVDs on the server and then connect to the database to just obtain those records that are needed to update the QVDs to be concurrent.
Thinking about this, there must be a few pieces that are needed before we can implement the strategy:
There will need to be an initial load of the data. This may be a complete load of the data table into one...