Migrating Large Data Volumes to Salesforce
When loading LDVs (hundreds of thousands or millions of records) into Salesforce, there are various tools and considerations to keep in mind. Firstly, the Application Programming Interface (API) used to load the data into Salesforce can make a huge difference. The Bulk API can be used to load lots of data in parallel (by setting it to parallel mode). This can cause record-locking issues, whereby records cannot be loaded as their parent is locked. However, typically, this results in a faster load time compared to loading data in one batch at a time (known as serial mode). A way to reduce the likelihood of getting record-locking issues is to order the records to be loaded by the parent record IDs. Thinking purely in terms of performance, the Bulk API in parallel mode is the fastest way to load millions of records into Salesforce in the shortest amount of time. An external ID field can be used to avoid duplicates while importing records, as the...