When you execute the job, Data Services populates relevant execution information into three log files: the trace, monitor, and error logs. In later chapters, we will take a closer look at the configuration parameters available at the job level in order to gather more detailed information regarding job execution. Meanwhile, in this recipe, we will spend some time analyzing the monitor log file, which logs processing information from inside the dataflow components.
For simplicity, we will use the second dataflow from the recipe Using the Table_Comparison transform created for detailed explanation of the flow of the data before and after it passes the Table_Comparison transform object:
Open the Table_Comparison transform editor in the workspace and change the comparison method to Cached comparison table:
We change this option to slightly change the behavior of the Data Services optimizer. Now, instead of comparing data row by row, executing...