A PDI Transformation may be colorful, organized, full of pretty notes, but at the end, the most important thing is that it meets its purpose within a reasonable time of execution. Therefore, it's important to test your work with real data in order to detect if there are things that can be affecting the performance.
There are many factors involved both internal—for example, bad configuration of sort steps—and external—for example lack of indexes in a database table. Fortunately, PDI offers some means to analyze and improve the performance of your transformations.
You are already familiar with the Step Metrics
tab, which shows statistics for each step in your Transformation. There are some columns that we haven't mentioned until now, which are useful to monitor the performance:
STEP METRIC | DESCRIPTION |
| The time of execution of the step |
| The processing speed in rows per second |
| The number of rows in the input and output buffer... |