While not strictly file based, there are alternative methods for storing intermediate data which are more efficient than using temporary files, so long as there is enough memory to hold the temporary data. This recipe shows how to do this using the tHashMap
component.
Open the jo_cook_ch08_0040_temporaryDatatHashMap
job. You will notice that this is the same job as in the previous recipe.
The steps for storing intermediate data in memory using tHashMap
are as follows:
Delete the
tCreateTemporaryfile
component.Replace the
tFileOutputDelimited
with atHashInput
component, having a generic schema ofsc_cook_ch8_0040_genericCustomerOut
.Replace
tFileInputDelimited
withtHashInput
componentsc_cook_ch8_0040_genericCustomerOut
.Add the
onSubjobOk
link.Run the job, and the results will be the same as for the previous recipe.