Sometimes you have several files to read, all with the same structure, but different data. In this recipe, you will see how to read those files in a single step. The example uses a list of files containing names of museums in Italy.
You must have a group of text files in a directory, all with the same format. In this recipe, the names of these files start with museums_italy_
for example, museums_italy_1
, museums_italy_2
, museums_italy_roma
, museums_italy_genova
, and so on.
Each file has a list of names of museums, one museum on each line.
Carry out the following steps:
Create a new transformation.
Drop a Text file input step onto the work area.
Under the File or directory tab, type the directory where the files are.
In the Regular Expression textbox, type:
museums_italy_.*\.txt
Then click on the Add button. The grid will be populated, as shown in the following screenshot: