This recipe guides you through discovering the structure and content of your PDI repository using the PDI command-line tools. We can know anything about the repository from the command line: we can view the list of available repositories, or view the list of directories in the repository, view the list of jobs or transformations in the specified directory. This recipe will work the same for both Kitchen and Pan, with the exception of the listing of jobs and transformations in a repository's directory; the first works with Kitchen and the second with Pan.
To get ready for this recipe, you need to check that the JAVA_HOME environment variable is set properly and then configure your environment variables so that the Kitchen script can start from anywhere without specifying the complete path to your PDI home directory. For details about these checks, refer to the recipe Executing PDI jobs from a filesystem (Simple).
To get the list of the available repositories, perform the following steps:
Sometimes we need to start a job or a transformation but we do not have the details of the repository we are going to interact with. The first thing we need to know is the name of the repository we are going to connect to to start our process. To get the name of the available repositories, we can use the
listrepcommand-line argument.The usage is very simple because it does not need any value, just the name of the argument specified in the command line.
Imagine that we need to find the list of the available repositories on Linux/Mac; the command to give is as follows:
$ kitchen.sh –listrepTo do the same thing on Windows, the command is written as follows:
C:\temp\samples>Kitchen.bat /listrepThe result we get is the repositories listed in a clear and concise form with the repository ID in the first column and the repository name in the second column:
INFO 19-03 23:18:51,675 - Kitchen - Start of run. INFO 19-03 23:18:51,695 - RepositoriesMeta - Reading repositories XML file: /home/sramazzina/.kettle/repositories.xml List of repositories: #1 : sample3 [PDI Book Samples] id=KettleFileRepository
To get the list of directories in a selected repository, perform the following steps:
The next step after we have found the repository we were looking for could be to look for a job or transformation located somewhere in the repository.
To do this, we need to get the list of available directories in the repository using the
listdirargument used together with the following arguments:The
repargument, to specify the name of the repository where we want to display the internal directory structure.The
dirargument, to give the directory name's starting point. The command will show you the directories contained in a specific directory. If this argument has not been specified, PDI assumes that you want to show all the directories contained in the root directory. Navigating through the structure of a complex repository is quite a tedious and iterative process, but something is better than nothing!The
userand–passarguments, in case your repository is an authenticated repository, to specify the username and password that needs to be connected to.
To find the list of the available directories in the root of the repository
rep3, the command to fire on Linux/Mac is as follows:$ kitchen.sh –rep:sample3 –listdirTo find the list of the available directories in the root of the repository
rep3, the command to fire on Windows is as follows:C:\temp\samples>Kitchen.bat /rep:sample3 /listdirThe command returns the list of available directories in the following form:
INFO 20-03 07:07:17,236 - Kitchen - Start of run. INFO 20-03 07:07:17,252 - RepositoriesMeta - Reading repositories XML file: /home/sramazzina/.kettle/repositories.xml dir2 dir1
The directory
dir1has a subdirectory,subdir11; to show this directory, we need to specify another command that for Linux/Mac is as follows:$ kitchen.sh –rep:sample3 –dir:dir1 –listdirAnd for Windows, the command is as follows:
C:\temp\samples>Kitchen.bat /rep:sample3 /dir:dir1 /listdirPDI will show us the children of the directory
dir1as follows:INFO 20-03 07:07:34,324 - Kitchen - Start of run. INFO 20-03 07:07:34,339 - RepositoriesMeta - Reading repositories XML file: /home/sramazzina/.kettle/repositories.xml subdir11
If you're checking the directories of an authenticated repository, the command will change as follows for Linux/Mac:
$ kitchen.sh –user:pdiuser –pass:password –rep:sample3 –listdirAnd the command will change as follows for Windows:
C:\temp\samples>Kitchen.bat /user:pdiuser /pass:password /rep:sample3 /listdirThe output of the command will remain the same.
To get the list of jobs in a specified directory, perform the following steps:
Now that we know about the internals of our repository, we're ready to look for our jobs.
The argument used to show the list of the available jobs in a specified directory is
listjob. This argument must be used together with the following:The
repargument, to specify the name of the repository where we want to display the internal directory structure.The
dirargument, to give the name of the directory. The command will show you the jobs contained in a specific directory. If this argument is not specified, PDI assumes that you want to show all the jobs contained in the root directory.The
userandpassarguments, in case your repository is an authenticated repository, to specify the username and password that needs to be connected to.
To find the list of the available jobs in the root directory of the repository
rep3, the command to fire on Linux/Mac is as follows:$ kitchen.sh –rep:sample3 –listjobsTo find the list of the available jobs in the root directory of the repository
rep3, the command to fire on Windows is as follows:C:\temp\samples>Kitchen.bat /rep:sample3 /listjobsThe command returns the list of available jobs in the following form:
INFO 20-03 07:30:46,642 - Kitchen - Start of run. INFO 20-03 07:30:46,657 - RepositoriesMeta - Reading repositories XML file: /home/sramazzina/.kettle/repositories.xml export-job
If you're checking the jobs in an authenticated repository, the command on Linux/Mac will change in the following way:
$ kitchen.sh –user:pdiuser –pass:password –rep:sample3 –listjobsIf you're checking the jobs in an authenticated repository, the command on a Windows platform will change in the following way:
C:\temp\samples>Kitchen.bat /user:pdiuser /pass:password /rep:sample3 /listjobs
To get the list of transformations in a specified directory, perform the following steps:
The Pan script lets us see the list of transformations contained in a directory of our repository.
To do this, we need to specify the
–listtransargument together with the same arguments specified for the–listjobsargument; for details about this, please refer to the previous paragraph to get a detailed explanation of the meaning and syntax of those arguments.To find the list of the available transformations in the root directory of the repository
rep3, the command to fire on Linux/Mac is as follows:$ pan.sh –rep:sample3 –listtransTo find the list of the available transformations in the root directory of the repository
rep3, the command to fire on Windows is as follows:C:\temp\samples>Pan.bat /rep:sample3 /listtransThe command returns the list of available transformations in the following form:
INFO 20-03 07:35:10,073 - Pan - Start of run. INFO 20-03 07:35:10,103 - RepositoriesMeta - Reading repositories XML file: /home/sramazzina/.kettle/repositories.xml read-customers
Anything applied to the display of jobs contained in a specific directory and the ability to apply the same command to an authenticated repository applies here to transformations as well; the only recommendation is to remember to use the Pan script instead of the Kitchen script.