Book Image

Pentaho 3.2 Data Integration: Beginner's Guide

Book Image

Pentaho 3.2 Data Integration: Beginner's Guide

Overview of this book

Pentaho Data Integration (a.k.a. Kettle) is a full-featured open source ETL (Extract, Transform, and Load) solution. Although PDI is a feature-rich tool, effectively capturing, manipulating, cleansing, transferring, and loading data can get complicated.This book is full of practical examples that will help you to take advantage of Pentaho Data Integration's graphical, drag-and-drop design environment. You will quickly get started with Pentaho Data Integration by following the step-by-step guidance in this book. The useful tips in this book will encourage you to exploit powerful features of Pentaho Data Integration and perform ETL operations with ease.Starting with the installation of the PDI software, this book will teach you all the key PDI concepts. Each chapter introduces new features, allowing you to gradually get involved with the tool. First, you will learn to work with plain files, and to do all kinds of data manipulation. Then, the book gives you a primer on databases and teaches you how to work with databases inside PDI. Not only that, you'll be given an introduction to data warehouse concepts and you will learn to load data in a data warehouse. After that, you will learn to implement simple and complex processes.Once you've learned all the basics, you will build a simple datamart that will serve to reinforce all the concepts learned through the book.
Table of Contents (27 chapters)
Pentaho 3.2 Data Integration Beginner's Guide
Credits
Foreword
The Kettle Project
About the Author
About the Reviewers
Preface
Index

Providing options when running Pan and Kitchen


When you execute a transformation or a job with Spoon, you have the option to provide additional information such as named parameters. The following Spoon dialog window shows you an example of that:

When you execute the transformation or job with Pan or Kitchen respectively, you provide this same information as options in the command line. This is how you do it compared side-by-side with Spoon:

Log details

Spoon

Pan/Kitchen option

Example

You specify the log level in the drop-down list inside the Details box.

When the transformation or job runs, the log is shown in the Execution Results window.

/level:<logging level>

where the logging level can be one of the following:

Error, Nothing, Minimal, Basic, Detailed, Debug, or Rowlevel.

/level:Detailed

The log appears in the terminal window, but you can use the command language of your operating system to redirect it to a file.

Named parameters

Spoon

Pan/Kitchen option

Example

You specify the named parameters in the Parameters box. The window shows you the name of the defined named parameters for you to fill the values or keep the default values.

/param:

<parameter name>=

<parameter value>

/param:

"REPORTS_FOLDER=

c:\my_rep\"

Arguments

Spoon

PAN/Kitchen option

Example

You specify the command line arguments in the Arguments grid. Each line corresponds to a different argument.

You type them in order as part of the command.

20091001 20091031

Variables

Spoon

Pan/Kitchen

The grid named Variables shows the variables used in the transformation/job as well as their current values. At the time of the execution, you can type different values.

You cannot set variables either in the Pan or in the Kitchen command. The variables have to exist. You may define them in the kettle.properties file. To get the details of this file, refer to the Kettle Variables section in Chapter 2.

Suppose that the sample transformation shown in the screenshot is located at c:\pdi_labs\sales_report.ktr. Then the following Pan command

pan.bat /file:"c:\pdi_labs\sales_report.ktr" 20091001 20091031 /level:Detailed > c:\pdi_labs\logs\sales_report.log

executes the transformation with the same options shown in the screenshot. The command redirects the log to the file c:\pdi_labs\logs\sales_report.log.

Besides these, both Pan and Kitchen have additional options. For a full list and more examples, visit the Pan and Kitchen documentation at http://wiki.pentaho.com/display/EAI/Pan+User+Documentation and http://wiki.pentaho.com/display/EAI/Kitchen+User+Documentation.