Book Image

Getting Started with Talend Open Studio for Data Integration

By : Jonathan Bowen
Book Image

Getting Started with Talend Open Studio for Data Integration

By: Jonathan Bowen

Overview of this book

Talend Open Studio for Data Integration (TOS) is an open source graphical development environment for creating custom integrations between systems. It comes with over 600 pre-built connectors that make it quick and easy to connect databases, transform files, load data, move, copy and rename files and connect individual components in order to define complex integration processes. "Getting Started with Talend Open Studio for Data Integration" illustrates common uses and scenarios in a simple, practical manner and, building on knowledge as the book progresses, works towards more complex integration solutions. TOS is a code generator and so does a lot of the "heavy lifting"ù for you. As such, it is a suitable tool for experienced developers and non-developers alike. You'll start by learning how to construct some common integrations tasks ñ transforming files and extracting data from a database, for example. These building blocks form a "toolkit"ù of techniques that you will learn how to apply in many different situations. By the end of the book, once complex integrations will appear easy and you will be your organization's integration expert! Best of all, TOS makes integrating systems fun!
Table of Contents (22 chapters)
Getting Started with Talend Open Studio for Data Integration
Credits
Foreword
Foreword
About the Author
Acknowledgement
About the Reviewers
www.PacktPub.com
Preface
Index

Iterating and looping


Looping and iterating structures are common to most programming languages and Talend Open Studio is no different. In this section, we will look at ways to use the Studio to implement loops and iterations and further automate your integration jobs through these repeating functions.

Iterate connections

In Chapter 6, Managing Files, we looked at the tFileList component and saw an example of how to iterate the flow between components, in this case iterating through the files in a directory and passing these filename values onwards one by one. The Studio offers an Iterate flow option from its start components, that is, those that can commence a subjob or flow, often in addition to a Main flow. Let's illustrate another example of an iterate flow now.

In this scenario, we have a delimited input file and we want to transform its output in some way. The input file contains e-mail addresses in one of its columns and we also want to send an e-mail to each e-mail address. We can approach...