Book Image

Getting Started with Talend Open Studio for Data Integration

By : Jonathan Bowen
Book Image

Getting Started with Talend Open Studio for Data Integration

By: Jonathan Bowen

Overview of this book

Talend Open Studio for Data Integration (TOS) is an open source graphical development environment for creating custom integrations between systems. It comes with over 600 pre-built connectors that make it quick and easy to connect databases, transform files, load data, move, copy and rename files and connect individual components in order to define complex integration processes. "Getting Started with Talend Open Studio for Data Integration" illustrates common uses and scenarios in a simple, practical manner and, building on knowledge as the book progresses, works towards more complex integration solutions. TOS is a code generator and so does a lot of the "heavy lifting"ù for you. As such, it is a suitable tool for experienced developers and non-developers alike. You'll start by learning how to construct some common integrations tasks ñ transforming files and extracting data from a database, for example. These building blocks form a "toolkit"ù of techniques that you will learn how to apply in many different situations. By the end of the book, once complex integrations will appear easy and you will be your organization's integration expert! Best of all, TOS makes integrating systems fun!
Table of Contents (22 chapters)
Getting Started with Talend Open Studio for Data Integration
About the Author
About the Reviewers

Chapter 6. Managing Files

We have seen in earlier chapters that files are often used as the medium in which data gets moved from one system to another. This could be a database extract that is written to a file in a specific format or a file that is converted from one format to another. In order to make your integration jobs complete and not rely on other automated or manual processes, the Studio offers the ability to program file operations beyond manipulating the file content. For example, we might wish to copy a file from one directory to another and once it has been moved to its final destination, delete the original file.

In this chapter we will:

  • Develop integration tasks that copy, rename, and delete files

  • Look at various tasks associated with archiving—specifically, time-stamping a file, zipping, and unzipping files

  • Show how we can list the files in a directory and operate on them in turn

  • Check for the existence of a file prior to attempting to process

When put together, these file operations...