Book Image

Learning Cascading

Book Image

Learning Cascading

Overview of this book

Table of Contents (18 chapters)
Learning Cascading
Credits
Foreword
About the Authors
About the Reviewers
www.PacktPub.com
Preface
7
Optimizing the Performance of a Cascading Application
Index

Summary


In this chapter, you learned the basics of the Cascading API and the elements of a Cascading application. We started with the most basic building blocks of a Cascading application, such as tuples, fields, pipes, and simple pipe assemblies. We learned how to read and write data using taps and define data types using schemes. Later in the chapter, we learned how to create more complex pipe assemblies by joining separate datasets together, and showed you how to merge, spit, group, and sort data. We touched on operations as a lead-in into the next chapter. We introduced you to flows and learned how to assemble them into Cascades. Finally, we touched on data handling and how to use Cascading in both local and Hadoop modes. We concluded with our first fully functional Cascading application. This chapter gave us a foundation for a deeper immersion into Cascading in the consequent chapters.

In the next chapter, we will learn how to extend Cascading and make it transform data and also perform...