Book Image

Programming MapReduce with Scalding

By : Antonios Chalkiopoulos
Book Image

Programming MapReduce with Scalding

By: Antonios Chalkiopoulos

Overview of this book

Table of Contents (16 chapters)
Programming MapReduce with Scalding
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Index

Chapter 7. Running Scalding in Production

We now know how to implement complex pipelines, use appropriate design patterns, and test our Scalding data processing applications in multiple layers. In this chapter, we will look at how to productionize a job, and more specifically, we will see how to:

  • Deploy, execute, and schedule

  • Coordinate task execution

  • Configure using property files and Hadoop parameters

  • Monitor and optimize