Summary

In this chapter, we learned how to conduct project functional decomposition, data analysis, and design process, specifically targeting big data/Cascading implementation, as well as how to design and develop components in the Cascading API. Having acquired knowledge of every aspect of Cascading design and development, we were able to develop a fully functional and reusable application to satisfy the requirements of a specific use case based on text analytics and NLP.

While developing this application, we learned how to integrate external Java libraries and frameworks into a fully functional Cascading application. We also learned various options for file storage, specifically HDFS versus local files, for data needed by the integrated software. We also addressed the roles and responsibilities of the project team.

Remember our brewery at the beginning of this book? Now we understand the works of the intricate pipe networks and what makes a "delicious beverage" out of a &quot...