Book Image

Storm Real-time Processing Cookbook

By : Quinton Anderson
Book Image

Storm Real-time Processing Cookbook

By: Quinton Anderson

Overview of this book

<p>Storm is a free and open source distributed real-time computation system. Storm makes it easy to reliably process unbounded streams of data, doing for real-time processing what Hadoop did for batch processing. Storm is simple, can be used with any programming language, and is a lot of fun to use!<br />Storm Real Time Processing Cookbook will have basic to advanced recipes on Storm for real-time computation.<br /><br />The book begins with setting up the development environment and then teaches log stream processing. This will be followed by real-time payments workflow, distributed RPC, integrating it with other software such as Hadoop and Apache Camel, and more.</p>
Table of Contents (16 chapters)
Storm Real-time Processing Cookbook
Credits
About the Author
About the Reviewers
www.packtpub.com
Preface
Index

Implementing automated acceptance testing


The automated acceptance test involves exercising a wide range of use cases across a wide range of test cases to achieve acceptable levels of test coverage at a system level. There are many technologies that can be used for such a process; however, often you need to implement quite complex logic, so using a traditional programming language and libraries is often a valid way to approach the problem. In this recipe, we will implement acceptance tests for the Random Forest topology and have them execute as part of the build pipeline.

Getting ready

You will be adding to your existing rf-topology implementation for this recipe; however, if you haven't completed the recipe from Chapter 7, Real-time Machine Learning, simply clone the instance from https://bitbucket.org/qanderson/rf-topology.git.

How to do it…

  1. The acceptance test will be implemented as a unit test that only executes in a particular build phase. To start with, create a unit test in the rf-topology...