In this chapter, we will explore the most harmonious combination of client-broker there is (in my opinion), Ruby and RabbitMQ. You will quickly feel as if it's a match made in heaven.
You will learn how to build a real-life data science pipeline using Lambda Architecture, a worker fabric, and we will introduced to both Bunny—the de-facto RabbitMQ library for Ruby and Sneakers—and my own high-level performance background processing job library for Ruby.
In this chapter, you will learn how to the following:
Use Bunny to implement each and every messaging semantics in Ruby
Explore Lambda architecture and understand why this is the new way forward in a world filled with Big data
Understand the differences between Big, Medium, and Small data
See how to build a solution that would really hold such an architecture
Implement the solution with Sneakers and build an
aggregator
type worker—anip2location
type worker; you will also understand how to go much further than...