6. RabbitMQ
○ You have messages that need to
be routed in complex ways to
consumers
○ You want per-message delivery
guarantees
○ You don't care about ordered
delivery
Message broker examples
Apache Kafka
○ You have a fire hose of
events
○ You need delivered in
partitioned order 'at least
once'
○ You want to be able to re-
read messages
https://www.quora.com/What-are-the-differences-between-Apache-Kafka-and-
RabbitMQ
http://queues.io
7. Pipeline is a set of data processing elements
connected into series, where the output of one
element is the input of the next one.
Data pipeline architecture