EnMasse - Apache Spark Streaming demo
Demo which shows a Kubernetes cluster deployed on Azure Container Services and on top of it the EnMasse (Messaging as a Service) infrastructure and Apache Spark (with the addition of an AMQP connector). During the demo an AMQP publisher sends simulated temperature values to the "temperature" address while an AMQP receiver gets filtered maximum value (in the last 5 seconds) from the "max" address. These addresses are deployed as queues using EnMasse and the AMQP clients connect to EnMasse as well. A Spark streaming driver reads the "temperature" values and processes them for extracting max value in the last 5 seconds writing it to the "max" address.