using a streaming data source in SAP Lumira 2.0 Designer - event stream processing applied in dashbo
One of the things that was on my wishlist for some time is to use Lumira 2.0 Designer with a streaming data source. Now that streaming data becomes more and more mainstream (think IoT devices or certain web-services), the use case for streaming data sources also gets more viable and apparent. With a streaming data source the data "streams" continuously into a dashboard. As such your visualizations on it will change and adjust permanently. The use cases vary from monitoring a machines temperature to reviewing the number of ongoing calls in a data center or even watch stock prices in live-mode, to mention a few. Time to sort out streaming data sources with Lumira 2.0 Designer and test it.
Event Stream Processing
SAP Lumira 2.0 Designer allows to use a streaming data source as source for analyzing. This
functionality was also available in its predecessor: SAP Design Studio. To make use of it, you need an event stream processor engine to handle the data as it flows in. I used SAP Event Stream Processor (ESP). Installing SAP ESP is not to difficult and I started with making a separate user to run my streams. SAP ESP is project-based and initially I took one of the sample projects coming with the software. This sample project uses a random data generator, but of course in real-live situations you'd use on of the streaming connectors available in ESP. After compiling my project and starting some of the required services, the data starts streaming and can be monitored from within ESP already.
There is a very good whitepaper here on SAP Event Stream Processor explaining how it works, what needs to be set up and what are the pre-requisites.
Setting up Lumira 2.0 Designer
Lumira 2.0 Designer made a big improvement when it comes to easiness of development of dashboards. I refer to my blogs on it here and here if you want to know more on this. For now I just sum up the step-by-step:
ensure your event stream processing engine is running. I used SAP Event Stream Processor
open your Lumira 2.0 Designer application or create a new one
Go to your Outline section and add a new data source. Choose Custom Data Source -> Streaming Data Source
Select your streaming data source and go to the Additional Properties
Apply the Host (LocalHost in my case) and the port number. You'll find the portnumber in your ESP engine
Use the User as set up in your ESP engine with the accompanying password
Select the Topic you defined in your ESP project
Within the Additional Properties there are three sub-tabs: now click the second one where you can define for the streaming attributes which ones are identified as measures and which ones as dimensions. Apply this correctly
Within the Additional Properties there are three sub-tabs: click the third one and select what dimension(s) and measure(s) you require for your data source
repeat step 8 and 9 by creating additional streaming data sources
Create a chart on your dashboard and assign the streaming data source
Off you go
Demo Lumira 2.0 Designer using a streaming data source
In below video I go through all of the above mentioned steps. You also see some insights on SAP Event Stream Processor using the Studio module. Have fun!