This slide deck discusses with examples how steaming SQL has been heavily utilized to battle real-world challenge. Learn more: https://wso2.com/library/conference/streaming-sql-in-the-real-world/

1. Senior Director - Solutions Architecture
WSO2
Streaming SQL in the Real World
Vidura Gamini Abhaya

2. Streaming SQL
We use SQL to query data at rest…why not use SQL to query data
in motion?
“Streaming SQL” refers to languages that enable users to
write SQL-like queries for streaming data without having to
write code.
Easy to understand, expressive, short, fast, core operations can
cover 90% of the problems and easy to optimize

3. ● Some data are naturally continuously produced
● Need for real-time insights
● Volume of data is too large to store
● Data in motion is very natural
Why is stream processing popular?

4. ● Real-time analytics
● Streaming data integration
● Adaptive intelligence
frameworks
● Notification management
Uses of Streaming SQL
Real-time Analytics
Streaming Data
Integration
Notification
Management
Adaptive
Intelligent
Frameworks

5. Streaming SQL in the
Real World

6. Stream Processor Architecture

7. Retail

8. Retail
Customers,
supermarkets and
restaurants place
orders regularly using
their laptops, phones,
tablets, etc.
These orders are continuously
recorded in a database, and with
time, it will be possible to identify
trends and relationships between
the products ordered by each
consumer.
Streaming SQL

9. Retail
Customers,
supermarkets and
restaurants place
orders regularly using
their laptops, phones,
tablets, etc.
These orders are continuously
recorded in a database, and with
time it will be possible to identify
trends and relationships between
the products ordered by each
consumer.
With time, it will be possible to predict
what the consumer orders, and you will
be able to prompt/remind the
consumer on items they may have
forgotten to order
Have you
forgotten the milk?
Streaming SQL

10. Transportation

11. Transportation
Mobile app on rider’s
phone send in
details about trips
they want to make
(Time of day, start
and end of journey)
Trip history is kept in a
database and retrieved
whenever required
Mobile app on driver’s phone send
in details about trips they would
like to accept
Streaming SQL
Compare locations of driver and
rider and historical data whether
the combination has a match in the
recent past.

12. Transportation
Mobile app on rider’s
phone send in
details about trips
they want to make
(Time of day, start
and end of journey)
Trip history is kept in a
database and retrieved
whenever required
Mobile app on driver’s phone send
in details about trips they would
like to accept
Streaming SQL
Potential fraud
scenario identified
Driver denied of
designated trip
X

13. Healthcare

14. Healthcare
Sensors on patient
sends readings to
the Stream
Processor at regular
interval
History of blood glucose levels
and sensor readings are stored
in the database for historical
referencing
Hospital staff takes blood samples
and the lab staff enters the
analysis result into the system
Streaming SQL
Blood glucose levels and sensor
readings are compared together
with previous readings

15. Healthcare
Sensors on patient
sends readings to
the Stream
Processor at regular
interval
History of blood glucose levels
and sensor readings are stored
in the database for historical
referencing
Hospital staff takes blood samples
and the lab staff enters the
analysis result into the system
Streaming SQL
!
Abnormal Blood Glucose
Patterns Detected
Patient is at risk, alerting
medical staff!

16. Aviation

17. Aviation
Streaming SQL

18. Aviation
Streaming SQL
!
All cleaning staff hasn’t
left the aircraft !

19. Finance

20. Finance
Streaming SQL
$
$
$
User initiates
payments on any
device, using an
e-banking app
User and payment
information
Historical data on
previous payments
made

21. Finance
Streaming SQL
User initiates
payments on any
device, using an
e-banking app
User and payment
information
Historical data on
previous payments
made
Payment is > $100 and total
of past 5 payments is >
$500
Engage 2nd and 3rd factor
authentication
Engage 2nd
and 3rd factor
authentication

22. Digital Advertising

23. Digital Advertising
Streaming SQL
Users navigate to a
website that has
online ad space
System needs to
decide whether to
bid for an ad in that
space
Decision needs to be
done within <20ms
User information,
website, time of day
Historical data
about user and
buying patterns
External system
decides on the
amount to bid for,
based on time of
day, website, etc.

24. Digital Advertising
Streaming SQL
Users navigate to a
website that has
online ad. space
System needs to
decide whether to
bid for an ad in that
space
Decision made in
0.5ms with WSO2 SP
User information,
website, time of day
Historical data
about user and
buying patterns
External system
decides on the
amount to bid for,
based on time of
day, website, etc.
Decision made to bid
for an ad, type of ad
and price
✓

25. Advantages of
Streaming SQL usage

26. ● To make better decisions
○ Operational and business monitoring
● Effectively communicate information
○ Visualization – Alerting mechanisms
● Offer new value propositions
○ Insight driven products and services
● Business user friendly
○ SQL like language
○ Business templates
Business Perspective

27. ● Non-intrusive integration
○ Pull data from heterogeneous data sources and analyze
○ Push results to existing flows with no interruptions
● Intrusive integration
○ Receive input from multiple flows, systems and sources of data
○ Push results to existing flows and systems
● Ability to combine data in motion with data at rest
Solution Perspective

28. ● Interoperability in receiving data to analyze
○ Multiple protocols and formats
○ Pre-process before analyzing
● Interoperability in communicating results
○ Multiple protocols and formats
● Interoperability in data analysis
○ Integration with existing metadata and models
○ Extend with new analysis capabilities
Product Perspective

29. In conclusion...
● Streaming Data is everywhere
● Stream processing has many uses
● Streaming SQL makes it easily accessible
● Deployments can be complex

30. THANK YOU
wso2.com