7. {
"id": 123,
"age": "35",
"gender": "male",
"location": {
"x": 252.1,
"y": 179.3
},
…
}
SensorBee™: Stream processing engine for IoT
7
Camera
Vehicle
Router
Sensor
fluentd
RDBMS
Search
Engine
NoSQL
Data Sources Data Destinations
SensorBee™ focuses on transformation of and information extraction
from structured and unstructured streaming data at the edge of the
network, in the Fog, and in the Cloud. Machine learning and Deep
Learning perform data transformation and information extraction.
SensorBee™ enriches information content and adds new value prior to
data being loaded to data processing systems.
ETL くらいのバランス
8. SensorBee™: Transform
8
Camera
Vehicle
Router
Sensor
fluentd
RDBMS
Search
Engine
NoSQL
Data Sources Data DestinationsSensorBee™
BQL, an SQL-like language
• Filter
• Aggregate
• Join
Data processing flow by a SQL-like language
BQL is designed for stream
processing. It is schema-less and
uses JSON as its internal data model.
CREATE
SOURCE
camera
TYPE
webcam_mjpeg
WITH
uri="http://host:port/path/to/video";
CREATE
STREAM
frames
AS
SELECT
RSTREAM
snowflake_id("general_id")
AS
id,
*
FROM
camera1
[RANGE
1
TUPLES];
CREATE
STREAM
regions
AS
SELECT
RSTREAM
id
AS
frame_id,
snowflake_id("general_id")
AS
id,
*
FROM
detect_people("frames",
"detection_config_parameters")
[RANGE
1
TUPLES];
CREATE
STREAM
regions_with_metainfo
AS
SELECT
RSTREAM
classify("age_model",
image)
AS
age,
classify("gender_model",
image)
AS
gender,
*
FROM
regions
[RANGE
1
TUPLES];
CREATE
STREAM
male_average_ages
AS
SELECT
RSTREAM
avg(age)
AS
age
FROM
regions_with_metainfo
[RANGE
5
MINUTES]
WHERE
gender
=
"male";
9. SensorBee™: Flexibility and Extensibility
Camera
Vehicle
Router
Sensor
fluentd
RDBMS
Search
Engine
NoSQL
Data Sources Data DestinationsSensorBee™
Plug-in Plug-in
UDF
Custom functionalities are added as
User Defined Functions (UDFs) and User
Defined States (UDSs) of BQL, such as
Deep Learning transformations.
Machine learning
• Classification
• Regression
• Object recognition
• Anomaly detection
Machine learning algorithms
supported in DIMo are online and do
not require local storage.
UDS
10. SensorBee™: in Deep Intelligence in Motion
10
Camera
Vehicle
Router
Sensor
fluentd
RDBMS
Search
Engine
NoSQL
Data Sources Data DestinationsSensorBee™
Deep
Learning
DeepIntelligence
in-Motion(DIMo)
Sta-s-cs
Computer
vision
Detect/Track/
Recognize
Reinforcement
learning
Distributed/
Curriculum
Time-‐series
RNN
/
Representa-on
Sensor
fusion
Mul--‐modal
Feedback/Ac-on
…
Libraries
Plug-in Plug-in
UDF
UDF
DIMo provides various libraries that
use machine learning to support
complex data processing flow.
UDS
