This is the presentation from Big Data November Bangalore Meetup 2014.
http://technology.inmobi.com/events/bigdata-meetup
Talk Outline:
- What does THE HIVE provide?
- Goals of Synapse Tech Stack
- THE HIVE Startups
- Demystifying IoT Market
- Synapse Stack for IoT
- Big Data Challenge
- Synapse Lambda Architecture
- Synapse Components
- Synapse Internals
- AKILI – Synapse Machine Learning
2. What does THE HIVE provide?
Business Design & Go-To-Market
In-house operating team and expert advisors working with entrepreneurs
Synapse Technology Stack
Application back-end technology stack covering Big Data,
Cloud & Mobile
Entrepreneur Access & Team Design
Unique access to top talent due to brand & relationships in Silicon Valley
Brand & Ecosystem
Big Data think tank driving thought leadership with 4500+ members and weekly
talks and panel discussions
Seed & Follow-on Capital
Invest $1.5M + $1.5M per company and help syndicate with VCs
Unique value creation structure to start and launch Big Data companies
11/21/14
2
3. Goals
of
Synapse
Tech
Stack
11/21/14
3
Accelerate
product
development
& go-to-
market for
The Hive
startups
Seamlessly plug-
in the latest open
source
innovations in
data science &
infrastructure
Engage &
contribute back
to relevant open
source
communities
5. 5
Demys4fying
IoT
Market
Ac*ve
Energy
Mgmnt,
Wind,
Solar,
Hydro,
Oil
&
Gas,
Grid
Mgmt.
Energy
IoT
Specific
Networks
&
Infrastructure/PaaS
Security
&
Data
Privacy
Telco/SPs
Fleet
Management
Asset
Tracking
Infotainment
Ford
Sync
GM
OnStar
Transporta4on
/
Connected
Car
Process
Control,
Maint.,
Manufacturing
Execu*on
Systems
(MES)
Asset
Loca*on
(RFID,
NFC)
Smart
Agriculture
&
Farming
Manufacturing
Smart
Home
Management
Energy,
Water,
Security,
Climate
Home
Automa4on
At
Home
Care,
Remote
Monitoring,
Tele-‐Health,
Post-‐
Surgery
Analy*cs/Diagnosis
Healthcare
Supply
Chain
Control
NFC
payments/games
Intelligent
Shopping
(WiFi,
BLE,
iBeacon)
Smart
Restocking/Rota*on
Retail
Waste
Management
Smart
Parking,
Pollu*on
Intelligent
Traffic
Systems
Public
Sector
Energy
Management
Automa*on
Structural
Health
Security
Building
Video
surveillance,
Access
control,
Radia*on,
Explosives,
Hazardous
Gases
Public
Safety
Industrial
Commercial
Consumer
$1.6tr
(CY17)
$1.2tr
(CY17)
$1.0tr
(CY17)
Source:
IDC
Internet
of
Things
Spending
Guide
by
Ver*cal
Market
2014
Smart
Home
Management
Energy,
Water,
Security,
Climate
Wearables
6. Synapse
Stack
for
IoT
Network
Communica*on
Appliance
So]ware
Appliance
Hardware
Rules
/
Analy*cs
Engine
Applica*on
Pla^orm
Database
Applica*ons
S
E
C
U
R
I
T
Y
E
X
T
E
R
N
A
L
S
O
U
R
C
E
S
B
U
S
I
N
E
S
S
11/21/14
6
8. Synapse
Lambda
Architecture
11/21/14
8
Master Data Set
Batch
Processor
Batch View 1
Batch View 2
Batch View
n
Bulk
Uploader
Machine
Learning
Batch Serving DB
Batch Layer
Realtime Layer
Transaction Data Stream
Realtime
Processor
Realtime Serving DB
Realtime Machine Learning
Append Only
Query
Processor
9. Synapse
Components
11/21/14
9
Data
Inges*on
&
Lineage
Storage
Stream
Processing
Batch
Processing
Machine
Learning
Service
API
Visualiza*on
P
D
R
E
O
P
V
L
I
O
S
Y
I
M
O
E
N
N
I
T
N
G
The
Hive
IoT
Startups
10. Synapse
Components
11/21/14
10
Ukoo
(Data
Inges*on
and
Lineage)
Duka
(Storage)
Tempus
(Real*me
Processor)
Huduma
(Batch
Processor)
Akili
(Machine
Learning)
Alchemy
(API
Services)
Tasvira
(Visualiza*on)
P
D
R
E
O
P
V
L
I
O
S
Y
I
M
O
E
N
N
I
T
N
G
The
Hive
IoT
Startups
11. Synapse
Internals
11/21/14
11
Machine
Learning
The
Hive
Startups
Kaga
Flume
Morphlines
Kite
SDK
MQTT
Falcon
HBase
HDFS
Cassandra
Redis
PostGreSQL
Data
Inges*on
&
Lineage
Storage
Spark
Streaming
Storm
Stream
Processor
Spark
Hadoop
Batch
Processor
REST
SQL
Service
API
Tableau
Gephi
D3.js
Visualiza*on
P
D
R
E
O
P
V
L
I
O
S
Y
I
M
O
E
N
N
I
T
N
G
D
O
C
K
E
R
12. AKILI
–
Synapse
Machine
Learning
11/21/14
12
HDFS
Database
Local
File
I
N
T
E
R
F
A
C
E
P
R
E
P
R
O
C
E
S
S
O
R
Transformation /
Feature Selection
Large
Scale
Recommeder
Engine
Naive Bayes
Decision Trees
Your Custom Model
Code
Genera*on
Embedded Models
API
Service
Model Storage
ML Black BoxInput Data
Custom Adapter