SlideShare une entreprise Scribd logo
1  sur  36
Télécharger pour lire hors ligne
High-performance database technology
for rock-solid IoT solutions
Gints Ernestsons, Clusterpoint founder
LATA conference, 28.01.2016.
Key facts about Clusterpoint
Founded: 2006
Team size: 32
Engineering: 25
Privately held, VC backed
4.8 m investments to date
Product: database software
Market share: 100s of installations
Partners: 7, Cloud partners: 2
Cloud DBaaS : from Q1/2015
Founder,

Visionary
Gints
Ernestsons
CTO, 

Founder
Jurgis 

Orups
DB Software
Architect
Janis 

Sermulins
CEO

Zigmars

Rasscevskis
Business

Dev Director
Peteris

Janovskis
Key Personnel
15 years CTO in
Lursoft; 8 years
CEO in
Clusterpoint;

25 years as a
technology
entrepreneur
and investor
8 years in
Google;
Engineering
manager of the
Web search
backend (Zurich);
IMO silver medal
9 years runs
Clusterpoint
core software
engineering
team, expert

in C/C++,
NoSQL, Big
data search
5 years in
Google 

MSc from MIT;
Intel Research
(USA)

IOI 2x Gold
medallist;
12 years in
Oracle; 

Alliance &
Channel
Director Central
and East
Europe
Algorithms

Architect
Martins 

Krikis
4 years in Intel
(USA), 4 years
in Tieto; 

PhD from Yale
University;
Lecturer on
Algorithms
Selected list of our customers and partners
Ousting ORACLE, Microsoft SQL, MySQL and SEARCH platforms in 24/7
services
We operate cloud database infrastructure in Europe and USA
Dallas, US
Riga, Europe
Already > 5000
users, only 8
months 

in a program
Cloud DBaaS
started in

Q1/2015
Gartner, Inc. forecasts that 6.4 billion connected things will
be in use worldwide in 2016, up 30 percent from 2015, and
will reach 20.8 billion by 2020. In 2016, 5.5 million new
things will get connected every day.
0
5000
10000
15000
20000
25000
2014 2015 2016 2020
Internet!of!Things!Units!Installed!Base!by!
Category!(Millions!of!Units)!|!Gartner!Nov!2015
Consumer Business:!Cross-Industry Business:!Vertical-Specific
0
500
1000
1500
2000
2500
3000
3500
2014 2015 2016 2020
Internet!of!Things!Endpoint!Spending!by!Category!
(Billions!of!Dollars)!|!Gartner!Nov!2015
Consumer Business:!Cross-Industry Business:!Vertical-Specific
Explosion of IoT data is inevitable: we are at the very beginning!
Product: hybrid operational database, analytics and search platform
Secure, high-performance,
distributed data management at scale
Hyper converged platform
that uses open standards
XML
JSON
SIEM
WEB HPC
DWH
OLAP
OLTP
Use cases
MB ► GB ▶ TB ▶ PB
ACID
TEXT
HybridSQL
We solve performance problems where relational databases fail
Blazing fast
performance
Unlimited
scalability
Bulletproof transactions, instant text search and security
Reduces your TCO by 80% over your database life-time
Up to 1000x 

faster MB ► GB ▶ TB ▶ PB


ACID
Distributed architecture delivers high-performance computing
CLUSTERPOINTRDBMS
Time
Reliability of legacy RDBMS without its complexity, at 1000x its speed
Simultaneous
execution of
parallel
computing
tasks using
fast & secure
transactions
All-in-one platform: DBMS, SEARCH, one API and one COST
Document database with
JavaScript/SQL + high
performance transactions
Search platform with data relevance
ranking, including full-text &
geospatial data
Scalable high-availability
distributed computing (sharding,
replication)
Real-time online web and mobile
analytics in Big data (no need for
map-reduce)
Bulletproof ACID
transactions
(patent filed, US)
No systems integration requiredCustom “stitching” all platforms
Kill complexity! Boost performance! Nail search! Cut your cost!
RDBMS w ACID-
transactions
ONE 

API:

JS/SQL
Cut 80% off your TCO
Up to 1000x faster
High availability 

shards, replicas
Online analytics

platform
Search platform,
full-text index
Tons of your integration efforts
and application “spaghetti” code
Budget for 100-users company, in
$
Commercial
RDBMS + SEARCH
Open source 

RDBMS + SEARCH
Clusterpoin
t database
DBMS software license (enterprise edition) 14 000 0 0
DBMS software maintenance (3 years) 20% / 3 x 2800 DIY / 0 3 x 7200
SEARCH PLATFORM (SEARCH) license 10 000 0 0
SEARCH PLATFORM maintenance fee (3 year) 20% / 3 x 2
000
DIY / 0 0
DBMS client software access licenses (100
users)
10 000 0 0
DBMS + SEARCH integration through custom
application software code (developer
months)
3m / 15 000 6m / 30 000 1m / 5000
DBMS high-availability clustering option or

custom HA integration (developer months)
2m / 10 000 4m / 20 000 0
Operate & scale integrated DBMS + SEARCH
+ custom application code (developer
9m / 45 000 18m / 90 000 0
Replace 2 software platforms with 1 to decrease your TCO by
80%
MySQL Multiple Bugs Let Remote Users
Access and Modify Data and Deny Service
Security Tracker
Attackers targeting Elasticsearch
remote code execution hole
The Register
US Department of Homeland Security
Calls On Computer Users to Disable Java
Forbes
The Odd Couple: Hadoop
and Data Security
ZDnet
Major security alert as 40,000 MongoDB
databases left unsecured on the internet
InformationAge
By using multiple platforms, your security problems are snowballing
Bash bug leaves Linux
users shellshocked
WindowsSecurity
Manage all your data, indexes and replicas with solid security
Ordinary relational SQL database
Big data cluster, replicas, backups
All your mission-critical data in one
DBMS, analytics and search platform
XML
JSON
ONE API:
JS/SQLACID transactions
Search and analytics data/indexes
BLOB
Develop your application software code scalable from day-one
OPEX, TCO
Database life-cycle
Save > 80%
 WRITE ONCE

and decrease
life-time cost
of your web or
mobile
application
Test Year 1 Year 2 Year 3 Year 4 Year N
replica 1
replica 2
replica 3
Why pay extra for high-end features? Use out-of-the-box!
LOAD BALANCING

FAULT-TOLERANCE 
 HIGH-AVAILABILITY

SCALE OUT ABILITY
Why document-oriented database architecture? Flexibility!
Easily includes other data models: tables, text, pictures, graphs, links etc
Manage all your data in open
industry standards:

XML and JSON
Life

time
Ordinary RDBMS: cost of changes escalates with software
stack
10
20
4015
Cumulative cost
ORM

45 d
Search

+ 90 d
Analytics & Reporting

+ 6 months
High availability clustering

+ 1 year
35
75
OPEX cost
Relational database

( ORM software model )
Launch
5
40
Document database: cost of changes goes down to minimum
20
40
Cumulative cost
Life

time
HA

+45 d
Search

+ 90 d
Analytics & Reporting

+ 6 months
Document model (de-
normalization)

1 year (rebuild application)


70
60
OPEX cost
Document database

( XML / JSON data model )
75
5
Launch
Ordinary database stores individual
measurements (1000s per meter)
Smart IoT meters: storing data in documents vs database raws
Document database stores all data on
individual meters as rich text objects
Fast degrading
performance
Billions of
measurements
Millions of smart
metersMeter Time Volts Amps Cost
1 10:00 220 0.25 0.05
2 10.00 230 0.50 0.10
3 10:00 180 0.30 0.03
... ... ... ... ...
1 10:15 240 0.65 0.10
2 10.15 230 0.50 0.10
3 10:15 180 0.30 0.03
... ... ... ... ...
Instant search

Top performance
Meter A day, a month or a year(s) data
1 00:00 { ... } ... 10:00 {220 0.25
0.05 } 10:15 { 240 0.65 0.10 } 10:30
{ ... } ... 23:45 { ... } address
2 00:00 { ... } ... 10:00 {230 0.50
0.10 } 10:15 { 230 0.50 0.10 } 10:30
{ ... } ... 23:45 { ... } ... name
3 00:00 { ... } ... 10:00 { Not
available } 10:15 { Signal loss }
10:30 { ... } ... 23:45 { ... } ... photo
Ordinary database indexing model
<id>
<title>
</title>
indexes
Full database content indexing
Automatically create and maintain fast full-text search index
Web-style free text SEARCH and
analytical JS/SQL queries
Complex queries requiring
steep learning curve
SQL query: tens of seconds Our query: milliseconds
RANKING INDEX
Your original data
in documents
Index tree is organized into a graph, enabling you
to set up your own search ranking (weighting)
rules
Distributed storage
architecture
words
strings
numbers
dates
names tags
values
relations
XML

& 

JSON
Ultra-fast database index for ranked search and online
analytics
RANKING
INDEX%
Ranking index delivers endless scale out ability to your data
Organized as a modular graph, it enables to distribute data and computing
MB►GB▶TB▶PB






Ordinary databases overload and overwhelm users with data
Two main performance problems with ordinary databases






Disrupt your competition with fast and relevant full-text search
Use ranking
Relevance

of search results
Free text queries

at subsecond latency
Programmable filter that delivers superior search relevance
Having
billions of
data?
Scientists: ranking is a game-changing technology in
databases
Very Large Data Bases
Conference
7th International Workshop on
Ranking in Databases, 2013
“ the sheer amount of data makes it almost impossible to process queries
in the traditional compute-then-sort approach ”
“ Facing explosion of data ... the user would be overwhelmed by too many
unranked results “
Map

application
Address Product
AddressProduct
Company Company
100% 100%
75% 75%
50% 50%
Ranking delivers superior search experience in your database
Shop





application
Same data,
different ranking
rules for your free
text search
queries (think
voice in future)
Least relevant
Address
Company
Easily configure your own ranking rules for your business
needs
Email
Category
Most relevant
Product
Your own data items (fields) in

your XML or JSON database
100%0% 50%
100%0% 50%
100%0% 50%
100%0% 50%
100%0% 50%
When free text search hits data with higher rankings, results are sorted up-front
Simple,
super-fast,
user-friendly
web-style 

SEARCH
Enjoy instantly relevant search in your data using only free text
Plain text:
Phrases:
Wildcards:
Patterns:
java developer London
“John Smith”
Joh* Smi* or “John Smi*”
John Sm?th
Substitutes: John Sm[iy]th
<query>
</query>
Two problems solved
w1^100% w2^+30% w3^-20%
integer 0 ..... 232

( when tag weightings are equal )
With ranking you can implement ranked pagination: 1 2 3 . . .
RANKING

INDEX
Real-time Big Data SEARCH
milli-
seconds
<id>
<title>
<document>
</title>


50%
Body
10%
Comments
100%
Ranking your database structure
Title
Ranking your documents
Ranking your search query terms
..w1...w2 ........ w3 ........
Ranking density of context
hits
Ranked pagination (1 2 3 ..) solves information overload
problem
Limited screen
estate
Limited network
bandwidth
Limited
waiting time
by users
Fast and relevant database search in your web and mobile applications
Page: 1 2 3 4 5 more
Constant query latency enables real-time Big data search and analytics
PB
GB
TB
MB
Milliseconds for a
JavaScript/SQL query in
Clusterpoint database
Minutes ... hours

for a SQL query in
legacy RDBMS
Scale to billions of documents without search performance
loss
RANKING

INDEX
XML
JSON
Clusterpoint Cloud Database as a Service (DBaaS)
We safely and efficiently manage
your databases for you AND 

We instantly scale on-demand!
Clusterpoint Cloud is always ON, 99.99% available &
reliable
REST API JS/SQL
http(s) tcp/ip
Our cloud computing is using cost-efficient on-demand
model
Cost-Efficient

Model, $
Resources
Time
Conventional
Provisioning
Model, $
Save 3x-10x


DB
Thank you!

Contenu connexe

Tendances

Tendances (20)

Big data on Azure for Architects
Big data on Azure for ArchitectsBig data on Azure for Architects
Big data on Azure for Architects
 
Data warehouse con azure synapse analytics
Data warehouse con azure synapse analyticsData warehouse con azure synapse analytics
Data warehouse con azure synapse analytics
 
Power BI for Big Data and the New Look of Big Data Solutions
Power BI for Big Data and the New Look of Big Data SolutionsPower BI for Big Data and the New Look of Big Data Solutions
Power BI for Big Data and the New Look of Big Data Solutions
 
Ai & Data Analytics 2018 - Azure Databricks for data scientist
Ai & Data Analytics 2018 - Azure Databricks for data scientistAi & Data Analytics 2018 - Azure Databricks for data scientist
Ai & Data Analytics 2018 - Azure Databricks for data scientist
 
IBM Cloud Native Day April 2021: Serverless Data Lake
IBM Cloud Native Day April 2021: Serverless Data LakeIBM Cloud Native Day April 2021: Serverless Data Lake
IBM Cloud Native Day April 2021: Serverless Data Lake
 
AWS Cloud Kata 2013 | Singapore - Getting to Scale on AWS
AWS Cloud Kata 2013 | Singapore - Getting to Scale on AWSAWS Cloud Kata 2013 | Singapore - Getting to Scale on AWS
AWS Cloud Kata 2013 | Singapore - Getting to Scale on AWS
 
Running cost effective big data workloads with Azure Synapse and Azure Data L...
Running cost effective big data workloads with Azure Synapse and Azure Data L...Running cost effective big data workloads with Azure Synapse and Azure Data L...
Running cost effective big data workloads with Azure Synapse and Azure Data L...
 
Big Data Analytics from Azure Cloud to Power BI Mobile
Big Data Analytics from Azure Cloud to Power BI MobileBig Data Analytics from Azure Cloud to Power BI Mobile
Big Data Analytics from Azure Cloud to Power BI Mobile
 
Suburface 2021 IBM Cloud Data Lake
Suburface 2021 IBM Cloud Data LakeSuburface 2021 IBM Cloud Data Lake
Suburface 2021 IBM Cloud Data Lake
 
Data Lake Overview
Data Lake OverviewData Lake Overview
Data Lake Overview
 
Azure Lowlands: An intro to Azure Data Lake
Azure Lowlands: An intro to Azure Data LakeAzure Lowlands: An intro to Azure Data Lake
Azure Lowlands: An intro to Azure Data Lake
 
Big Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft AzureBig Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft Azure
 
USQ Landdemos Azure Data Lake
USQ Landdemos Azure Data LakeUSQ Landdemos Azure Data Lake
USQ Landdemos Azure Data Lake
 
Trivadis Azure Data Lake
Trivadis Azure Data LakeTrivadis Azure Data Lake
Trivadis Azure Data Lake
 
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
 
Big Data Architecture and Design Patterns
Big Data Architecture and Design PatternsBig Data Architecture and Design Patterns
Big Data Architecture and Design Patterns
 
Big Data Architecture
Big Data ArchitectureBig Data Architecture
Big Data Architecture
 
USQL Trivadis Azure Data Lake Event
USQL Trivadis Azure Data Lake EventUSQL Trivadis Azure Data Lake Event
USQL Trivadis Azure Data Lake Event
 
Azure Synapse Analytics Overview (r1)
Azure Synapse Analytics Overview (r1)Azure Synapse Analytics Overview (r1)
Azure Synapse Analytics Overview (r1)
 
Dipping Your Toes: Azure Data Lake for DBAs
Dipping Your Toes: Azure Data Lake for DBAsDipping Your Toes: Azure Data Lake for DBAs
Dipping Your Toes: Azure Data Lake for DBAs
 

Similaire à High-performance database technology for rock-solid IoT solutions

MongoDB and the Internet of Things
MongoDB and the Internet of ThingsMongoDB and the Internet of Things
MongoDB and the Internet of Things
MongoDB
 
Accelerating a Path to Digital With a Cloud Data Strategy
Accelerating a Path to Digital With a Cloud Data StrategyAccelerating a Path to Digital With a Cloud Data Strategy
Accelerating a Path to Digital With a Cloud Data Strategy
MongoDB
 

Similaire à High-performance database technology for rock-solid IoT solutions (20)

Azure Data Explorer deep dive - review 04.2020
Azure Data Explorer deep dive - review 04.2020Azure Data Explorer deep dive - review 04.2020
Azure Data Explorer deep dive - review 04.2020
 
[「RDB技術者のためのNoSQLガイド」出版記念セミナー] Azure DocumentDB
[「RDB技術者のためのNoSQLガイド」出版記念セミナー] Azure DocumentDB[「RDB技術者のためのNoSQLガイド」出版記念セミナー] Azure DocumentDB
[「RDB技術者のためのNoSQLガイド」出版記念セミナー] Azure DocumentDB
 
MongoDB Days Silicon Valley: Jumpstart: The Right and Wrong Use Cases for Mon...
MongoDB Days Silicon Valley: Jumpstart: The Right and Wrong Use Cases for Mon...MongoDB Days Silicon Valley: Jumpstart: The Right and Wrong Use Cases for Mon...
MongoDB Days Silicon Valley: Jumpstart: The Right and Wrong Use Cases for Mon...
 
Tapping the cloud for real time data analytics
 Tapping the cloud for real time data analytics Tapping the cloud for real time data analytics
Tapping the cloud for real time data analytics
 
Mining Information from Data on Cloud
Mining Information from Data on CloudMining Information from Data on Cloud
Mining Information from Data on Cloud
 
Introduction to Azure DocumentDB
Introduction to Azure DocumentDBIntroduction to Azure DocumentDB
Introduction to Azure DocumentDB
 
AWS Summit Berlin 2013 - Big Data Analytics
AWS Summit Berlin 2013 - Big Data AnalyticsAWS Summit Berlin 2013 - Big Data Analytics
AWS Summit Berlin 2013 - Big Data Analytics
 
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
 
Welcome & AWS Big Data Solution Overview
Welcome & AWS Big Data Solution OverviewWelcome & AWS Big Data Solution Overview
Welcome & AWS Big Data Solution Overview
 
Using real time big data analytics for competitive advantage
 Using real time big data analytics for competitive advantage Using real time big data analytics for competitive advantage
Using real time big data analytics for competitive advantage
 
Data Culture Series - Keynote - 3rd Dec
Data Culture Series - Keynote - 3rd DecData Culture Series - Keynote - 3rd Dec
Data Culture Series - Keynote - 3rd Dec
 
Qo Introduction V2
Qo Introduction V2Qo Introduction V2
Qo Introduction V2
 
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
 
A Data Culture with Embedded Analytics in Action
A Data Culture with Embedded Analytics in ActionA Data Culture with Embedded Analytics in Action
A Data Culture with Embedded Analytics in Action
 
Financial Services Analytics on AWS
Financial Services Analytics on AWSFinancial Services Analytics on AWS
Financial Services Analytics on AWS
 
Data Treatment MongoDB
Data Treatment MongoDBData Treatment MongoDB
Data Treatment MongoDB
 
Customer migration to Azure SQL database, December 2019
Customer migration to Azure SQL database, December 2019Customer migration to Azure SQL database, December 2019
Customer migration to Azure SQL database, December 2019
 
MongoDB and the Internet of Things
MongoDB and the Internet of ThingsMongoDB and the Internet of Things
MongoDB and the Internet of Things
 
Microsoft Azure Big Data Analytics
Microsoft Azure Big Data AnalyticsMicrosoft Azure Big Data Analytics
Microsoft Azure Big Data Analytics
 
Accelerating a Path to Digital With a Cloud Data Strategy
Accelerating a Path to Digital With a Cloud Data StrategyAccelerating a Path to Digital With a Cloud Data Strategy
Accelerating a Path to Digital With a Cloud Data Strategy
 

Dernier

CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
anilsa9823
 
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female serviceCALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
anilsa9823
 

Dernier (20)

Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial Goals
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AISyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTV
 
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS LiveVip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
 
Diamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with PrecisionDiamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with Precision
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
 
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female serviceCALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
 

High-performance database technology for rock-solid IoT solutions

  • 1. High-performance database technology for rock-solid IoT solutions Gints Ernestsons, Clusterpoint founder LATA conference, 28.01.2016.
  • 2. Key facts about Clusterpoint Founded: 2006 Team size: 32 Engineering: 25 Privately held, VC backed 4.8 m investments to date Product: database software Market share: 100s of installations Partners: 7, Cloud partners: 2 Cloud DBaaS : from Q1/2015
  • 3. Founder,
 Visionary Gints Ernestsons CTO, 
 Founder Jurgis 
 Orups DB Software Architect Janis 
 Sermulins CEO
 Zigmars
 Rasscevskis Business
 Dev Director Peteris
 Janovskis Key Personnel 15 years CTO in Lursoft; 8 years CEO in Clusterpoint;
 25 years as a technology entrepreneur and investor 8 years in Google; Engineering manager of the Web search backend (Zurich); IMO silver medal 9 years runs Clusterpoint core software engineering team, expert
 in C/C++, NoSQL, Big data search 5 years in Google 
 MSc from MIT; Intel Research (USA)
 IOI 2x Gold medallist; 12 years in Oracle; 
 Alliance & Channel Director Central and East Europe Algorithms
 Architect Martins 
 Krikis 4 years in Intel (USA), 4 years in Tieto; 
 PhD from Yale University; Lecturer on Algorithms
  • 4. Selected list of our customers and partners Ousting ORACLE, Microsoft SQL, MySQL and SEARCH platforms in 24/7 services
  • 5. We operate cloud database infrastructure in Europe and USA Dallas, US Riga, Europe Already > 5000 users, only 8 months 
 in a program Cloud DBaaS started in
 Q1/2015
  • 6. Gartner, Inc. forecasts that 6.4 billion connected things will be in use worldwide in 2016, up 30 percent from 2015, and will reach 20.8 billion by 2020. In 2016, 5.5 million new things will get connected every day. 0 5000 10000 15000 20000 25000 2014 2015 2016 2020 Internet!of!Things!Units!Installed!Base!by! Category!(Millions!of!Units)!|!Gartner!Nov!2015 Consumer Business:!Cross-Industry Business:!Vertical-Specific 0 500 1000 1500 2000 2500 3000 3500 2014 2015 2016 2020 Internet!of!Things!Endpoint!Spending!by!Category! (Billions!of!Dollars)!|!Gartner!Nov!2015 Consumer Business:!Cross-Industry Business:!Vertical-Specific Explosion of IoT data is inevitable: we are at the very beginning!
  • 7. Product: hybrid operational database, analytics and search platform Secure, high-performance, distributed data management at scale Hyper converged platform that uses open standards XML JSON SIEM WEB HPC DWH OLAP OLTP Use cases MB ► GB ▶ TB ▶ PB ACID TEXT HybridSQL
  • 8. We solve performance problems where relational databases fail Blazing fast performance Unlimited scalability Bulletproof transactions, instant text search and security Reduces your TCO by 80% over your database life-time Up to 1000x 
 faster MB ► GB ▶ TB ▶ PB
  • 9. 
 ACID Distributed architecture delivers high-performance computing CLUSTERPOINTRDBMS Time Reliability of legacy RDBMS without its complexity, at 1000x its speed Simultaneous execution of parallel computing tasks using fast & secure transactions
  • 10. All-in-one platform: DBMS, SEARCH, one API and one COST Document database with JavaScript/SQL + high performance transactions Search platform with data relevance ranking, including full-text & geospatial data Scalable high-availability distributed computing (sharding, replication) Real-time online web and mobile analytics in Big data (no need for map-reduce) Bulletproof ACID transactions (patent filed, US)
  • 11. No systems integration requiredCustom “stitching” all platforms Kill complexity! Boost performance! Nail search! Cut your cost! RDBMS w ACID- transactions ONE 
 API:
 JS/SQL Cut 80% off your TCO Up to 1000x faster High availability 
 shards, replicas Online analytics
 platform Search platform, full-text index Tons of your integration efforts and application “spaghetti” code
  • 12. Budget for 100-users company, in $ Commercial RDBMS + SEARCH Open source 
 RDBMS + SEARCH Clusterpoin t database DBMS software license (enterprise edition) 14 000 0 0 DBMS software maintenance (3 years) 20% / 3 x 2800 DIY / 0 3 x 7200 SEARCH PLATFORM (SEARCH) license 10 000 0 0 SEARCH PLATFORM maintenance fee (3 year) 20% / 3 x 2 000 DIY / 0 0 DBMS client software access licenses (100 users) 10 000 0 0 DBMS + SEARCH integration through custom application software code (developer months) 3m / 15 000 6m / 30 000 1m / 5000 DBMS high-availability clustering option or
 custom HA integration (developer months) 2m / 10 000 4m / 20 000 0 Operate & scale integrated DBMS + SEARCH + custom application code (developer 9m / 45 000 18m / 90 000 0 Replace 2 software platforms with 1 to decrease your TCO by 80%
  • 13. MySQL Multiple Bugs Let Remote Users Access and Modify Data and Deny Service Security Tracker Attackers targeting Elasticsearch remote code execution hole The Register US Department of Homeland Security Calls On Computer Users to Disable Java Forbes The Odd Couple: Hadoop and Data Security ZDnet Major security alert as 40,000 MongoDB databases left unsecured on the internet InformationAge By using multiple platforms, your security problems are snowballing Bash bug leaves Linux users shellshocked WindowsSecurity
  • 14. Manage all your data, indexes and replicas with solid security Ordinary relational SQL database Big data cluster, replicas, backups All your mission-critical data in one DBMS, analytics and search platform XML JSON ONE API: JS/SQLACID transactions Search and analytics data/indexes BLOB
  • 15. Develop your application software code scalable from day-one OPEX, TCO Database life-cycle Save > 80%
 WRITE ONCE
 and decrease life-time cost of your web or mobile application Test Year 1 Year 2 Year 3 Year 4 Year N
  • 16. replica 1 replica 2 replica 3 Why pay extra for high-end features? Use out-of-the-box! LOAD BALANCING
 FAULT-TOLERANCE 
 HIGH-AVAILABILITY
 SCALE OUT ABILITY
  • 17. Why document-oriented database architecture? Flexibility! Easily includes other data models: tables, text, pictures, graphs, links etc Manage all your data in open industry standards:
 XML and JSON
  • 18. Life
 time Ordinary RDBMS: cost of changes escalates with software stack 10 20 4015 Cumulative cost ORM
 45 d Search
 + 90 d Analytics & Reporting
 + 6 months High availability clustering
 + 1 year 35 75 OPEX cost Relational database
 ( ORM software model ) Launch 5 40
  • 19. Document database: cost of changes goes down to minimum 20 40 Cumulative cost Life
 time HA
 +45 d Search
 + 90 d Analytics & Reporting
 + 6 months Document model (de- normalization)
 1 year (rebuild application) 
 70 60 OPEX cost Document database
 ( XML / JSON data model ) 75 5 Launch
  • 20. Ordinary database stores individual measurements (1000s per meter) Smart IoT meters: storing data in documents vs database raws Document database stores all data on individual meters as rich text objects Fast degrading performance Billions of measurements Millions of smart metersMeter Time Volts Amps Cost 1 10:00 220 0.25 0.05 2 10.00 230 0.50 0.10 3 10:00 180 0.30 0.03 ... ... ... ... ... 1 10:15 240 0.65 0.10 2 10.15 230 0.50 0.10 3 10:15 180 0.30 0.03 ... ... ... ... ... Instant search
 Top performance Meter A day, a month or a year(s) data 1 00:00 { ... } ... 10:00 {220 0.25 0.05 } 10:15 { 240 0.65 0.10 } 10:30 { ... } ... 23:45 { ... } address 2 00:00 { ... } ... 10:00 {230 0.50 0.10 } 10:15 { 230 0.50 0.10 } 10:30 { ... } ... 23:45 { ... } ... name 3 00:00 { ... } ... 10:00 { Not available } 10:15 { Signal loss } 10:30 { ... } ... 23:45 { ... } ... photo
  • 21. Ordinary database indexing model <id> <title> </title> indexes Full database content indexing Automatically create and maintain fast full-text search index Web-style free text SEARCH and analytical JS/SQL queries Complex queries requiring steep learning curve SQL query: tens of seconds Our query: milliseconds RANKING INDEX
  • 22. Your original data in documents Index tree is organized into a graph, enabling you to set up your own search ranking (weighting) rules Distributed storage architecture words strings numbers dates names tags values relations XML
 & 
 JSON Ultra-fast database index for ranked search and online analytics RANKING INDEX%
  • 23. Ranking index delivers endless scale out ability to your data Organized as a modular graph, it enables to distribute data and computing MB►GB▶TB▶PB
  • 24. 
 
 
 Ordinary databases overload and overwhelm users with data Two main performance problems with ordinary databases
  • 25. 
 
 
 Disrupt your competition with fast and relevant full-text search Use ranking Relevance
 of search results Free text queries
 at subsecond latency Programmable filter that delivers superior search relevance Having billions of data?
  • 26. Scientists: ranking is a game-changing technology in databases Very Large Data Bases Conference 7th International Workshop on Ranking in Databases, 2013 “ the sheer amount of data makes it almost impossible to process queries in the traditional compute-then-sort approach ” “ Facing explosion of data ... the user would be overwhelmed by too many unranked results “
  • 27. Map
 application Address Product AddressProduct Company Company 100% 100% 75% 75% 50% 50% Ranking delivers superior search experience in your database Shop
 
 
 application Same data, different ranking rules for your free text search queries (think voice in future)
  • 28. Least relevant Address Company Easily configure your own ranking rules for your business needs Email Category Most relevant Product Your own data items (fields) in
 your XML or JSON database 100%0% 50% 100%0% 50% 100%0% 50% 100%0% 50% 100%0% 50% When free text search hits data with higher rankings, results are sorted up-front
  • 29. Simple, super-fast, user-friendly web-style 
 SEARCH Enjoy instantly relevant search in your data using only free text Plain text: Phrases: Wildcards: Patterns: java developer London “John Smith” Joh* Smi* or “John Smi*” John Sm?th Substitutes: John Sm[iy]th <query> </query>
  • 30. Two problems solved w1^100% w2^+30% w3^-20% integer 0 ..... 232
 ( when tag weightings are equal ) With ranking you can implement ranked pagination: 1 2 3 . . . RANKING
 INDEX Real-time Big Data SEARCH milli- seconds <id> <title> <document> </title> 
 50% Body 10% Comments 100% Ranking your database structure Title Ranking your documents Ranking your search query terms ..w1...w2 ........ w3 ........ Ranking density of context hits
  • 31. Ranked pagination (1 2 3 ..) solves information overload problem Limited screen estate Limited network bandwidth Limited waiting time by users Fast and relevant database search in your web and mobile applications Page: 1 2 3 4 5 more
  • 32. Constant query latency enables real-time Big data search and analytics PB GB TB MB Milliseconds for a JavaScript/SQL query in Clusterpoint database Minutes ... hours
 for a SQL query in legacy RDBMS Scale to billions of documents without search performance loss RANKING
 INDEX XML JSON
  • 33. Clusterpoint Cloud Database as a Service (DBaaS) We safely and efficiently manage your databases for you AND 
 We instantly scale on-demand!
  • 34. Clusterpoint Cloud is always ON, 99.99% available & reliable REST API JS/SQL http(s) tcp/ip
  • 35. Our cloud computing is using cost-efficient on-demand model Cost-Efficient
 Model, $ Resources Time Conventional Provisioning Model, $ Save 3x-10x 
 DB