Contenu connexe Similaire à Infinite graph nosql meetup dec 2012 (10) Plus de InfiniteGraph (20) Infinite graph nosql meetup dec 20121. Choosing The Right Big Data Tools For The Job –
A Polyglot Approach
Current Big Data Analytics
Relationship Analytics
The NoSQL Polyglot Approach
The Big Data Connection Platform
Leon Guzenda
Silicon Valley NoSQL Meetup
December 11, 2012
2. Objectivity Inc.
• Objectivity, Inc. is headquartered in Sunnyvale, CA.
• Objectivity has over two decades of Big Data and NoSQL experience
• We develop NoSQL platforms for managing and discovering relationships and
patterns in complex data:
– Objectivity/DB - an object database that manages localized, centralized or
distributed databases
– InfiniteGraph - a massively scalable graph database built on Objectivity/DB
that enables organizations to find, store and exploit the relationships in their
data
Millions of deployments - Our technology is embedded in hundreds of enterprise
and government systems and commercial products
Copyright © Objectivity, Inc. 2012
3. A Typical “Big Data” Analytics Setup
Data Aggregation and Analytics Applications
Commodity Linux Platforms and/or High Performance Computing Clusters
Column Data Graph Object K-V
RDBMS Hadoop Doc DB
Store W/H DB DB Store
Structured Semi-Structured Unstructured
Copyright © Objectivity, Inc. 2012
4. Not Only SQL – A group of 4 primary technologies
Simple Highly
Interconnected
Copyright © Objectivity, Inc. 2012
6. Incremental Analytics Improvements Aren’t Enough
All current solutions use the same basic architectural model
• None of the current solutions have a way to store connections between
entities in different silos
• Most analytic technology focuses on the content of the data nodes, rather
than the many kinds of connections between the nodes and the data in those
connections
• Why? Because traditional and earlier NoSQL solutions are bad at handling
relationships.
• Graph databases can efficiently store, manage and query the many kinds of
relationships hidden in the data.
Copyright © Objectivity, Inc. 2012
7. Relationship (Connection) Analytics...
A SQL Shortcoming
Think about the SQL query for finding all links between the two “blue” rows... it's hard!!
Table_A Table_B Table_C Table_D Table_E Table_F Table_G
There are some kinds of complex relationship handling problems that SQL
wasn't designed for.
8. Relationship (Connection) Analytics...
A SQL Shortcoming
Table_A Table_B Table_C Table_D Table_E Table_F Table_G
InfiniteGraph - The solution can be found with a few lines of code
A3 G4
Copyright © Objectivity, Inc. 2012
9. Applications for Relationship Analytics
MARKET ANALYSIS SOCIAL NETWORK ANALYSIS
LOGISTICS HEALTHCARE INFORMATICS
Copyright © Objectivity, Inc. 2012
10. Representing the Graph...
The existing intelligence data might look like this:
Events/Places People/Orgs Facts
Situation X Combatant A A Called P A Seen Near X P Emailed S
Situation Y Bank X P Called Q Q Seen Near T X Paid S
Target T Civilian P R Seen Near T
P Called R
Cafe C Civilian Q A Banks at X S Seen Near T
Civilian R A Seen At Y
A Eats At
Civilian S
Copyright © Objectivity, Inc. 2012
11. Representing the Graph...
We start by identifying the nodes (Vertices) and the connections (Edges)
NODES CONNECTIONS
Events/Places People/Orgs Facts
Situation X Combatant A A Called P A Seen Near X P Emailed S
Situation Y Bank X P Called Q Q Seen Near T X Paid S
Target T Civilian P R Seen Near T
P Called R
Cafe C Civilian Q A Banks at X S Seen Near T
Civilian R A Seen At Y
A Eats At
Civilian S
Copyright © Objectivity, Inc. 2012
13. ...Representing the Graph..
“Nodes” VERTEX EDGE “Connections”
Situation X Seen Near Combatant A Seen At Situation Y
Eats At Called Banks At
Cafe C Civilian P Bank X
Called Called Emailed Paid
Civilian Q Civilian R Civilian S
Seen Near Seen Near Seen Near
Target T
Copyright © Objectivity, Inc. 2012
14. ...Analyzing the Graph...
Situation X Seen Near Combatant A Seen At Situation Y
Called Banks At
Eats At
Cafe C Civilian P Bank X
Called Called Emailed Paid
Civilian Q Civilian R Civilian S
Seen Near Seen Near Seen Near
Target T
Copyright © Objectivity, Inc. 2012
15. ...Analyzing the Graph...
Situation X Seen Near Combatant A Seen At Situation Y
Called Banks At
Eats At
Cafe C Civilian P Bank X
Called Called Emailed Paid
Civilian Q Civilian R Civilian S
Seen Near Seen Near Seen Near
Target T
Copyright © Objectivity, Inc. 2012
16. ...Threat Analysis
Situation X Seen Near Combatant A Seen At Situation Y
Called Banks At
SUSPECTS
Civilian P Bank X
Called Called Emailed Paid
Civilian Q Civilian R Civilian S
Seen Near Seen Near Seen Near
Target T NEEDS PROTECTION
Copyright © Objectivity, Inc. 2012
17. Graph Databases Can Connect The Dots
DATABASE(S)
GRAPH DATABASE
Copyright © Objectivity, Inc. 2012
20. We (Oracle, Objectivity and Impetus) can help you combine Oracle NoSQL
Products with InfiniteGraph to produce...
YOUR BIG DATA CONNECTION PLATFORM
21. InfiniteGraph - The Enterprise Graph Database
• A high performance distributed database engine that supports analyst-time decision
support and actionable intelligence
• Cost effective link analysis – flexible deployment on commodity resources (hardware
and OS).
• Efficient, scalable, risk averse technology – enterprise proven.
• High Speed parallel ingest to load graph data quickly.
• Parallel, distributed queries
• Flexible plugin architecture
• Complementary technology
• Fast proof of concept – easy to use Graph API.
Copyright © Objectivity, Inc. 2012
22. InfiniteGraph Capabilities
Parallel Graph Traversal Inclusive or Exclusive Selection
X
Start Start
X
Shortest or All Paths Between Objects Computational & Visualization Plug-Ins
Compute Cost To Date
Start Finish Start
Visualize
Copyright © Objectivity, Inc. 2012
23. Conventional & Relationship Analytics
Data Visualization
& Analytics
*Now HP *Now IBM
Big Data Connection ORACLE
Platform Big Data
Solutions
+
Impetus, Oracle and Objectivity can help you combine Oracle NoSQL Products
with InfiniteGraph to produce a customized Big Data Analytics Platform
Copyright © Objectivity, Inc. 2012
24. Thank You!
Please take a look at objectivity.com
For InfiniteGraph Online Demos, White Papers, Free
Downloads, Samples & Tutorials
Notes de l'éditeur Thinking we should be less about Objy in the last bullet… possibly Object oriented and graph databases… ? Note Object Oriented Databases as NOSQL here. This section seems out of place. By having a scalable and distributed platform that can manage connections between all types of disparate data, enterprise can easily capitalize on the best tools for the job at hand.