Graph databases in PHP @ PHPCon Poland 10-22-2011

GraphDB in PHP
Alessandro Nadalin David Funaro

1

domenica 23 ottobre 11

Agenda

•Theory
•When to use a graph?
•Why graphDB?
•The graphDB community
•OrientDB
•OrientDB in PHP
•Demo
2


Essential (Theory)

3


Essential (Theory)

G=
Graph

3


Essential (Theory)

G = (V,
Vertex
Graph

3


Essential (Theory)

G = (V,
Vertex
Graph

A

3


Essential (Theory)

G = (V, E)
Vertex
Graph

Edge
A

3


Binary Relation

Hates

A B

Itchy Scratchy

4


Binary Relation

Edge

A B

Vertex Vertex

4


Graph

B E

F
A

D G

5


Undirected Graph

B E

A

D F

Example: Friendship 6


Directed Edge

A B

Vertex Vertex

7


Directed Edge

Edge

A B

Vertex Vertex

7


Directed Graph

A B

A
F

D

Example: Followee 8


Path

B E

F
A

D G

9


Path

A B D G E F

10


Graph -> GraphDB

GraphDB is a database that use the Graph
as its primary data structure

11


... when to use a graph ?


Web in ’99

13


Web in 2005

14


The social web

15


Your data is a graph

16


a tree is a graph

17


parent_id is a graph

18


Recommendations
lives in

John type shows
Mr
Fun Cinema B
Bean loca
tion
lik

Rome
es

shows Cinema A location
type
Thriller Se7en
s ho
ws

location Milan
Cinema C

19


Recommendations
lives in

John type shows
Mr
Fun Cinema B
Bean loca
tion
lik

Rome
es

type
shows Cinema A location ✓

x x
Thriller Se7en
s ho
ws

location Milan
Cinema C

20


Recommendations
lives in

John type shows
Mr
Fun Cinema B
Bean
✓ loca
tion
lik

Rome
es

type

x x
Thriller Se7en
s ho
ws

location Milan
Cinema C

21


Recommendations
lives in

John type shows
Mr
Fun Cinema B

✓
Bean
✓ loca
tion
lik

Rome
es

type

x x
Thriller Se7en
s ho
ws

location Milan
Cinema C

22


Recommendations
lives in

John

xFun
type Mr

✓
Bean
shows
Cinema B

✓ loca
tion
lik

Rome
es

type

x x
Thriller Se7en
s ho
ws

location Milan
Cinema C

23


Recommendations
lives in

John

x x x
Fun
type Mr
Bean
shows
Cinema B
loca
tion
lik

Rome
es

type
shows
✓
Cinema A location ✓

x x
Thriller Se7en
s ho
ws

location Milan
Cinema C

24


Recommendations
lives in

John

x x x
Fun
type Mr
Bean
shows
Cinema B
loca
tion
lik

Rome
es

type
shows
✓
✓ shows
x x
Thriller Se7en

location Milan
Cinema C

25


Recommendations
lives in

John

x x x
Fun
type Mr
Bean
shows
Cinema B
loca
tion
lik

Rome
es

type
shows
✓
✓ shows
x x
✓
Thriller Se7en

location Milan
Cinema C

26


Recommendations
lives in

John

x x x
Fun
type Mr
Bean
shows
Cinema B
loca
tion
lik

✓
Rome
es

type
shows
✓
✓ shows
x x
✓
Thriller Se7en

location Milan
Cinema C

27


Solve decision problems


Maximum flow


Given a dataset, calculate how to best organize it
maximum flow

travelling salesman problem


The pizza guy needs to deliver on A, B,C.


Decision base on distance, traffic, time and so on.


Shortest path

Identify "special" nodes of the graph


Given your dataset, organize some clusters

Are there some nodes which cannot belong to a cluster?

They probably have some properties different from the average


Given your dataset, organize some clusters

Are there some nodes which cannot belong to a cluster?

They probably have some properties different from the average

ACHTUNG!
TERRORISTEN!


but ... why graphDB?

38


Representing a Graph in:
http://www.slideshare.net/slidarko/problemsolving-using-graph-traversals-searching-
scoring-ranking-and-recommendation#

39


Representing a Graph in:
http://www.slideshare.net/slidarko/problemsolving-using-graph-traversals-searching-
scoring-ranking-and-recommendation#
✓ Relational Database
(mysql, oracle)

✓ Document Oriented DB
(mongodb, couchdb)

✓ XML Database
(MarkLogic, eXist-db)
39


where is the difference ?

40


GraphDB

A graph database is any storage
system that provides index-free
adjacency.

http://www.slideshare.net/slidarko/problemsolving-using-graph-traversals-searching-scoring-ranking-and-recommendation


Step by step example

Given a list of people, find their homepages

42


Tree-based DB WAY

1

43


Tree-based DB WAY

David Funaro

put in the Search Engine
2

1

43


Tree-based DB WAY

David Funaro

put in the Search Engine
2

find 3

1

http://davidfunaro.com
43


Tree-based DB WAY

David Funaro

The cost to find Search Engine friend HP
put in the a single
2

grows as the friends HP tables grows

find 3

1

43


GraphDB WAY

it’s like that the GraphDB has an additional information
(the ancor <a>)
44


GraphDB WAY

1 get the embedded
information(index)
www.odino.org

it’s like that the GraphDB has an additional information
(the ancor <a>)
44


GraphDB WAY

The Anchor work as a local index to
reach the document = index-free
adjacency

<a href=”http://odino.org”>
Alessandro Nadalin
</a>

45


Local cost

The local cost is O(k) = Constant

46


Local cost

The local cost is O(k) = Constant

47


Local cost

48


Local cost

Thus, as the graph grows in size,
the cost of a local step remain the same

48


any database can implicity represent a
graph

BUT
only a graph database make the graph
structure explicit

49


Benchmark

Deph RDBMS Graph
1 100ms 30ms
• 1 Million Vertex

• 4 Million Edge
2 1000ms 500ms
• Scale Free Tolopogy
3 10000ms 3000ms
• Postgres VS Neo4J
4 100000m 50000ms
s • Both Hash and BTree
5 N/A 100000m
s

50
http://markorodriguez.com/2011/02/18/mysql-vs-neo4j-on-a-large-scale-graph-traversal/


community that is building and feeding the GraphDB ecosystem
GraphDB community

ThinkerPop
Stack

Databases

data model and their
implementation

Blueprints is a collection of interfaces, implementations,
ouplementations, and test suites for the property graph data
model. Blueprints is analogous to the JDBC, but for graph
databases.

https://github.com/tinkerpop/blueprints/wiki/


a data flow Framework using Process Graph

provide a collection of "pipes" that are
connected togheter to from processing
pipelines


a graph-based programming language.

a Turing-Complete graph-base programming language
that compiles Gremlin syntax down to Pipes


a REST-full graph shell.

Allow blueprints graph to be exposed
through a RESTful API (HTTP)


What's hot


OrientDB


Glossary

RID
<10:05>
Cluster Position

58


Glossary

RID
<10:05>
Cluster Position

CLASS

58


Main features


Inheritance

class Vehicle

class Car
class Bike


class Vehicle

class Car
class Bike

SELECT FROM Vehicle WHERE owner = 1:1


class Vehicle

class Car
class Bike

can return records of class Bike or Car


Traversal


SELECT FROM fellas WHERE any() traverse(0,-1) ( @rid = [Michelle @rid] )
66


SELECT FROM fellas WHERE any() traverse(0,-1) ( @rid = [Michelle @rid] )
67


SELECT FROM fellas WHERE any() traverse(0,2) ( @rid = = [Michelle @rid] ))
SELECT FROM fellas WHERE any() traverse(0,2) ( @rid [Michelle @rid]


SELECT FROM fellas WHERE any() traverse(0,2) ( @rid = [Michelle @rid] )


SQL synthax


beyond SQL


SELECT FROM authors WHERE book.title = ...


ACID

speaks JSON


{ "schema": {
"name": "Address"
},
"result": [{
"@type": "d", "@rid": "#13:0", "@version": 6, "@class": "Address",
"type": "Residence",
"street": "Piazza Navona, 1",
"city": "#14:0",
"nick": "Luca2"
}, {
...
...


Double Protocol


HTTP


HTTP

Universal


HTTP

Easy to interact with


binary


binary

Blazing fast


on-record SELECTs


SELECT FROM cats


SELECT FROM 11:0


SELECT FROM [11:0,11:1]


SELECT FROM [11:0,12:0]


stress-free setup

./orient/bin/server.sh

93


in-memory DB


or disk-persisted


Supports standards Supports standards

96


•Inheritance
•Traversal
•Sql syntax like
•ACID
OrientDB •Speak JSON
•Double protocol
•on-record Select
•ThinkerPop Compliant

Oh, it's Java.

98


PHP ?


somebody started writing the
binary-protocol binding
https://github.com/AntonTerekhov/OrientDB-PHP
( beta0.4.1, 28 April 2010 )


$db = new OrientDB($host, $port);

$record = $db->recordLoad('1:1', '*:-1');

// $record instance of OrientDBRecord


and others


Orient Library

... are writing a complete library
https://github.com/congow/Orient

104


Orient = PHP Library to work with OrientDB

105


Data Mapper

Query Builder
HTTP Binding


HTTP Binding


use CongowOrient;
use CongowOrientFoundationBinding;

$driver = new OrientHttpClientCurl();
$orient = new Binding($driver, '127.0.0.1', '2480', 'admin', 'admin', 'demo');

$response = $orient->query("SELECT FROM Address");

$output = json_decode($response->getBody());

foreach ($output->result as $address)
{
var_dump($address->street);
}


use CongowOrient;
use CongowOrientFoundationBinding;

$driver = new OrientHttpClientCurl();
$orient = new Binding($driver, '127.0.0.1', '2480', 'admin', 'admin', 'demo');

$response = $orient->query("SELECT FROM Address");

$output = json_decode($response->getBody());

foreach ($output->result as $address)
{
var_dump($address->street); { "schema": {
"name": "Address"
} },
"result": [{
"@type": "d", "@rid": "#13:0", "@version": 6, "@class": "Address",
"type": "Residence",
"street": "Piazza Navona, 1",
"city": "#14:0",
"nick": "Luca2"
}, {
...
...


apart from ->query($SQL)


->get|delete|postClass($class)


->post|delete|put|getDocument($rid)


...and much more!

(connect, disconnect, ...)


Query Builder


use CongowOrientQuery;

$query = new Query();
$query->from(array('users'))->where('username = ?', "admin");

echo $query->getRaw();
// SELECT FROM users WHERE username = "admin"


$query->select(array('name', 'username', 'email'), false)
->from(array('12:0', '12:1'), false)
->where('any() traverse ( any() like "%danger%" )')
->orWhere("1 = ?", 1)
->andWhere("links = ?", 1)
->limit(20)
->orderBy('username')
->orderBy('name', true, true)
->range("12:0", "12:1");

SELECT name, username, email
FROM [12:0, 12:1]
WHERE any() traverse ( any() like "%danger%" )
OR 1 = "1" AND links = "1"
ORDER BY name, username
LIMIT 20
RANGE 12:0 12:1


Data Mapper


A Doctrine2 strange ODM


namespace PolandPHPConEntity;

use CongowOrientODMMapperAnnotations as ODM;

/**
* @ODMDocument(class="Person")
*/
class Speaker
{
/**
* @ODMProperty( type="string")
*/
protected $name;

public function setName($name)
{
$this->name = $name;
}


namespace PolandPHPConEntity;

use CongowOrientODMMapperAnnotations as ODM;

/**
* @ODMDocument(class="Person")
*/
class Speaker
{
/**
* @ODMProperty(type="string")
*/
protected $name;

public function setName($name)
{
$this->name = $name;
}


Domain Driven Design


{ "schema": {
"name": "Speaker"
},
"result": [{
"@type": "d", "@rid": "#1:0", "@version": 6, "@class": "Speaker",
"name": "David Coallier"
}, {
...
...


{ "schema": {
"name": "Speaker"
},
"result": [{
}, {
...
...

$david = $mapper->hydrate(json_decode($speaker));


{ "schema": {
"name": "Speaker"
},
"result": [{
}, {
...
...

$david instanceOf PolandPHPConEntitySpeaker


Repository Pattern

$repo = $manager->getRepository('Speaker')


$speakers = $repo->findAll();


$speaker = $repo->find($rid);


$criteria = array('Name' => 'Lorna');

$lornas = $repo->findBy($criteria);


$criteria = array(
'Name' => 'Lorna',
'last_name' => 'Jane'
);

$lornaJ = $repo->findOneBy($criteria);


Know your boundaries

138


https://github.com/doctrine/common/tree/master/lib/Doctrine/Common/Persistence

139


Theory sucks.

140


Demo

Menu items in RDBMS
id type page url
1 external NULL http://www.google.com
2 page 1 NULL

142


Demo
Menu items in OrientDB
Link

PageLink
rid title
{page
ExternalLink
rid title url

9:1 home 1 8:2 google google.com
143


That’s all, folks!

144



David Funaro
@ingdavidino

144



David Funaro Alessandro Nadalin
@ingdavidino @_odino_
http://davidfunaro.com http://odino.org

144


Credits

http://www.flickr.com/photos/sayamindu/5677281218/sizes/l/in/photostream/
http://farm1.static.flickr.com/182/471383865_79d04aec36_o.png
http://farm1.static.flickr.com/134/318947873_12028f1b66_b.jpg
http://www.flickr.com/photos/atomdocs/3275758118/sizes/o/in/photostream/
http://www.flickr.com/photos/pattipics/5229478393/sizes/o/in/photostream/
http://www.flickr.com/photos/kongharald/366597251/sizes/o/in/photostream/
http://www.everaldo.com/
http://www.flickr.com/photos/tusnelda/6140792529/sizes/l/in/photostream/
http://www.flickr.com/photos/mondi/5368644355/sizes/l/in/photostream/
http://www.flickr.com/photos/jayneandd/4191106566/sizes/l/in/photostream/
http://www.flickr.com/photos/jooon/2093253534/sizes/l/in/photostream/
http://www.flickr.com/photos/bluedharma/89186151/sizes/o/in/photostream/
http://www.flickr.com/photos/exfordy/2747089295/sizes/l/in/photostream/
http://www.flickr.com/photos/nostri-imago/3137422976/sizes/o/in/photostream/
http://www.flickr.com/photos/fionasjournal/379587818/sizes/z/in/photostream/
http://www.flickr.com/photos/nperlapro/1297392267/
http://www.flickr.com/photos/fastphive/28428808/sizes/m/in/photostream/
http://www.flickr.com/photos/rnugraha/2003147365/sizes/o/in/photostream/
http://www.flickr.com/photos/zigazou76/4412946911/sizes/l/in/photostream/
http://www.flickr.com/photos/greatnet/4667555436/sizes/l/in/photostream/
http://www.flickr.com/photos/mnsc/2768391365/sizes/l/in/photostream/
http://www.flickr.com/photos/christmaswithak/4675962453/sizes/l/in/photostream/
http://www.amazon.com/Trainspotting-Irvine-Welsh/dp/0393314804
http://www.flickr.com/photos/franconadalin59/5778176872/sizes/l/in/photostream/
http://farm6.static.flickr.com/5176/5474445627_875d621689_b.jpg
http://farm3.static.flickr.com/2243/2189435082_a16d3c89ae_b.jpg
http://farm3.static.flickr.com/2647/3816311930_ac52cff491_o.jpg
http://i130.photobucket.com/albums/p266/feike1977/PES6-4-3-3defencesettings.jpg
http://images.usatoday.com/life/_photos/2006/11/30/numb3rs-topper.jpg
http://www.flickr.com/photos/jakecaptive/3205277810/sizes/l/in/photostream/


Graph databases in PHP @ PHPCon Poland 10-22-2011

Recommandé

Recommandé

Contenu connexe

Dernier

Dernier (20)

En vedette

En vedette (20)

Graph databases in PHP @ PHPCon Poland 10-22-2011