A RESTful API for Controlling Dynamic Streaming Topologies
•
0 j'aime•730 vues
A RESTful API for Controlling Dynamic Streaming Topologies, presented at the WS-REST 2014 Workshop.
Recommandé
Contenu connexe
En vedette
En vedette (17)
Similaire à A RESTful API for Controlling Dynamic Streaming Topologies
Similaire à A RESTful API for Controlling Dynamic Streaming Topologies (20)
Dernier
Dernier (20)
A RESTful API for Controlling Dynamic Streaming Topologies
- 1. A RESTful API for Controlling Dynamic Streaming Topologies Masiar Babazadeh! University of Lugano Switzerland @masiarb Cesare Pautasso! University of Lugano Switzerland @pautasso 1
- 2. 2 F CP F F
- 3. 3 P
- 4. 4 F
- 5. 5 C
- 6. 6 P C
- 7. 7
- 11. 9
- 12. 9
- 13. 9
- 14. 9
- 15. 9
- 16. 9
- 17. 9
- 18. 10
- 22. 12 F Workers
- 34. 15 F CP F FX
- 35. 15 F CP F FX
- 36. 15 F CP F
- 37. 15 F CP F F
- 47. 19 RPC
- 48. 20 REST
- 50. 22 Operator
- 51. 22 Operator
- 52. 22 Operator
- 53. 22 Operator
- 54. 22 Operator
- 58. 24 Operator Error Detection & Recovery
- 59. 24 Operator Error Detection & Recovery operators[0].getWorkers();
- 60. 24 Operator Error Detection & Recovery Exception
- 61. 24 Operator Error Detection & Recovery GET …/workers
- 62. 24 Operator Error Detection & Recovery “request timeout”
- 63. 24 Operator Error Detection & Recovery {! ! “error” : …! }
- 64. 24 Operator Error Detection & Recovery GET …/workers
- 65. 24 Operator Error Detection & Recovery
- 66. 25 Representations { "topology": { "id": "example", "operators": […], "bindings": […] } } <topology> <id>example</id> <operators> <operator>…</operator> … </operators> <bindings> <binding>…</binding> … </bindings> </topology>
- 67. 2626 F CP F F
- 74. 28 Peer Discovery C F GET /! GET /peers! POST /peers! GET /peers/:pid! DELETE /peers/:pid
- 75. 29 Peer Representation {! "peer": ! {! ! ! ! ! ! "id": "example",! ! ! ! ! ! "operators": […],! ! ! ! ! ! "topologies": […],! ! ! ! ! ! "CPU": [0, 50, 0] ! ! ! ! }! } GET /peers/example
- 76. 30 Topologies GET /topologies! POST /topologies! GET /topologies/:tid! PUT /topologies/:tid! DELETE /topologies/:tid F CP F
- 77. 31 Topology Representation { "topology": { "id": "example", "operators": […], "bindings": […] } } GET /topologies/example
- 78. 32 F Operators GET /operators! GET /topologies/:tid/operators! GET /topologies/:tid/operators/:oid! PUT /topologies/:tid/operators/:oid! PATCH /topologies/:tid/operators/:oid/script! PATCH /topologies/:tid/operators/:oid/bindings! DELETE /topologies/:tid/operators/:oid
- 79. 33 {! "operators" : [! {! "topology" : "example",! "id" : "prod",! "workers" : […],! "href" : “…/topologies/example/operators/prod”,! "peer" : "http://IP:port/",! "replicas" : [! ! "http://IP2:port2/topologies/example/operators/prod"! ! ! ] ! ! },! ]! } Operator Representation GET /topologies/example/operators
- 80. 34 “topology” : { “operators: […], "bindings": [ { "from": “…/topologies/example/operators/a”, "to": “…/topologies/example/operators/b”, "type": "round_robin" }, { "from": “…/topologies/example/operators/b”, "to": “…/topologies/example/operators/c”, "type": "broadcast" } ] } Binding Representation
- 81. 35 Workers GET ! /topologies/:tid/operators/:oid/workers! GET ! /topologies/:tid/operators/:oid/workers/:wid! POST ! /topologies/:tid/operators/:oid/workers! DELETE ! /topologies/:tid/operators/:oid/workers/:wid
- 82. 36 “operators“ : [! !{! ! "topology" : "example",! "id" : "prod", ! "workers" : [! ! ! {! ! ! ! "id" : "0",! ! ! ! "href" : “…/topologies/example/operators/prod/workers/0”,! ! ! ! "operator" : “…/topologies/example/operators/prod”,! ! ! ! "uptime" : 3600,! ! ! ! "messages" : 42,! ! ! ! "req-res-ratio" : 1.5! ! ! }, …! ! ],! ! …! ! }! ] Worker Representation
- 83. 37
- 87. 3838 F “workers”: [ ! {! ! ! ! "id" : "0",! ! ! ! "href" : …,,! ! ! ! "operator" : …,! ! ! ! "uptime" : 3600,! ! ! ! "messages" : 42,! ! ! ! "req-res-ratio" : 1.5”,! ! ! },! !…! ]Load Balancing
- 94. 3939 F “workers”: [ ! {! ! ! ! "id" : "0",! ! ! ! "href" : “…/prod/workers/0”,! ! ! ! …! ! ! },! {! ! ! ! “id” : “1”,! ! ! ! “href” : …,! ! ! ! “error”: “request timeout”! ! ! }! ] Fault Tolerance
- 102. 40 F CP F “operators”: [ ! {! ! ! ! …! ! ! },! {! ! ! “id” : “C”,! ! ! “href” : …,! ! ! “error” : ! ! ! “request timeout”! ! ! }! ]Fault Tolerance
- 120. 42 F CP F { ! ! “peer”: ! {! ! ! ! …! ! ! ! “CPU” : ! ! ! ! [100,100,100] ! }! }Peer Overloading
- 133. 44
- 134. 44
- 135. 44
- 136. 44
- 137. 44
- 138. 44
- 139. A RESTful API for Controlling Dynamic Streaming Topologies Masiar Babazadeh! University of Lugano Switzerland @masiarb Cesare Pautasso! University of Lugano Switzerland @pautasso 45 http://design.inf.usi.ch/