SlideShare a Scribd company logo
1 of 18
Download to read offline
Interoperability of Lightpath Provisioning
   Systems in a Multi-domain Testbed


                    Fred Wan
                   Paola Grosso
                   Cees de Laat

              University of Amsterdam

   System and Network Engineering research group
Overview
• Background
   –   E-science and dynamic resource allocation and provisioning
   –   GLIF, NRENs and GOLEs
   –   Lightpaths/deterministic paths
   –   Network Resource Provisioning Systems (NRPSs)
• Network service- and control-planes
   –   General NRPS architecture
   –   Multi-domain NRPSs: Chain versus Tree model
   –   Harmony, Fenius, IDC
   –   Interoperability requirements
   –   Automated GOLE pilot, Fenius
   –   SC10 demo
• Conclusions and future work
Dynamic Resource Allocation and Provisioning
• National Research and Education Networks (NRENs) facilitate data
  transport between
   –   compute resources
   –   scientific instruments
   –   data-storage
   –   distributed measurement equipment
• Dynamic resource allocation: The network as a dynamic resource
• Efforts to combine international e-science resources:
   – EU projects Phosphorus (finished), Geysers (current), FEDERICA, Panlab,
     FIRE, etc.
   – US projects, e.g. GENI
• Problem: how to combine, allocate and control the inter-NREN
  network?
• Current status: manually by NREN NOCs
• Goal: automate request processing for network connections (advance
  reservation and provisioning)
GLIF and GOLEs
• Global Lambda Integrated Facility
• Virtual international organization promoting paradigm of lambda
  networking
• Collaborative initiative among worldwide NRENs, consortia and
  institutions
• World-scale Lambda based Laboratory to facilitate application and
  middleware development
• GOLE – GLIF Open Lightpath Exchange
   – Peering point for lightpaths
   – Global model: MANLAN, NetherLight, UKLight, Starlight, NorthernLight, …
• Open anyone can bring lambdas
   – Lambda owner controls port
   – GOLE owner makes cross connects happen
   – Limitations only in technology
GLIF: Global Lambda Integrated Facility




http://www.glif.is
GLIF Europe




Global Open Lightpath Exchanges (GOLEs):
NetherLight
NorthernLight
CERNLight
Netherlight GOLE: Global Open Lightpath
               Exchange
Connection requirements and Control
• Overprovisioning best-effort networks does not work
• Requirements:
   – deterministic bandwidth
   – point to point connection
   – capacity and timeliness guarantees when transferring large chunks
     asynchronously
   – Bandwidth guarantees and jitter-free transport when transferring
     synchronously
• Available technologies: GMPLS, WDM, TDM (layer 1) and PBT (layer 2)
• TDM: provision a number of VC-4 (or other capacity) channels by
  creating cross connects on the switches comprising the path
• Configuration: CLI, TL1, SNMP
• Integrate NEs into workflow: Network Resource Provisioning Systems
  (NRPSs) so lightpaths can be reserved in advance
• General design abstracted from various implementations
General inter-domain NSP design and implementations
                       Single-domain NRPSs:




                       Multi-domain NSP: OSCARS & DRAGON (IDC)




                                             IDC
                                       Internet2, ESnet
Inter-domain path reservation and provisioning:
                 Two models




• Federated model: uniform request interface, topology exchange
  and event notification among peers
Legend: East / West interfaces
                                                                                          Grid
                          Reservation service interface
       ----------------------------------------------------------                      Middleware                                                  Reservation WS:
                         Topology service interface                                                                                                • Availability Request
                                                                                                                                                   • Create Reservation Request
                                                                                                 Request for end-to-end resource
                                                                                                          provisioning

                                                                Network Service Plane
                                                                                                                                                   • Query Reservation(s) Request
                                                                                                                                                   • Activate Reservation Request
                                                                                                            Database
                                 Topology information
                                                                                                                                                   • Cancel Reservation Request
                                         NRPS address information
                                                                                                                                                   • Status Request

                                 Topology
                                                                       NRPS Manager                            Path                                 Topology WS:
                                                                                                             Computer
                                  Service                                                                                                           • Add domain
                                                                    Reservation service client
                                                                                                                                                    • Delete domain




                                                                                                                                Interoperability
                                                                                                                                                    • Edit domain
                                                                                 Resource reservations




                                                                                                                                     layer
                                                                                                                                                    • Retrieve domain
                                                                                                                                                    • Add Endpoints
                                                                                                                                                    • Delete Endpoint
                   Reservation Topology
                     service    client
                                                                    Reservation Topology
                                                                      service    client
                                                                                                         Reservation Topology
                                                                                                           service    client                        • Edit Endpoints
                                                                                                                                                    • Retrieve Endpoints
                             Adapter                                        Adapter                            Adapter
                                                                                                                                                    • Add Link
                       ARGON driver                                      UCLP driver                        DRAC driver
                                                                                                                                                    • Delete Link
                                                                                                                                                    • Edit Link
                                                                                                                                                    • Retrieve Link

                       ARGON domain                                     UCLP domain                             DRAC domain




Centralized model: unification of request interface through an adaptation
layer, overlay topology and central event management
Automated GOLE pilot

               • 16 Networks/GOLEs
               • NRPSs: IDC, ARGIA,
                 DRAC, G-Lambda,
                 AutoBAHN
               • Central controller:
                 Fenius
               • Fenius: simpler
                 version of Harmony
SC09 setup (UvA view)




• Dynamic lightpath provisioning between GOLEs/Networks
• Each domain: perfSONAR deployed
• Demo: light turns green when connections are made
Pinger matrix
Example Scenario: UvA-StarLight


                        • Fenius translator on
                          each domain
                        • Super-Agent:
                           – central request
                             handler,
                           – inter-domain path-
                             finder
                           – messaging to
                             translators
                        • Domain-NRPSs
                          handle path-setup
                        • Translators can be
                          queried
Endpoints involved in the UvA-StarLight path


UvALight   urn:ogf:network:domain=uvalight.net:node=geller:port=s8p4:link=geller_8630_GBR_s8p4 geller_8630_GBR_s8p4 netherlight.net:f25s1t:0-5:UvA
UvALight   urn:ogf:network:domain=uvalight.net:node=geller:port=s8p5:link=geller_8630_GBR_s8p5 geller_8630_GBR_s8p5 netherlight.net:f25s1t:0-6:UvA
UvALight   urn:ogf:network:domain=uvalight.net:node=sweggb2:port=g2:link=sweggb2_RJ-45_g2                 NetherLight-UvALight     VM_fooyoung (perfSONAR)




                                             NetherLight     netherlight.net:f25s1t:0-5:UvA         Force10_Ge0/5 (to UvALight)   UvA : geller_8630_GBR_s8p4
                                             NetherLight     netherlight.net:f25s1t:0-6:UvA         Force10_Ge0/6 (to UvALight)   UvA : geller_8630_GBR_s8p5
                                             NetherLight     netherlight.net:f25s1t:0-7:StarLight   To StarLight                  StarLight




                                                           Starlight    starlight:arista-sl:1/13    to USLHCNet / NetherLight       USLHCNet & NetherLight

                                                           Starlight    starlight:arista-sl:1/14    to JGN2                         JGN2

                                                           Starlight    starlight:arista-sl:1/24    StarLight PerfSONAR             StarLight PerfSONAR
Conclusions and future work
• Interoperability between heterogeneous Network Resource
  Provisioning Systems is possible
• An hierarchical model is easiest to realize for heterogeneous NRPSs
  (lesson learned from Harmony)
• A federated model is more flexible (design changes in the interface
  apply to all instances), has enhanced interoperability and scalability
• We have show that mixing the two models is possible, but leads to a
  lot of ad-hoc solutions
• Ideal solution is a standardized Network Service Interface: work
  underway in the OGF-NSI working group. However: slow progress
• Future work:
    – Investigate automation of GOLES: OGF automated-GOLE WG
    – Improve the design and application of the current prevalent hierarchical
      design component: Fenius
    – Investigate if an IDC service interface can be designed to improve
      integration with DRAC
Questions?

Thank you!

More Related Content

Similar to Research on Networks presentation at SURFnet, November 8th 2010

ARCHSTONE: Intelligent Network Services for Advanced Application Workflows
ARCHSTONE: Intelligent Network Services for Advanced Application WorkflowsARCHSTONE: Intelligent Network Services for Advanced Application Workflows
ARCHSTONE: Intelligent Network Services for Advanced Application WorkflowsEd Dodds
 
Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...balmanme
 
Virtualizing Latency Sensitive Workloads and vFabric GemFire
Virtualizing Latency Sensitive Workloads and vFabric GemFireVirtualizing Latency Sensitive Workloads and vFabric GemFire
Virtualizing Latency Sensitive Workloads and vFabric GemFireCarter Shanklin
 
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...balmanme
 
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...Tal Lavian Ph.D.
 
Optimization of Resource Provisioning Cost in Cloud Computing
Optimization of Resource Provisioning Cost in Cloud Computing Optimization of Resource Provisioning Cost in Cloud Computing
Optimization of Resource Provisioning Cost in Cloud Computing Sivadon Chaisiri
 
Analyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation NetworksAnalyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation Networksbalmanme
 
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...Tal Lavian Ph.D.
 
Shared personalization service. How to scale to 15 k rps (Patrice Pelland)
Shared personalization service. How to scale to 15 k rps (Patrice Pelland)Shared personalization service. How to scale to 15 k rps (Patrice Pelland)
Shared personalization service. How to scale to 15 k rps (Patrice Pelland)Ontico
 
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...Tal Lavian Ph.D.
 
Business Models for Dynamically Provisioned Optical Networks
Business Models for Dynamically Provisioned Optical NetworksBusiness Models for Dynamically Provisioned Optical Networks
Business Models for Dynamically Provisioned Optical NetworksTal Lavian Ph.D.
 
Active dataguard
Active dataguardActive dataguard
Active dataguardManoj Kumar
 
Demo Etom Information Structure
Demo Etom Information StructureDemo Etom Information Structure
Demo Etom Information StructureSergey Khylevich
 
Network Operations Managed Services (NOMS)
Network Operations Managed Services (NOMS)Network Operations Managed Services (NOMS)
Network Operations Managed Services (NOMS)TMNG Global
 
Ramakrishnan Keynote Ladis2009
Ramakrishnan Keynote Ladis2009Ramakrishnan Keynote Ladis2009
Ramakrishnan Keynote Ladis2009yarapavan
 

Similar to Research on Networks presentation at SURFnet, November 8th 2010 (20)

ARCHSTONE: Intelligent Network Services for Advanced Application Workflows
ARCHSTONE: Intelligent Network Services for Advanced Application WorkflowsARCHSTONE: Intelligent Network Services for Advanced Application Workflows
ARCHSTONE: Intelligent Network Services for Advanced Application Workflows
 
Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...
 
Virtualizing Latency Sensitive Workloads and vFabric GemFire
Virtualizing Latency Sensitive Workloads and vFabric GemFireVirtualizing Latency Sensitive Workloads and vFabric GemFire
Virtualizing Latency Sensitive Workloads and vFabric GemFire
 
Chapter8 6up
Chapter8 6upChapter8 6up
Chapter8 6up
 
40234553 drive-test
40234553 drive-test40234553 drive-test
40234553 drive-test
 
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...
 
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
 
Optimization of Resource Provisioning Cost in Cloud Computing
Optimization of Resource Provisioning Cost in Cloud Computing Optimization of Resource Provisioning Cost in Cloud Computing
Optimization of Resource Provisioning Cost in Cloud Computing
 
Philly DB MapR Overview
Philly DB MapR OverviewPhilly DB MapR Overview
Philly DB MapR Overview
 
Search Computing
Search ComputingSearch Computing
Search Computing
 
Analyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation NetworksAnalyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation Networks
 
RA self tuning on LTE
RA self tuning on LTERA self tuning on LTE
RA self tuning on LTE
 
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...
 
Shared personalization service. How to scale to 15 k rps (Patrice Pelland)
Shared personalization service. How to scale to 15 k rps (Patrice Pelland)Shared personalization service. How to scale to 15 k rps (Patrice Pelland)
Shared personalization service. How to scale to 15 k rps (Patrice Pelland)
 
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
 
Business Models for Dynamically Provisioned Optical Networks
Business Models for Dynamically Provisioned Optical NetworksBusiness Models for Dynamically Provisioned Optical Networks
Business Models for Dynamically Provisioned Optical Networks
 
Active dataguard
Active dataguardActive dataguard
Active dataguard
 
Demo Etom Information Structure
Demo Etom Information StructureDemo Etom Information Structure
Demo Etom Information Structure
 
Network Operations Managed Services (NOMS)
Network Operations Managed Services (NOMS)Network Operations Managed Services (NOMS)
Network Operations Managed Services (NOMS)
 
Ramakrishnan Keynote Ladis2009
Ramakrishnan Keynote Ladis2009Ramakrishnan Keynote Ladis2009
Ramakrishnan Keynote Ladis2009
 

Research on Networks presentation at SURFnet, November 8th 2010

  • 1. Interoperability of Lightpath Provisioning Systems in a Multi-domain Testbed Fred Wan Paola Grosso Cees de Laat University of Amsterdam System and Network Engineering research group
  • 2. Overview • Background – E-science and dynamic resource allocation and provisioning – GLIF, NRENs and GOLEs – Lightpaths/deterministic paths – Network Resource Provisioning Systems (NRPSs) • Network service- and control-planes – General NRPS architecture – Multi-domain NRPSs: Chain versus Tree model – Harmony, Fenius, IDC – Interoperability requirements – Automated GOLE pilot, Fenius – SC10 demo • Conclusions and future work
  • 3. Dynamic Resource Allocation and Provisioning • National Research and Education Networks (NRENs) facilitate data transport between – compute resources – scientific instruments – data-storage – distributed measurement equipment • Dynamic resource allocation: The network as a dynamic resource • Efforts to combine international e-science resources: – EU projects Phosphorus (finished), Geysers (current), FEDERICA, Panlab, FIRE, etc. – US projects, e.g. GENI • Problem: how to combine, allocate and control the inter-NREN network? • Current status: manually by NREN NOCs • Goal: automate request processing for network connections (advance reservation and provisioning)
  • 4. GLIF and GOLEs • Global Lambda Integrated Facility • Virtual international organization promoting paradigm of lambda networking • Collaborative initiative among worldwide NRENs, consortia and institutions • World-scale Lambda based Laboratory to facilitate application and middleware development • GOLE – GLIF Open Lightpath Exchange – Peering point for lightpaths – Global model: MANLAN, NetherLight, UKLight, Starlight, NorthernLight, … • Open anyone can bring lambdas – Lambda owner controls port – GOLE owner makes cross connects happen – Limitations only in technology
  • 5. GLIF: Global Lambda Integrated Facility http://www.glif.is
  • 6. GLIF Europe Global Open Lightpath Exchanges (GOLEs): NetherLight NorthernLight CERNLight
  • 7. Netherlight GOLE: Global Open Lightpath Exchange
  • 8. Connection requirements and Control • Overprovisioning best-effort networks does not work • Requirements: – deterministic bandwidth – point to point connection – capacity and timeliness guarantees when transferring large chunks asynchronously – Bandwidth guarantees and jitter-free transport when transferring synchronously • Available technologies: GMPLS, WDM, TDM (layer 1) and PBT (layer 2) • TDM: provision a number of VC-4 (or other capacity) channels by creating cross connects on the switches comprising the path • Configuration: CLI, TL1, SNMP • Integrate NEs into workflow: Network Resource Provisioning Systems (NRPSs) so lightpaths can be reserved in advance • General design abstracted from various implementations
  • 9. General inter-domain NSP design and implementations Single-domain NRPSs: Multi-domain NSP: OSCARS & DRAGON (IDC) IDC Internet2, ESnet
  • 10. Inter-domain path reservation and provisioning: Two models • Federated model: uniform request interface, topology exchange and event notification among peers
  • 11. Legend: East / West interfaces Grid Reservation service interface ---------------------------------------------------------- Middleware Reservation WS: Topology service interface • Availability Request • Create Reservation Request Request for end-to-end resource provisioning Network Service Plane • Query Reservation(s) Request • Activate Reservation Request Database Topology information • Cancel Reservation Request NRPS address information • Status Request Topology NRPS Manager Path Topology WS: Computer Service • Add domain Reservation service client • Delete domain Interoperability • Edit domain Resource reservations layer • Retrieve domain • Add Endpoints • Delete Endpoint Reservation Topology service client Reservation Topology service client Reservation Topology service client • Edit Endpoints • Retrieve Endpoints Adapter Adapter Adapter • Add Link ARGON driver UCLP driver DRAC driver • Delete Link • Edit Link • Retrieve Link ARGON domain UCLP domain DRAC domain Centralized model: unification of request interface through an adaptation layer, overlay topology and central event management
  • 12. Automated GOLE pilot • 16 Networks/GOLEs • NRPSs: IDC, ARGIA, DRAC, G-Lambda, AutoBAHN • Central controller: Fenius • Fenius: simpler version of Harmony
  • 13. SC09 setup (UvA view) • Dynamic lightpath provisioning between GOLEs/Networks • Each domain: perfSONAR deployed • Demo: light turns green when connections are made
  • 15. Example Scenario: UvA-StarLight • Fenius translator on each domain • Super-Agent: – central request handler, – inter-domain path- finder – messaging to translators • Domain-NRPSs handle path-setup • Translators can be queried
  • 16. Endpoints involved in the UvA-StarLight path UvALight urn:ogf:network:domain=uvalight.net:node=geller:port=s8p4:link=geller_8630_GBR_s8p4 geller_8630_GBR_s8p4 netherlight.net:f25s1t:0-5:UvA UvALight urn:ogf:network:domain=uvalight.net:node=geller:port=s8p5:link=geller_8630_GBR_s8p5 geller_8630_GBR_s8p5 netherlight.net:f25s1t:0-6:UvA UvALight urn:ogf:network:domain=uvalight.net:node=sweggb2:port=g2:link=sweggb2_RJ-45_g2 NetherLight-UvALight VM_fooyoung (perfSONAR) NetherLight netherlight.net:f25s1t:0-5:UvA Force10_Ge0/5 (to UvALight) UvA : geller_8630_GBR_s8p4 NetherLight netherlight.net:f25s1t:0-6:UvA Force10_Ge0/6 (to UvALight) UvA : geller_8630_GBR_s8p5 NetherLight netherlight.net:f25s1t:0-7:StarLight To StarLight StarLight Starlight starlight:arista-sl:1/13 to USLHCNet / NetherLight USLHCNet & NetherLight Starlight starlight:arista-sl:1/14 to JGN2 JGN2 Starlight starlight:arista-sl:1/24 StarLight PerfSONAR StarLight PerfSONAR
  • 17. Conclusions and future work • Interoperability between heterogeneous Network Resource Provisioning Systems is possible • An hierarchical model is easiest to realize for heterogeneous NRPSs (lesson learned from Harmony) • A federated model is more flexible (design changes in the interface apply to all instances), has enhanced interoperability and scalability • We have show that mixing the two models is possible, but leads to a lot of ad-hoc solutions • Ideal solution is a standardized Network Service Interface: work underway in the OGF-NSI working group. However: slow progress • Future work: – Investigate automation of GOLES: OGF automated-GOLE WG – Improve the design and application of the current prevalent hierarchical design component: Fenius – Investigate if an IDC service interface can be designed to improve integration with DRAC