SlideShare une entreprise Scribd logo
1  sur  55
Télécharger pour lire hors ligne
Cross-SDO Projects to Accelerate Cloud Innovation
Alan Sill, Ph.D
Site Director, Cloud and Autonomic Computing Center
Senior Scientist, High Performance Computing Center
Adjunct Professor of Physics

Texas Tech University
Vice President of Standards, Open Grid Forum
Standards as a Means to Interoperability
• Risk reduction:
• Lessen risk of dead-end product design and orphan
components.	

• Lessen or remove risk of vendor service lock-in.	

• Mitigate reusability barriers for software and data access.	

• Provide best-of-breed development and methods.
• Mix-and-match for input & output of processing steps.
• Allow innovation/competition at more interesting layers
and development of better internal features.
• Facilitate interoperation with other provider software
services, components and infrastructures.
• Approach must be explicitly cross-SDO and cross-vendor.
Alan Sill, TTU
November 20, 2013
!2
CAC Goals and Vision
The Texas Tech site intends to provide a practical work arena for
development and coordination of standards, standards-based
software and reference implementations applicable to cloud
and other forms of advanced distributed computing.
The site will fill a need to organize, classify, develop reference
implementations for and otherwise contribute to standardsbased software in advanced distributed computing.
The vision that underlies these goals is one of harmonious,
coordinated development of software that interoperates across
many boundaries of deployment and implementation, and that
can be repurposed, rescaled and redeployed as needed to solve
a wide variety of user, vendor and supplier problems.
Alan Sill, TTU
November 20, 2013
!4
Standards, Clouds and Interoperability:
Our vision at the CAC is that appropriate use of standards
as part of the innovation process permits software and
hardware used in clouds to interoperate with other
components and infrastructures, and thus reduces risks
including the risk of unwanted vendor lock-in.	

!

This allows developers, vendors and users to focus more
on higher level capabilities and therefore less on
reinventing common aspects and features of their APIs and
interface modules.	

!

Coupling standards and software innovation is therefore
crucial to economical cloud development at this stage.
Alan Sill, TTU
November 20, 2013
!5
Background:

Large-Scale Science

Alan Sill, TTU
November 20, 2013
The Large Hadron Collider
10k CPU cores,
2M lines of code
Muon system:
Drift tubes (170k wires), RPC,
Cathode Strip Ch.(200k wires)

Silicon tracker:
66M pixel channels
9.6M strips, 210 m2

ECAL: 76k PbWO4 crystals
HCAL: 15k scint/brass ch.
Beam Crossings at the LHC
Where a lot of things happen at once…
and then happen again very quickly!
CMS Higgs Candidate Event
CMS Global Data Grid
CMS Experiment
Online
System

Tier 0
Tier 1
Tier 2

10-40 Gb/s

Taiwan T1

UK T1

Italy T1

Physics caches
across Tier 2

10 Gb/s

UCSD

FNAL T1
>10 Gb/s

Caltech

Univ. T3

Tier 3
Tier 4

CERN T0

~4 Gb/s

Wisconsin

Univ. T3

Univ. T3

PCs

Florida

Univ. T3
Example: Worldwide LHC
Computing Grid

~450,000 cpu cores
~430 Pb storage
Typical data transfer
rate: ~12 GByte/sec

Total worldwide grid
capacity: ~2x WLCG
across all grids and
VOs

Alan Sill, TTU
November 20, 2013
!15
EGI in numbers
CPU	
  cores

361,300	
  across	
  53	
  countries	
  (1.44	
  
M	
  job/day)

Storage

Value	
  (yearly	
  increase)

Disk	
  (PB)

235	
  PB	
  (+69%)

Tape	
  (PB)

Value	
  (yearly	
  increase)

176	
  PB	
  (+32%)

!17
XSEDE/EGI BoF - XSEDE 2013
EGI-­‐InSPIRE	
  RI-­‐261323

www.egi.eu
Science Virtual Organizations on the OSG
• Astrophysics	
  
• Biochemistry	
  
• Bioinformatics	
  	
  
• Earthquake	
  Engineering	
  
• Genetics	
  
• Gravitational-­‐wave	
  physics	
  	
  
• Mathematics	
  
• Nanotechnology	
  
• Nuclear	
  and	
  particle	
  physics
LSN-MAGIC Meeting
February 22, 2012

XSEDE: The Next Generation of
US Supercomputing Infrastructure

The Role of Standards
for Risk Reduction and
Inter-operation in XSEDE

OGF standards
power some of
the largest
supercomputing
infrastructures
in the world!
LSN-MAGIC Meeting
XSEDE Services Layer:

February 22, 2012
Simple services combined in many ways

–Resource	
  Namespace	
  Service	
  1.1	
  
–OGSA	
  Basic	
  Execu@on	
  Service	
  
–OGSA	
  WSRF	
  BP	
  –	
  metadata	
  and	
  no@fica@on	
  
–OGSA-­‐ByteIO	
  
Examples – (not
–GridFTP	
  
a complete list)
–JSDL,	
  BES,	
  BES	
  HPC	
  Profile	
  
–WS	
  Trust	
  Secure	
  Token	
  Services	
  
–WSI	
  BSP	
  for	
  transport	
  of	
  creden@als	
  
–…	
  (more	
  than	
  we	
  have	
  room	
  to	
  cover	
  here)
XSEDE represents a phase change in the engagement of
modern computing standards with US cyberinfrastructure.

!20
Standardization Benefits
p

Having an organized set of acceptance criteria 

can improve business value to members in the following ways:
n For VENDORS, ensures that their product passes test acceptance
conditions, leading to fewer customer complaints in the field.
n For PROVIDERS, ensures that products they are hosting are wellbehaved, with fewer unexpected error or service failure
conditions.
n For USERS, ensures that the products and services they use will be
interoperable with the API, framework or standard they are using
as the basis for their purchased services,

p

Pre-purchase specification for products and services can be done on a
rational basis.

p

Productivity of programmer teams is maximized by having welldefined workflows for scenario and unit testing.
Alan Sill, TTU
November 20, 2013
!21
About the Open Grid Forum:
Open Grid Forum (OGF) is a leading global standards
organization cooperating with many partners in the areas of
cloud, grid and related forms of advanced distributed
computing.
The OGF community and its partners pursue these topics
through an open process for development, creation and
promotion of relevant specifications and use cases.
The central feature of this work is open forum with open
processes to champion architectural blueprints related to cloud
and grid computing.
The resulting specifications and standards enable pervasive
adoption of advanced distributed computing techniques for
business and research worldwide.
Alan Sill, TTU
November 20, 2013
!22
History and Background
•
•
•
•

•
•

OGF began in 2001 as an organization to promote the
advancement of distributed computing worldwide.
Grid Forum --> Global Grid Forum --> GGF + Enterprise Grid
Alliance --> formation of OGF in 2005.
Mandate is to take on all forms of distributed computing and to
work to promote cooperation, information exchange, best
practices in use and standardization.
OGF best known for a series of important computing, security
and network standards that form the basis for major science
and business-based distributed computing (BES, GridFTP,
DRMAA, JSDL, RNS, GLUE, UR, etc.).
Have also been working on cloud and Big Data standards
(OCCI, WS-Agreement, DFDL, etc.) for several years.
Cooperative work agreements with other SDOs in place.
Alan Sill, TTU
November 20, 2013
!23
OGF and the Pursuit of
Open International Standards:
• OGF views its mission as integrally tied to the creation and
implementation of practical standards of use across a wide
variety of boundaries.
• Interoperability and utility for implementation across
multiple projects is essential
• Interoperability and usability across international
boundaries on a global basis is desired
• OGF’s approach to standards creation and curation
promotes development of standards that will be of use to
the large-scale infrastructure projects.
• Standards are developed by participants in these projects.
• For the past several years, active also in cloud computing.
© 2013 Open Grid Forum

www.ogf.org
OGF Standards Strengths
§

OGF has an extensive set of applicable standards related to federated
community grid and cloud computing:
§
§
§
§
§
§
§
§
§
§
§
§

§

Federated Identity Management (FedSec-CG)
Managing the Trust Eco-System (CA operations, AuthZ and AuthN tools)
Virtual Organizations (VOMS) and related authorization tools
Job Submission and Workflow Management (JSDL, BES, HPC Profile)
Network Management (NSI, NML, NMC, NM)
Secure, fast multi--party data transfer (GridFTP, SRM)
Data Format Description Language (DFDL)
Service Agreements (WS-Agreement, WS-Agreement Negotiation)
Cloud Computing interfaces (OCCI family of specifications)
Distributed resource management (DRMAA, SAGA, etc.)
Firewall Traversal (FiTP); Usage Accounting (UR, GLUE)
Others under development through ISOD-RG, DCIFed-WG, etc.

Working to gather this information to form an organized description of OGF
work - an OGF “Cloud Portfolio”.
Alan Sill, TTU
November 20, 2013
!25
OGF Standards In Use In Industry:
• DRMAA: Distributed Resource Management Application API
Grid Engine, Open Grid Scheduler: (open source); TORQUE and related
products: Adaptive Computing; PBS Works: Altair Engineering; Gridway:
DSA Research; Condor: U. of Wisconsin / Red Hat;

• OGSA® Basic Execution Service Version 1.0 and BES HPC Profile:
BES++ for LSF/SGE/PBS: Platform Computing; Windows HPC Server
2008: Microsoft Corporation; PBS Works - (client only): Altair Engineering;

• JSDL: Job Submission Description Language (family of specs):
BES++ for LSF/SGE/PBS and Platform LSF: Platform Computing;
Windows HPC Server 2008: Microsoft Corporation; PBS Works - (client
only): Altair Engineering;

• WS-Agreement (family of specifications):
ElasticLM License-as-a-Service: ElasticLM; BEinGrid SLA Negotiator, 

LM-Architecture and Framework: (Multiple partners); BREIN SLA
Management Framework: (Multiple partners); WSAG4J, Web Services
Agreement for Java (framework implementation): Fraunhofer SCAI.
Alan Sill, TTU
November 20, 2013
!26
OGF Infrastructure Area
The OGF Infrastructure groups explore and define what is needed to
interface physical and virtual resources to higher level constructs. These
include networks and network devices, computers and virtual machines,
storage, visualization devices, instruments, and sensor technologies.

•
•
•
•
•
•

Network Measurements Working Group (NM-WG)

•
•

Firewall Virtualization For Grid Applications Working Group (FVGA-WG)

Network Measurement And Control Working Group (NMC-WG)
Network Mark-Up Language Working Group (NML-WG)
Network Service Interface Working Group (NSI-WG)
Open Cloud Computing Interface Working Group (OCCI-WG)
Infrastructure Services On-Demand Provisioning Research Group
(ISOD-RG)
Grid High-Performance Networking Research Group (GHPN-RG)
Alan Sill, TTU
November 20, 2013
!27
Infrastructure Area: The Groups
Network Measurements
NM-WG

Network Measurement
& Control
NMC-WG

Network Mark-up Language
NML-WG
Network-Network
DNMR-BOF
merge
spawn
Grid-Network
Grid High Performance
GNI-BOF
Networking GHPN-RG
DICE

Use Cases
Best Practices
Standards
Network Service Interface
NSI-WG

Firewall Virtualisation WG

Firewall RG

Open Cloud Computing Interface OCCI-WG
On-demand Infrastructure Services Provisioning ISOD-RG
2

© 2011 Open Grid Forum

OGF32, Salt Lake City, July 2011
InterCloud-Related Standardization Activities
	

 •	

 NIST Cloud definition (NIST SP 800-145), NIST Special Publication 500-291 version 2, NIST
Cloud Computing Standards Roadmap, July 2013and Cloud Computing Reference Architecture
(CCRA), v1.0 (NIST SP 500-292) http://www.nist.gov/itl/cloud/publications.cfm	

	

 •	

 ITU-T Focus Group on Cloud: Technical Report (Part 1 to 7) 

http://www.itu.int/en/ITU-T/focusgroups/cloud/Documents/FG-coud-technical-report.zip 	

	

 •	

 IEEE - WGs on InterCloud issues and Cloud Profiles 

– IEEE ICWG/2302 WG - Intercloud WG (ICWG) Working Group

	

 http://standards.ieee.org/develop/wg/ICWG-2302_WG.html

– IEEE P2301, P2302 Projects	

 

	

 http://standards.ieee.org/develop/project/2301.html, 2302.html	

• OGF ISOD-RG

	

 – On-Demand Infrastructure Services Provisioning Best Practices:

	

 	

 http://ogf.org/documents/GFD.208.pdf	

• IETF Internet Drafts	

	

 	

 –  Cloud Reference Framework. Internet Draft, by B. Khasnabish, J. Chu, S. Ma,Y. Meng, N. So, P.
Unbehagen, M. Morrow, M. Hasan,Y. Demchenko 

	

 http://tools.ietf.org/html/draft-khasnabish-cloud-reference-framework-05.txt 	

	

 	

 –  Cloud Service Broker, Internet Draft by Shao Weixiang, Hu Jie, Bhumip Khasnabish.

	

 http://tools.ietf.org/html/draft-shao-opsawg-cloud-service-broker-03.txt
Alan Sill, TTU
November 20, 2013
!29
Open Cloud Computing Interface®

OCCI® by OGF

• OCCI is an API and Protocol
• Sits on the boundary of a Service Provider
and Service Consumer
http://ogf.org/documents/GFD.183.pdf
• No assumptions about the boundary
http://ogf.org/documents/GFD.184.pdf
http://ogf.org/documents/GFD.185.pdf
Many real-world implementations!
Alan Sill, TTU
November 20, 2013
!30
Federation Test bed – September 2013
FedCloud Core Services
AAI

EGI Production
Infrastructure
Service
Availability
SAM
Configuration

GOCDB

DB

Accounting
APEL

External Services
Certification
Authorities

Image Metadata
Marketplace

VOMS Proxy
User Interfaces
OCCI Clients	

rOCCI; WNoDeS-CLI

CDMI Clients	

Libcdmi-java

Information
System
Top-DBII

Resource Providers
VOMS proxy
OCCI server
CDMI server

!

OpenNebula	

OpenStack	

StratusLab	

WNoDeS
Marketplace
client

Appliance
Repository

SSM
Vmcatcher	

Vmcaster
LDAP

Monitoring
Nagios
VO
VOMS server

Credit: David Wallom
Chair EGI Federated Cloud Task Force
Task Force – Sept 2013
Cyfronet

FZJ

OeRC

EGI.eu

CESNET

GWDG

IN2P3

CNRS
KTH
FCTSG

Members

Technologies
•OpenNebula.
•StratusLab.
•OpenStack.
•Synnefo.
•WNoDeS.

•70 individuals
•40 institutions
•13 countries

CETA

Masaryk
INFN
CESGA
SARA

IGI
RADICAL
STFC

TUD

Stakeholders

IFCA

•23 Resource Providers
•10 Technology Providers
•7 User Communities
•4 Liaisons

SZTAKI

BSC

GRNET

Imperial

DANTE

LMU

IPHC

IISAS

SixSq

100%IT

IFAE

SRCE

Credit: David Wallom
Chair EGI Federated Cloud Task Force
Multiple Organizations Have Cloud Standards
Multiple organizations have their own APIs, and real work has
been done by standards organizations to catch up and offer
common standards and products that can work across these.
Now is the time to do this! Recent work has brought several
cloud-related standards into frameworks that can be used to
implement them (for example, CloudStack, OpenStack, Open
Nebula, and several others) and are mature enough to apply:
n
n
n
n
n
n
n

Open Cloud Computing Interface (OCCI) from OGF
Cloud Data Management Interface (CDMI) from SNIA
Data Format Description Language (DFDL) from OGF
Open Virtualization Format (OVF) from DMTF and ISO
Cloud Application Management Protocol (CAMP) from OASIS
Cloud Infrastructure Management Interface (CIMI) from DMTF
WS-Agreement and WS-Agreement Negotiation from OGF
Alan Sill, TTU
November 20, 2013
!33
Standards Organizations Active in Cloud Computing:

(Some of many...)

•

It is often said that there are “too many standards organizations”. This is a lot like
saying there is “too much software”.

•

Each has its own area of specialty, its own contributor base, and its own method
of funding to develop its work products.

•

How best to work with these organizations? (Our answer: Cooperatively!)
Alan Sill, TTU
November 20, 2013
!34
OGF Cooperative Agreements
In Place as of Feb. 2013
OGF and ETSI:
Cooperative MoU in place; contributing
to ETSI CSC effort. Co-host Cloud
Plugfest series (cooperative with SNIA).
OGF and TM Forum:
Memorandum of Understanding in
place; ongoing cross-SDO document
on End-to-End Management of Cloud
Service Agreements, including SLAs, in
progress.
OGF and CSA:
Cooperative agreement between OGF
and CSA in place.
OGF and IEEE:
OGF co-sponsored IEEE CloudCom
2011 (Athens) and Cloudcom 2012
(Taipei); open to other engagements.
© 2011 Open Grid Forum

Cloudscape V

LSN-MAGIC Meeting
February 22, 2012

OGF and SIENA, NIST, GICTF, Canada
Cloud, etc.:
Contribute actively to to ongoing global
standards roadmapping efforts.
OGF and DMTF:
Joint work register on OCCI and CIMI
with DMTF Cloud Management WG.
OGF and ISO; OGF and ITU-T:
OGF has a formal liaisons with ISO/
IEC JTC1 SC38 on Cloud Computing
and with ITU-T JCA Cloud.
OGF and SNIA (CDMI):
Cooperative agreement w/SNIA Cloud
on CDMI and has held 7 jointly hosted
Cloud Standards Plugfests so far
(cooperative now with ETSI).
Brussels, Belgium

Feb. 28, 2013

!35
DMTF

Cloud Management Standards



Slides prepared by


Winston Bumpus – VMware

Who is DMTF

• Established in 1993 to enable more effective management of millions of
IT systems worldwide by bringing the IT industry together to collaborate
on the development, validation and promotion of systems management
standards.

• The group spans the industry with 160 member companies and

organizations, and more than 4,000 active participants crossing 43
countries.

• Strong Alliance Partnership with GICTF and other Organizations
• The DMTF board of directors is led by 17 innovative, industry-leading

technology companies. They include; Broadcom Corporation; CA
Technologies.; Cisco; Citrix Systems, Inc.; Fujitsu; HP; Hitachi, Ltd.;
Huawei; IBM; Intel Corporation; Microsoft Corporation; NetApp; Oracle;
Software AG; SunGard Availability Services; Telecom Italia and VMware,
Inc.
Open Virtualization Format (OVF)

XML
myapp.ovf

A standard packaging format for virtual machines
A distribution format for VMs
Supports single VM & multiple VM configurations
Optimized for distribution & simple automation
Vendor and platform independent
Now an ANSI and ISO standard

myapp.mf

myapp.cert

An OVF package consists of
One OVF descriptor with extension .ovf
zero or one OVF manifest (w/ extension .mf)
zero or one OVF certificate (w/ extension .cert)
zero or more disk image files
zero or more additional resource files (such as ISO images)

web.xxx

images.iso

OVF Package (myapp.ova)

OVF 2 (Recently Released): brings an enhanced set of networking
capabilities making it applicable to a broader range of use cases that are
emerging as industry enters the Cloud era.
Cloud Infrastructure Management Interface (CIMI)
Model Scope: Core IaaS functionality
Deploying and managing: Machines, Volumes, Networks, Monitoring, etc.
Client: VM/application developer, deployer and administrator
Server: IaaS Cloud Provider
Version 1.1 is released and implemented

CIMI REST/HTTP-Based Protocol
Specification currently describes a REST/HTTP binding to the model.
Other bindings are Considered.
Follows REST principles and describes mapping of the HTTP protocol verbs to operations on
the model.
Standard HTTP status codes are used to convey the results of the operations.
Serialization formats for the message body include JSON and XML

Other features:
Cloud Entry Point to manage Systems, Machines, Volumes, and Networks; Grouping of
resources meant to be managed as a single unit; Metering and Monitoring support; Resource
metadata; Events and event logging; Jobs; Dynamic Discovery of a provider’s resources
characteristics; Entity creation using Templates
Cloud Auditing Data Federation (CADF) Working Group
Scope / Objectives
Develop Standards for the Federation of Cloud Auditing Data
By Specifying a Normative, Prescriptive Auditing Event Data Format along with
Interface Definitions and a compatible Component and Interaction model.
The Data Model will include support for:
Classification by Extensible Event Taxonomies to categorize cloud provider IT
Resources, event Actions and Outcomes.
Federation of Customized Auditing Reports and Logs - event data will support
federation and be composable into customizable reports and logs.
The Interface Model includes:
Definition of Service Methods to Manage and Federate the Data Model’s Events,
Logs and Reports
Interfaces will support audit data Submission, Import and Export, Query and
Subscription.
The Component and Interaction Model will
Demonstrate how the Interfaces and Data Format can be used by Cloud Providers
and Consumers to Support Cloud Auditing use cases.
Future work may include Profiles that extend the core data and interface specifications
to accommodate particular methods of consumption
DMTF NSMWG Focus: Virtualized and Hybrid
Network Environment Management
Apps	
  and	
  Services	
  that	
  Utilize	
  
Virtualized	
  L3	
  Resource/Entities	
  	
  
Apps	
  and	
  Services	
  that	
  Utilize	
  
Virtualized	
  Network	
  Entities	
  	
  

Management	
  of	
  Virtualized	
  
Network	
  Entities
vNE	
  Management	
  API

Virtualized	
  Network	
  Entities
Network	
  Entities	
  Abstraction

Edge/Core/Border
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  Router Fire	
  Wall
*

AAA	
  
Server

…

DNS

D
N
S

… Balancer
Load	
  

Physical	
  	
  and	
  Virtual	
  Network	
  Entities	
  	
  
Software Entitlement Working Group
Purpose:
To extend the Common Information Model to capture software entitlement and usage
metrics and to deliver the associated profile.
Based on ISO/IEC 19770-2 Software Identification Tags
Driven by a request for JP Morgan Chase.
1. Update CIM to support Software Entitlement and Usage Metrics – Q4 2013
2. Create CIM Software Entitlement and Usage Metrics Profile - Q1 2014

For more information
www.dmtf.org/cloud
www.dmtf.org/OVF
7
013.3

Landscape of Cloud SLA
Management
End User Requirements

TMF TR174
ECLC VPC
Requirements

TMF GB963
Cloud SLA App.
Note

NIST CC RA/
Taxonomy/SLA

!

TMF Multicloud catalyst
CSCC –
Practical Guide
to Cloud SLA

TMF GB917.V3
SLAM Handbook

!

ITU-T FGCC
Cloud
Ecosystem

Best Practices/Guidebooks

Architecture Specification

Key inputs to

TMF061
SES RA

TMF GB922
SID

DMTF CMWG
DSP-IS0103
DSP-IS0102
DSP-IS0101

!

TMF TR178
Enabling E2E Cloud
SLA Management

OGF GFD.192
WS-Agreement

OASIS
TOSCA

DMTF CMWG
DSP0263

TMF617
SES SMI

DMTF CMWG
DSP2027
DSP0263

Meta Models

Interface Specification

Cloud SLA Measurements

OGF
GFD.192
GFD.193
WS-Agreement
WS-Agreement
Negotiation
DMTF CMWG &
SVPC VN QoS
Profiles

SPEC OSG
Cloud
Benchmark

TMF GB963
Cloud SLA App.
Note

ISMA

CSMIC

!

© 2013 TM Forum | 

Cloud Plugfest Developer Series:
(Multiple Partners)

Developer-oriented inperson standards and
software testing series
OPEN TO ALL!
http://
cloudplugfest.org

Cloud Plugfest 10 just
completed!

Continuing series

co-sponsored by
OGF, DMTF, SNIA,
OASIS, ETSI,
OCEAN and OW2!

9 previous events
held so far!
Easy to get involved
and join in events as
developers or project
researchers!

Cloud Interoperability
Week Sep. 2013!

Alan Sill, TTU
November 20, 2013
!44
NIST SAJACC Public Process

http://collaborate.nist.gov/twiki-cloud-computing/bin/view/CloudComputing/SAJACC
Alan Sill, TTU
November 20, 2013
!46
(
Internal(Group(Report(
Feb(12,(2013

Special(Publication(5001273(Special(Publication(5001273

!
SAJACC Working Group
Recommendations to NIST

National Institute of Standards and
Technology
NIST Cloud Computing
Standards Acceleration to Jumpstart Adoption
of Cloud Computing (SAJACC) Working Group
Phase I group report and recommendations
NIST SAJACC Phase I Cloud Computing Use Cases

•
•
•

Public project to define testable
use cases that can provide the
basis for independent evaluation
of cloud standards, products and
processes.	

Phase I completed and working
group report “SAJACC Working
Group Recommendations to
NIST” delivered Feb. 12, 2013.	

Working group continues with
Phase II to define and refine use
cases with greater technical
detail.
Example Work In Progress:

Reorganize
and rewrite
previous
SAJACC Use
Cases
Example Work In Progress:
Incorporate
input from other
ongoing NIST
cloud computing
working groups
Example Work In Progress:

Greatly
improve
content
Example Work In Progress:
Include diagrams where
appropriate to improve clarity
of the logic sequence and
workflow of a complex
operation, step or procedure.
European Union “Standards & Interoperability for e-Infrastructure
Implementation” (SIENA) Initiative (2010-2012)
SIENA	
  (2010-­‐2012)	
  was	
  a	
  Support	
  AcAon	
  funded	
  by	
  the	
  European	
  Commission	
  under	
  FP7	
  (2007-­‐13)	
  CapaciQes	
  programme.
Partners

“A	
  coordinated	
  effort...

Final Report:
June 2012

...towards	
  the	
  delivery	
  of	
  a	
  future	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  
e-­‐Infrastructures	
  Roadmap....
InternaAonal	
  Experts
	
  REB	
  –	
  Roadmap	
   –	
  Special	
  Liaison	
   –	
  Industry	
  Expert	
  
SLG	
  
IEG	
  
Editorial	
  Board
GroupGroup

...aligned	
  with	
  the	
  needs	
  of	
  European	
  and	
  na>onal	
  
ini>a>ves	
  and	
  the	
  evolving	
  world.”

Standards	
  Development	
  OrganisaAons	
  (SDOs)

Distributed	
  CompuAng	
  Infrastructure	
  (DCI)	
  IniAaAves

Consolidated	
  Cloud	
  CompuAng	
  Workshops

Alan Sill, TTU
November 20, 2013
!53
European Cloud Standards Coordination (New)
Multi-organization open survey commissioned by EC,
coordinated by ETSI along same lines as GICTF, NIST

ra
D

In
ft

ro
P

re
g

s!
s

Alan Sill, TTU
November 20, 2013
!54
Summary
p

Many active projects are underway to document, map and extend the
important role played by standards and software development with
significant uptake in advanced distributed computing, including
cloud, grid, networking and large-scale data processing, transfer and
handling through innovative cooperation with many partners.

p

The CAC actively engages with partners and participants throughout
the international arena to understand and promote best practices
and standards in cloud and advanced distributed computing.

p

TTU is leveraging these standards to support a wide variety of
flexible architectures for advanced scientific and business uses
through the NSF Cloud and Autonomic Computing Center and is
actively seeking international collaborators to extend this work more
comprehensively through the cloud.
Alan Sill, TTU
November 20, 2013
!55

Contenu connexe

Tendances

Communication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeCommunication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeSumant Tambe
 
OpenSplice DDS Tutorial -- Part II
OpenSplice DDS Tutorial -- Part IIOpenSplice DDS Tutorial -- Part II
OpenSplice DDS Tutorial -- Part IIAngelo Corsaro
 
Vortex II -- The Industrial IoT Connectivity Standard
Vortex II -- The  Industrial IoT  Connectivity StandardVortex II -- The  Industrial IoT  Connectivity Standard
Vortex II -- The Industrial IoT Connectivity StandardAngelo Corsaro
 
IRJET- A Survey on Remote Data Possession Verification Protocol in Cloud Storage
IRJET- A Survey on Remote Data Possession Verification Protocol in Cloud StorageIRJET- A Survey on Remote Data Possession Verification Protocol in Cloud Storage
IRJET- A Survey on Remote Data Possession Verification Protocol in Cloud StorageIRJET Journal
 
The Data Distribution Service
The Data Distribution ServiceThe Data Distribution Service
The Data Distribution ServiceAngelo Corsaro
 
Cs 1023 lec 13 web (week 4)
Cs 1023 lec 13 web (week 4)Cs 1023 lec 13 web (week 4)
Cs 1023 lec 13 web (week 4)stanbridge
 
Deep Dive into the OPC UA / DDS Gateway Specification
Deep Dive into the OPC UA / DDS Gateway SpecificationDeep Dive into the OPC UA / DDS Gateway Specification
Deep Dive into the OPC UA / DDS Gateway SpecificationGerardo Pardo-Castellote
 
Running the Grid on Linux
Running the Grid on LinuxRunning the Grid on Linux
Running the Grid on LinuxDan Tervo
 
Tuning and Troubleshooting OpenSplice DDS Applications
Tuning and Troubleshooting OpenSplice DDS ApplicationsTuning and Troubleshooting OpenSplice DDS Applications
Tuning and Troubleshooting OpenSplice DDS ApplicationsAngelo Corsaro
 
RTI Data-Distribution Service (DDS) Master Class 2011
RTI Data-Distribution Service (DDS) Master Class 2011RTI Data-Distribution Service (DDS) Master Class 2011
RTI Data-Distribution Service (DDS) Master Class 2011Gerardo Pardo-Castellote
 
Getting Started with Vortex
Getting Started with VortexGetting Started with Vortex
Getting Started with VortexAngelo Corsaro
 
Introducing Vortex Lite
Introducing Vortex LiteIntroducing Vortex Lite
Introducing Vortex LiteAngelo Corsaro
 
Two Approaches You Must Consider when Architecting Radar Systems
Two Approaches You Must Consider when Architecting Radar SystemsTwo Approaches You Must Consider when Architecting Radar Systems
Two Approaches You Must Consider when Architecting Radar SystemsReal-Time Innovations (RTI)
 
FPGA-based soft-processors: 6G nodes and post-quantum security in space
 FPGA-based soft-processors: 6G nodes and post-quantum security in space FPGA-based soft-processors: 6G nodes and post-quantum security in space
FPGA-based soft-processors: 6G nodes and post-quantum security in spaceFacultad de Informática UCM
 
Vortex Tutorial -- Part I
Vortex Tutorial -- Part IVortex Tutorial -- Part I
Vortex Tutorial -- Part IAngelo Corsaro
 
Classical Distributed Algorithms with DDS
Classical Distributed Algorithms with DDSClassical Distributed Algorithms with DDS
Classical Distributed Algorithms with DDSAngelo Corsaro
 
Vortex: The Intelligent Data Sharing Platform for the Internet of Things
Vortex: The Intelligent Data Sharing Platform for the Internet of ThingsVortex: The Intelligent Data Sharing Platform for the Internet of Things
Vortex: The Intelligent Data Sharing Platform for the Internet of ThingsAngelo Corsaro
 

Tendances (20)

Communication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/SubscribeCommunication Patterns Using Data-Centric Publish/Subscribe
Communication Patterns Using Data-Centric Publish/Subscribe
 
OpenSplice DDS Tutorial -- Part II
OpenSplice DDS Tutorial -- Part IIOpenSplice DDS Tutorial -- Part II
OpenSplice DDS Tutorial -- Part II
 
Vortex II -- The Industrial IoT Connectivity Standard
Vortex II -- The  Industrial IoT  Connectivity StandardVortex II -- The  Industrial IoT  Connectivity Standard
Vortex II -- The Industrial IoT Connectivity Standard
 
IRJET- A Survey on Remote Data Possession Verification Protocol in Cloud Storage
IRJET- A Survey on Remote Data Possession Verification Protocol in Cloud StorageIRJET- A Survey on Remote Data Possession Verification Protocol in Cloud Storage
IRJET- A Survey on Remote Data Possession Verification Protocol in Cloud Storage
 
The Data Distribution Service
The Data Distribution ServiceThe Data Distribution Service
The Data Distribution Service
 
DDS Everywhere
DDS EverywhereDDS Everywhere
DDS Everywhere
 
Cs 1023 lec 13 web (week 4)
Cs 1023 lec 13 web (week 4)Cs 1023 lec 13 web (week 4)
Cs 1023 lec 13 web (week 4)
 
OpenSplice DDS v6
OpenSplice DDS v6OpenSplice DDS v6
OpenSplice DDS v6
 
Deep Dive into the OPC UA / DDS Gateway Specification
Deep Dive into the OPC UA / DDS Gateway SpecificationDeep Dive into the OPC UA / DDS Gateway Specification
Deep Dive into the OPC UA / DDS Gateway Specification
 
Running the Grid on Linux
Running the Grid on LinuxRunning the Grid on Linux
Running the Grid on Linux
 
Tuning and Troubleshooting OpenSplice DDS Applications
Tuning and Troubleshooting OpenSplice DDS ApplicationsTuning and Troubleshooting OpenSplice DDS Applications
Tuning and Troubleshooting OpenSplice DDS Applications
 
RTI Data-Distribution Service (DDS) Master Class 2011
RTI Data-Distribution Service (DDS) Master Class 2011RTI Data-Distribution Service (DDS) Master Class 2011
RTI Data-Distribution Service (DDS) Master Class 2011
 
ISO C++ DDS PSM
ISO C++ DDS PSMISO C++ DDS PSM
ISO C++ DDS PSM
 
Getting Started with Vortex
Getting Started with VortexGetting Started with Vortex
Getting Started with Vortex
 
Introducing Vortex Lite
Introducing Vortex LiteIntroducing Vortex Lite
Introducing Vortex Lite
 
Two Approaches You Must Consider when Architecting Radar Systems
Two Approaches You Must Consider when Architecting Radar SystemsTwo Approaches You Must Consider when Architecting Radar Systems
Two Approaches You Must Consider when Architecting Radar Systems
 
FPGA-based soft-processors: 6G nodes and post-quantum security in space
 FPGA-based soft-processors: 6G nodes and post-quantum security in space FPGA-based soft-processors: 6G nodes and post-quantum security in space
FPGA-based soft-processors: 6G nodes and post-quantum security in space
 
Vortex Tutorial -- Part I
Vortex Tutorial -- Part IVortex Tutorial -- Part I
Vortex Tutorial -- Part I
 
Classical Distributed Algorithms with DDS
Classical Distributed Algorithms with DDSClassical Distributed Algorithms with DDS
Classical Distributed Algorithms with DDS
 
Vortex: The Intelligent Data Sharing Platform for the Internet of Things
Vortex: The Intelligent Data Sharing Platform for the Internet of ThingsVortex: The Intelligent Data Sharing Platform for the Internet of Things
Vortex: The Intelligent Data Sharing Platform for the Internet of Things
 

En vedette

OGF Standards Overview - Globus World 2013
OGF Standards Overview - Globus World 2013OGF Standards Overview - Globus World 2013
OGF Standards Overview - Globus World 2013Alan Sill
 
OGF Standards Overview - Cloudscape V
OGF Standards Overview - Cloudscape VOGF Standards Overview - Cloudscape V
OGF Standards Overview - Cloudscape VAlan Sill
 
Cloud-Oriented Federated Projects and Testbeds: Current Status in the US and...
Cloud-Oriented Federated Projects and Testbeds:  Current Status in the US and...Cloud-Oriented Federated Projects and Testbeds:  Current Status in the US and...
Cloud-Oriented Federated Projects and Testbeds: Current Status in the US and...Alan Sill
 
OGF Introductory Overview - FAS* 2014
OGF Introductory Overview -  FAS* 2014OGF Introductory Overview -  FAS* 2014
OGF Introductory Overview - FAS* 2014Alan Sill
 
OGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA CloudOGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA CloudAlan Sill
 
Gom time final
Gom time finalGom time final
Gom time finalcammy216
 
Requirement 5: Federated Community Cloud - Sill
Requirement 5: Federated Community Cloud - SillRequirement 5: Federated Community Cloud - Sill
Requirement 5: Federated Community Cloud - SillAlan Sill
 
Cloud Standards in the Real World: Cloud Standards Testing for Developers
Cloud Standards in the Real World: Cloud Standards Testing for DevelopersCloud Standards in the Real World: Cloud Standards Testing for Developers
Cloud Standards in the Real World: Cloud Standards Testing for DevelopersAlan Sill
 

En vedette (8)

OGF Standards Overview - Globus World 2013
OGF Standards Overview - Globus World 2013OGF Standards Overview - Globus World 2013
OGF Standards Overview - Globus World 2013
 
OGF Standards Overview - Cloudscape V
OGF Standards Overview - Cloudscape VOGF Standards Overview - Cloudscape V
OGF Standards Overview - Cloudscape V
 
Cloud-Oriented Federated Projects and Testbeds: Current Status in the US and...
Cloud-Oriented Federated Projects and Testbeds:  Current Status in the US and...Cloud-Oriented Federated Projects and Testbeds:  Current Status in the US and...
Cloud-Oriented Federated Projects and Testbeds: Current Status in the US and...
 
OGF Introductory Overview - FAS* 2014
OGF Introductory Overview -  FAS* 2014OGF Introductory Overview -  FAS* 2014
OGF Introductory Overview - FAS* 2014
 
OGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA CloudOGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA Cloud
 
Gom time final
Gom time finalGom time final
Gom time final
 
Requirement 5: Federated Community Cloud - Sill
Requirement 5: Federated Community Cloud - SillRequirement 5: Federated Community Cloud - Sill
Requirement 5: Federated Community Cloud - Sill
 
Cloud Standards in the Real World: Cloud Standards Testing for Developers
Cloud Standards in the Real World: Cloud Standards Testing for DevelopersCloud Standards in the Real World: Cloud Standards Testing for Developers
Cloud Standards in the Real World: Cloud Standards Testing for Developers
 

Similaire à MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill

ISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computingISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computingAlan Sill
 
OGF Introductory Overview - OGF 44 at EGI Conference 2015
OGF Introductory Overview - OGF 44 at EGI Conference 2015OGF Introductory Overview - OGF 44 at EGI Conference 2015
OGF Introductory Overview - OGF 44 at EGI Conference 2015Alan Sill
 
OGF standards for cloud computing
OGF standards for cloud computingOGF standards for cloud computing
OGF standards for cloud computingAlan Sill
 
Cloud computing - dien toan dam may
Cloud computing - dien toan dam mayCloud computing - dien toan dam may
Cloud computing - dien toan dam mayNguyen Duong
 
Introduction to DDS: Context, Information Model, Security, and Applications.
Introduction to DDS: Context, Information Model, Security, and Applications.Introduction to DDS: Context, Information Model, Security, and Applications.
Introduction to DDS: Context, Information Model, Security, and Applications.Gerardo Pardo-Castellote
 
The Inside Story: How OPC UA and DDS Can Work Together in Industrial Systems
The Inside Story: How OPC UA and DDS Can Work Together in Industrial SystemsThe Inside Story: How OPC UA and DDS Can Work Together in Industrial Systems
The Inside Story: How OPC UA and DDS Can Work Together in Industrial SystemsReal-Time Innovations (RTI)
 
DDS Advanced Tutorial - OMG June 2013 Berlin Meeting
DDS Advanced Tutorial - OMG June 2013 Berlin MeetingDDS Advanced Tutorial - OMG June 2013 Berlin Meeting
DDS Advanced Tutorial - OMG June 2013 Berlin MeetingJaime Martin Losa
 
IRJET- Build SDN with Openflow Controller
IRJET-  	  Build SDN with Openflow ControllerIRJET-  	  Build SDN with Openflow Controller
IRJET- Build SDN with Openflow ControllerIRJET Journal
 
Cyber Resiliency 20120420
Cyber Resiliency 20120420Cyber Resiliency 20120420
Cyber Resiliency 20120420Steve Goeringer
 
SECURE FILE STORAGE IN THE CLOUD WITH HYBRID ENCRYPTION
SECURE FILE STORAGE IN THE CLOUD WITH HYBRID ENCRYPTIONSECURE FILE STORAGE IN THE CLOUD WITH HYBRID ENCRYPTION
SECURE FILE STORAGE IN THE CLOUD WITH HYBRID ENCRYPTIONIRJET Journal
 
DEVNET-1166 Open SDN Controller APIs
DEVNET-1166	Open SDN Controller APIsDEVNET-1166	Open SDN Controller APIs
DEVNET-1166 Open SDN Controller APIsCisco DevNet
 
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...Nane Kratzke
 
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Mark Goldstein
 
Bitkom Cray presentation - on HPC affecting big data analytics in FS
Bitkom Cray presentation - on HPC affecting big data analytics in FSBitkom Cray presentation - on HPC affecting big data analytics in FS
Bitkom Cray presentation - on HPC affecting big data analytics in FSPhilip Filleul
 
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshThe Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshIanFurlong4
 
All Things Open SDN, NFV and Open Daylight
All Things Open SDN, NFV and Open Daylight All Things Open SDN, NFV and Open Daylight
All Things Open SDN, NFV and Open Daylight Mark Hinkle
 
RTI/Cisco response to the Software Defined Networks (SDN) OMG RFI
RTI/Cisco response to the Software Defined Networks (SDN) OMG RFIRTI/Cisco response to the Software Defined Networks (SDN) OMG RFI
RTI/Cisco response to the Software Defined Networks (SDN) OMG RFIGerardo Pardo-Castellote
 
REVIEW ON IMPLEMENTING BLOCKCHAIN ASSISTED PUBLIC KEY ENCRYPTION TECHNIQUE IN...
REVIEW ON IMPLEMENTING BLOCKCHAIN ASSISTED PUBLIC KEY ENCRYPTION TECHNIQUE IN...REVIEW ON IMPLEMENTING BLOCKCHAIN ASSISTED PUBLIC KEY ENCRYPTION TECHNIQUE IN...
REVIEW ON IMPLEMENTING BLOCKCHAIN ASSISTED PUBLIC KEY ENCRYPTION TECHNIQUE IN...IRJET Journal
 
Open Source Edge Computing Platforms - Overview
Open Source Edge Computing Platforms - OverviewOpen Source Edge Computing Platforms - Overview
Open Source Edge Computing Platforms - OverviewKrishna-Kumar
 
A Comparative Review on Fault Tolerance methods and models in Cloud Computing
A Comparative Review on Fault Tolerance methods and models in Cloud ComputingA Comparative Review on Fault Tolerance methods and models in Cloud Computing
A Comparative Review on Fault Tolerance methods and models in Cloud ComputingIRJET Journal
 

Similaire à MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill (20)

ISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computingISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
 
OGF Introductory Overview - OGF 44 at EGI Conference 2015
OGF Introductory Overview - OGF 44 at EGI Conference 2015OGF Introductory Overview - OGF 44 at EGI Conference 2015
OGF Introductory Overview - OGF 44 at EGI Conference 2015
 
OGF standards for cloud computing
OGF standards for cloud computingOGF standards for cloud computing
OGF standards for cloud computing
 
Cloud computing - dien toan dam may
Cloud computing - dien toan dam mayCloud computing - dien toan dam may
Cloud computing - dien toan dam may
 
Introduction to DDS: Context, Information Model, Security, and Applications.
Introduction to DDS: Context, Information Model, Security, and Applications.Introduction to DDS: Context, Information Model, Security, and Applications.
Introduction to DDS: Context, Information Model, Security, and Applications.
 
The Inside Story: How OPC UA and DDS Can Work Together in Industrial Systems
The Inside Story: How OPC UA and DDS Can Work Together in Industrial SystemsThe Inside Story: How OPC UA and DDS Can Work Together in Industrial Systems
The Inside Story: How OPC UA and DDS Can Work Together in Industrial Systems
 
DDS Advanced Tutorial - OMG June 2013 Berlin Meeting
DDS Advanced Tutorial - OMG June 2013 Berlin MeetingDDS Advanced Tutorial - OMG June 2013 Berlin Meeting
DDS Advanced Tutorial - OMG June 2013 Berlin Meeting
 
IRJET- Build SDN with Openflow Controller
IRJET-  	  Build SDN with Openflow ControllerIRJET-  	  Build SDN with Openflow Controller
IRJET- Build SDN with Openflow Controller
 
Cyber Resiliency 20120420
Cyber Resiliency 20120420Cyber Resiliency 20120420
Cyber Resiliency 20120420
 
SECURE FILE STORAGE IN THE CLOUD WITH HYBRID ENCRYPTION
SECURE FILE STORAGE IN THE CLOUD WITH HYBRID ENCRYPTIONSECURE FILE STORAGE IN THE CLOUD WITH HYBRID ENCRYPTION
SECURE FILE STORAGE IN THE CLOUD WITH HYBRID ENCRYPTION
 
DEVNET-1166 Open SDN Controller APIs
DEVNET-1166	Open SDN Controller APIsDEVNET-1166	Open SDN Controller APIs
DEVNET-1166 Open SDN Controller APIs
 
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
 
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
 
Bitkom Cray presentation - on HPC affecting big data analytics in FS
Bitkom Cray presentation - on HPC affecting big data analytics in FSBitkom Cray presentation - on HPC affecting big data analytics in FS
Bitkom Cray presentation - on HPC affecting big data analytics in FS
 
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshThe Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
 
All Things Open SDN, NFV and Open Daylight
All Things Open SDN, NFV and Open Daylight All Things Open SDN, NFV and Open Daylight
All Things Open SDN, NFV and Open Daylight
 
RTI/Cisco response to the Software Defined Networks (SDN) OMG RFI
RTI/Cisco response to the Software Defined Networks (SDN) OMG RFIRTI/Cisco response to the Software Defined Networks (SDN) OMG RFI
RTI/Cisco response to the Software Defined Networks (SDN) OMG RFI
 
REVIEW ON IMPLEMENTING BLOCKCHAIN ASSISTED PUBLIC KEY ENCRYPTION TECHNIQUE IN...
REVIEW ON IMPLEMENTING BLOCKCHAIN ASSISTED PUBLIC KEY ENCRYPTION TECHNIQUE IN...REVIEW ON IMPLEMENTING BLOCKCHAIN ASSISTED PUBLIC KEY ENCRYPTION TECHNIQUE IN...
REVIEW ON IMPLEMENTING BLOCKCHAIN ASSISTED PUBLIC KEY ENCRYPTION TECHNIQUE IN...
 
Open Source Edge Computing Platforms - Overview
Open Source Edge Computing Platforms - OverviewOpen Source Edge Computing Platforms - Overview
Open Source Edge Computing Platforms - Overview
 
A Comparative Review on Fault Tolerance methods and models in Cloud Computing
A Comparative Review on Fault Tolerance methods and models in Cloud ComputingA Comparative Review on Fault Tolerance methods and models in Cloud Computing
A Comparative Review on Fault Tolerance methods and models in Cloud Computing
 

Plus de Alan Sill

Return on Investment for Research Computing and Data Support 2021-03-03
Return on Investment for Research Computing and Data Support 2021-03-03Return on Investment for Research Computing and Data Support 2021-03-03
Return on Investment for Research Computing and Data Support 2021-03-03Alan Sill
 
Design installation-commissioning-red raider-cluster-ttu
Design installation-commissioning-red raider-cluster-ttuDesign installation-commissioning-red raider-cluster-ttu
Design installation-commissioning-red raider-cluster-ttuAlan Sill
 
NSF CAC Cloud Interoperability Testbed Projects
NSF CAC Cloud Interoperability Testbed ProjectsNSF CAC Cloud Interoperability Testbed Projects
NSF CAC Cloud Interoperability Testbed ProjectsAlan Sill
 
OCCI - The Open Cloud Computing Interface – flexible, portable, interoperable...
OCCI - The Open Cloud Computing Interface – flexible, portable, interoperable...OCCI - The Open Cloud Computing Interface – flexible, portable, interoperable...
OCCI - The Open Cloud Computing Interface – flexible, portable, interoperable...Alan Sill
 
Cloud Testbeds for Standards Development and Innovation
Cloud Testbeds for Standards Development and InnovationCloud Testbeds for Standards Development and Innovation
Cloud Testbeds for Standards Development and InnovationAlan Sill
 
OCCI-OS tutorial
OCCI-OS tutorialOCCI-OS tutorial
OCCI-OS tutorialAlan Sill
 
SAJACC Working Group Recommendations to NIST, Feb. 12 2013
SAJACC Working Group Recommendations to NIST, Feb. 12 2013SAJACC Working Group Recommendations to NIST, Feb. 12 2013
SAJACC Working Group Recommendations to NIST, Feb. 12 2013Alan Sill
 
SAJACC WG Report Summary and Conclusions Jan 2013
SAJACC WG Report Summary and Conclusions  Jan 2013SAJACC WG Report Summary and Conclusions  Jan 2013
SAJACC WG Report Summary and Conclusions Jan 2013Alan Sill
 

Plus de Alan Sill (8)

Return on Investment for Research Computing and Data Support 2021-03-03
Return on Investment for Research Computing and Data Support 2021-03-03Return on Investment for Research Computing and Data Support 2021-03-03
Return on Investment for Research Computing and Data Support 2021-03-03
 
Design installation-commissioning-red raider-cluster-ttu
Design installation-commissioning-red raider-cluster-ttuDesign installation-commissioning-red raider-cluster-ttu
Design installation-commissioning-red raider-cluster-ttu
 
NSF CAC Cloud Interoperability Testbed Projects
NSF CAC Cloud Interoperability Testbed ProjectsNSF CAC Cloud Interoperability Testbed Projects
NSF CAC Cloud Interoperability Testbed Projects
 
OCCI - The Open Cloud Computing Interface – flexible, portable, interoperable...
OCCI - The Open Cloud Computing Interface – flexible, portable, interoperable...OCCI - The Open Cloud Computing Interface – flexible, portable, interoperable...
OCCI - The Open Cloud Computing Interface – flexible, portable, interoperable...
 
Cloud Testbeds for Standards Development and Innovation
Cloud Testbeds for Standards Development and InnovationCloud Testbeds for Standards Development and Innovation
Cloud Testbeds for Standards Development and Innovation
 
OCCI-OS tutorial
OCCI-OS tutorialOCCI-OS tutorial
OCCI-OS tutorial
 
SAJACC Working Group Recommendations to NIST, Feb. 12 2013
SAJACC Working Group Recommendations to NIST, Feb. 12 2013SAJACC Working Group Recommendations to NIST, Feb. 12 2013
SAJACC Working Group Recommendations to NIST, Feb. 12 2013
 
SAJACC WG Report Summary and Conclusions Jan 2013
SAJACC WG Report Summary and Conclusions  Jan 2013SAJACC WG Report Summary and Conclusions  Jan 2013
SAJACC WG Report Summary and Conclusions Jan 2013
 

Dernier

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 

Dernier (20)

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 

MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill

  • 1. Cross-SDO Projects to Accelerate Cloud Innovation Alan Sill, Ph.D Site Director, Cloud and Autonomic Computing Center Senior Scientist, High Performance Computing Center Adjunct Professor of Physics Texas Tech University Vice President of Standards, Open Grid Forum
  • 2. Standards as a Means to Interoperability • Risk reduction: • Lessen risk of dead-end product design and orphan components. • Lessen or remove risk of vendor service lock-in. • Mitigate reusability barriers for software and data access. • Provide best-of-breed development and methods. • Mix-and-match for input & output of processing steps. • Allow innovation/competition at more interesting layers and development of better internal features. • Facilitate interoperation with other provider software services, components and infrastructures. • Approach must be explicitly cross-SDO and cross-vendor. Alan Sill, TTU November 20, 2013 !2
  • 3.
  • 4. CAC Goals and Vision The Texas Tech site intends to provide a practical work arena for development and coordination of standards, standards-based software and reference implementations applicable to cloud and other forms of advanced distributed computing. The site will fill a need to organize, classify, develop reference implementations for and otherwise contribute to standardsbased software in advanced distributed computing. The vision that underlies these goals is one of harmonious, coordinated development of software that interoperates across many boundaries of deployment and implementation, and that can be repurposed, rescaled and redeployed as needed to solve a wide variety of user, vendor and supplier problems. Alan Sill, TTU November 20, 2013 !4
  • 5. Standards, Clouds and Interoperability: Our vision at the CAC is that appropriate use of standards as part of the innovation process permits software and hardware used in clouds to interoperate with other components and infrastructures, and thus reduces risks including the risk of unwanted vendor lock-in. ! This allows developers, vendors and users to focus more on higher level capabilities and therefore less on reinventing common aspects and features of their APIs and interface modules. ! Coupling standards and software innovation is therefore crucial to economical cloud development at this stage. Alan Sill, TTU November 20, 2013 !5
  • 7. The Large Hadron Collider
  • 8. 10k CPU cores, 2M lines of code Muon system: Drift tubes (170k wires), RPC, Cathode Strip Ch.(200k wires) Silicon tracker: 66M pixel channels 9.6M strips, 210 m2 ECAL: 76k PbWO4 crystals HCAL: 15k scint/brass ch.
  • 9.
  • 10.
  • 11.
  • 12. Beam Crossings at the LHC Where a lot of things happen at once… and then happen again very quickly!
  • 14. CMS Global Data Grid CMS Experiment Online System Tier 0 Tier 1 Tier 2 10-40 Gb/s Taiwan T1 UK T1 Italy T1 Physics caches across Tier 2 10 Gb/s UCSD FNAL T1 >10 Gb/s Caltech Univ. T3 Tier 3 Tier 4 CERN T0 ~4 Gb/s Wisconsin Univ. T3 Univ. T3 PCs Florida Univ. T3
  • 15. Example: Worldwide LHC Computing Grid ~450,000 cpu cores ~430 Pb storage Typical data transfer rate: ~12 GByte/sec Total worldwide grid capacity: ~2x WLCG across all grids and VOs Alan Sill, TTU November 20, 2013 !15
  • 16.
  • 17. EGI in numbers CPU  cores 361,300  across  53  countries  (1.44   M  job/day) Storage Value  (yearly  increase) Disk  (PB) 235  PB  (+69%) Tape  (PB) Value  (yearly  increase) 176  PB  (+32%) !17 XSEDE/EGI BoF - XSEDE 2013 EGI-­‐InSPIRE  RI-­‐261323 www.egi.eu
  • 18. Science Virtual Organizations on the OSG • Astrophysics   • Biochemistry   • Bioinformatics     • Earthquake  Engineering   • Genetics   • Gravitational-­‐wave  physics     • Mathematics   • Nanotechnology   • Nuclear  and  particle  physics
  • 19. LSN-MAGIC Meeting February 22, 2012 XSEDE: The Next Generation of US Supercomputing Infrastructure The Role of Standards for Risk Reduction and Inter-operation in XSEDE OGF standards power some of the largest supercomputing infrastructures in the world!
  • 20. LSN-MAGIC Meeting XSEDE Services Layer:
 February 22, 2012 Simple services combined in many ways –Resource  Namespace  Service  1.1   –OGSA  Basic  Execu@on  Service   –OGSA  WSRF  BP  –  metadata  and  no@fica@on   –OGSA-­‐ByteIO   Examples – (not –GridFTP   a complete list) –JSDL,  BES,  BES  HPC  Profile   –WS  Trust  Secure  Token  Services   –WSI  BSP  for  transport  of  creden@als   –…  (more  than  we  have  room  to  cover  here) XSEDE represents a phase change in the engagement of modern computing standards with US cyberinfrastructure. !20
  • 21. Standardization Benefits p Having an organized set of acceptance criteria 
 can improve business value to members in the following ways: n For VENDORS, ensures that their product passes test acceptance conditions, leading to fewer customer complaints in the field. n For PROVIDERS, ensures that products they are hosting are wellbehaved, with fewer unexpected error or service failure conditions. n For USERS, ensures that the products and services they use will be interoperable with the API, framework or standard they are using as the basis for their purchased services, p Pre-purchase specification for products and services can be done on a rational basis. p Productivity of programmer teams is maximized by having welldefined workflows for scenario and unit testing. Alan Sill, TTU November 20, 2013 !21
  • 22. About the Open Grid Forum: Open Grid Forum (OGF) is a leading global standards organization cooperating with many partners in the areas of cloud, grid and related forms of advanced distributed computing. The OGF community and its partners pursue these topics through an open process for development, creation and promotion of relevant specifications and use cases. The central feature of this work is open forum with open processes to champion architectural blueprints related to cloud and grid computing. The resulting specifications and standards enable pervasive adoption of advanced distributed computing techniques for business and research worldwide. Alan Sill, TTU November 20, 2013 !22
  • 23. History and Background • • • • • • OGF began in 2001 as an organization to promote the advancement of distributed computing worldwide. Grid Forum --> Global Grid Forum --> GGF + Enterprise Grid Alliance --> formation of OGF in 2005. Mandate is to take on all forms of distributed computing and to work to promote cooperation, information exchange, best practices in use and standardization. OGF best known for a series of important computing, security and network standards that form the basis for major science and business-based distributed computing (BES, GridFTP, DRMAA, JSDL, RNS, GLUE, UR, etc.). Have also been working on cloud and Big Data standards (OCCI, WS-Agreement, DFDL, etc.) for several years. Cooperative work agreements with other SDOs in place. Alan Sill, TTU November 20, 2013 !23
  • 24. OGF and the Pursuit of Open International Standards: • OGF views its mission as integrally tied to the creation and implementation of practical standards of use across a wide variety of boundaries. • Interoperability and utility for implementation across multiple projects is essential • Interoperability and usability across international boundaries on a global basis is desired • OGF’s approach to standards creation and curation promotes development of standards that will be of use to the large-scale infrastructure projects. • Standards are developed by participants in these projects. • For the past several years, active also in cloud computing. © 2013 Open Grid Forum www.ogf.org
  • 25. OGF Standards Strengths § OGF has an extensive set of applicable standards related to federated community grid and cloud computing: § § § § § § § § § § § § § Federated Identity Management (FedSec-CG) Managing the Trust Eco-System (CA operations, AuthZ and AuthN tools) Virtual Organizations (VOMS) and related authorization tools Job Submission and Workflow Management (JSDL, BES, HPC Profile) Network Management (NSI, NML, NMC, NM) Secure, fast multi--party data transfer (GridFTP, SRM) Data Format Description Language (DFDL) Service Agreements (WS-Agreement, WS-Agreement Negotiation) Cloud Computing interfaces (OCCI family of specifications) Distributed resource management (DRMAA, SAGA, etc.) Firewall Traversal (FiTP); Usage Accounting (UR, GLUE) Others under development through ISOD-RG, DCIFed-WG, etc. Working to gather this information to form an organized description of OGF work - an OGF “Cloud Portfolio”. Alan Sill, TTU November 20, 2013 !25
  • 26. OGF Standards In Use In Industry: • DRMAA: Distributed Resource Management Application API Grid Engine, Open Grid Scheduler: (open source); TORQUE and related products: Adaptive Computing; PBS Works: Altair Engineering; Gridway: DSA Research; Condor: U. of Wisconsin / Red Hat; • OGSA® Basic Execution Service Version 1.0 and BES HPC Profile: BES++ for LSF/SGE/PBS: Platform Computing; Windows HPC Server 2008: Microsoft Corporation; PBS Works - (client only): Altair Engineering; • JSDL: Job Submission Description Language (family of specs): BES++ for LSF/SGE/PBS and Platform LSF: Platform Computing; Windows HPC Server 2008: Microsoft Corporation; PBS Works - (client only): Altair Engineering; • WS-Agreement (family of specifications): ElasticLM License-as-a-Service: ElasticLM; BEinGrid SLA Negotiator, 
 LM-Architecture and Framework: (Multiple partners); BREIN SLA Management Framework: (Multiple partners); WSAG4J, Web Services Agreement for Java (framework implementation): Fraunhofer SCAI. Alan Sill, TTU November 20, 2013 !26
  • 27. OGF Infrastructure Area The OGF Infrastructure groups explore and define what is needed to interface physical and virtual resources to higher level constructs. These include networks and network devices, computers and virtual machines, storage, visualization devices, instruments, and sensor technologies. • • • • • • Network Measurements Working Group (NM-WG) • • Firewall Virtualization For Grid Applications Working Group (FVGA-WG) Network Measurement And Control Working Group (NMC-WG) Network Mark-Up Language Working Group (NML-WG) Network Service Interface Working Group (NSI-WG) Open Cloud Computing Interface Working Group (OCCI-WG) Infrastructure Services On-Demand Provisioning Research Group (ISOD-RG) Grid High-Performance Networking Research Group (GHPN-RG) Alan Sill, TTU November 20, 2013 !27
  • 28. Infrastructure Area: The Groups Network Measurements NM-WG Network Measurement & Control NMC-WG Network Mark-up Language NML-WG Network-Network DNMR-BOF merge spawn Grid-Network Grid High Performance GNI-BOF Networking GHPN-RG DICE Use Cases Best Practices Standards Network Service Interface NSI-WG Firewall Virtualisation WG Firewall RG Open Cloud Computing Interface OCCI-WG On-demand Infrastructure Services Provisioning ISOD-RG 2 © 2011 Open Grid Forum OGF32, Salt Lake City, July 2011
  • 29. InterCloud-Related Standardization Activities • NIST Cloud definition (NIST SP 800-145), NIST Special Publication 500-291 version 2, NIST Cloud Computing Standards Roadmap, July 2013and Cloud Computing Reference Architecture (CCRA), v1.0 (NIST SP 500-292) http://www.nist.gov/itl/cloud/publications.cfm • ITU-T Focus Group on Cloud: Technical Report (Part 1 to 7) 
 http://www.itu.int/en/ITU-T/focusgroups/cloud/Documents/FG-coud-technical-report.zip • IEEE - WGs on InterCloud issues and Cloud Profiles 
 – IEEE ICWG/2302 WG - Intercloud WG (ICWG) Working Group
 http://standards.ieee.org/develop/wg/ICWG-2302_WG.html
 – IEEE P2301, P2302 Projects 
 http://standards.ieee.org/develop/project/2301.html, 2302.html • OGF ISOD-RG
 – On-Demand Infrastructure Services Provisioning Best Practices:
 http://ogf.org/documents/GFD.208.pdf • IETF Internet Drafts –  Cloud Reference Framework. Internet Draft, by B. Khasnabish, J. Chu, S. Ma,Y. Meng, N. So, P. Unbehagen, M. Morrow, M. Hasan,Y. Demchenko 
 http://tools.ietf.org/html/draft-khasnabish-cloud-reference-framework-05.txt –  Cloud Service Broker, Internet Draft by Shao Weixiang, Hu Jie, Bhumip Khasnabish.
 http://tools.ietf.org/html/draft-shao-opsawg-cloud-service-broker-03.txt Alan Sill, TTU November 20, 2013 !29
  • 30. Open Cloud Computing Interface® OCCI® by OGF • OCCI is an API and Protocol • Sits on the boundary of a Service Provider and Service Consumer http://ogf.org/documents/GFD.183.pdf • No assumptions about the boundary http://ogf.org/documents/GFD.184.pdf http://ogf.org/documents/GFD.185.pdf Many real-world implementations! Alan Sill, TTU November 20, 2013 !30
  • 31. Federation Test bed – September 2013 FedCloud Core Services AAI EGI Production Infrastructure Service Availability SAM Configuration GOCDB DB Accounting APEL External Services Certification Authorities Image Metadata Marketplace VOMS Proxy User Interfaces OCCI Clients rOCCI; WNoDeS-CLI CDMI Clients Libcdmi-java Information System Top-DBII Resource Providers VOMS proxy OCCI server CDMI server ! OpenNebula OpenStack StratusLab WNoDeS Marketplace client Appliance Repository SSM Vmcatcher Vmcaster LDAP Monitoring Nagios VO VOMS server Credit: David Wallom Chair EGI Federated Cloud Task Force
  • 32. Task Force – Sept 2013 Cyfronet FZJ OeRC EGI.eu CESNET GWDG IN2P3 CNRS KTH FCTSG Members Technologies •OpenNebula. •StratusLab. •OpenStack. •Synnefo. •WNoDeS. •70 individuals •40 institutions •13 countries CETA Masaryk INFN CESGA SARA IGI RADICAL STFC TUD Stakeholders IFCA •23 Resource Providers •10 Technology Providers •7 User Communities •4 Liaisons SZTAKI BSC GRNET Imperial DANTE LMU IPHC IISAS SixSq 100%IT IFAE SRCE Credit: David Wallom Chair EGI Federated Cloud Task Force
  • 33. Multiple Organizations Have Cloud Standards Multiple organizations have their own APIs, and real work has been done by standards organizations to catch up and offer common standards and products that can work across these. Now is the time to do this! Recent work has brought several cloud-related standards into frameworks that can be used to implement them (for example, CloudStack, OpenStack, Open Nebula, and several others) and are mature enough to apply: n n n n n n n Open Cloud Computing Interface (OCCI) from OGF Cloud Data Management Interface (CDMI) from SNIA Data Format Description Language (DFDL) from OGF Open Virtualization Format (OVF) from DMTF and ISO Cloud Application Management Protocol (CAMP) from OASIS Cloud Infrastructure Management Interface (CIMI) from DMTF WS-Agreement and WS-Agreement Negotiation from OGF Alan Sill, TTU November 20, 2013 !33
  • 34. Standards Organizations Active in Cloud Computing: (Some of many...) • It is often said that there are “too many standards organizations”. This is a lot like saying there is “too much software”. • Each has its own area of specialty, its own contributor base, and its own method of funding to develop its work products. • How best to work with these organizations? (Our answer: Cooperatively!) Alan Sill, TTU November 20, 2013 !34
  • 35. OGF Cooperative Agreements In Place as of Feb. 2013 OGF and ETSI: Cooperative MoU in place; contributing to ETSI CSC effort. Co-host Cloud Plugfest series (cooperative with SNIA). OGF and TM Forum: Memorandum of Understanding in place; ongoing cross-SDO document on End-to-End Management of Cloud Service Agreements, including SLAs, in progress. OGF and CSA: Cooperative agreement between OGF and CSA in place. OGF and IEEE: OGF co-sponsored IEEE CloudCom 2011 (Athens) and Cloudcom 2012 (Taipei); open to other engagements. © 2011 Open Grid Forum Cloudscape V LSN-MAGIC Meeting February 22, 2012 OGF and SIENA, NIST, GICTF, Canada Cloud, etc.: Contribute actively to to ongoing global standards roadmapping efforts. OGF and DMTF: Joint work register on OCCI and CIMI with DMTF Cloud Management WG. OGF and ISO; OGF and ITU-T: OGF has a formal liaisons with ISO/ IEC JTC1 SC38 on Cloud Computing and with ITU-T JCA Cloud. OGF and SNIA (CDMI): Cooperative agreement w/SNIA Cloud on CDMI and has held 7 jointly hosted Cloud Standards Plugfests so far (cooperative now with ETSI). Brussels, Belgium Feb. 28, 2013 !35
  • 36. DMTF
 Cloud Management Standards
 
 Slides prepared by
 Winston Bumpus – VMware

  • 37. Who is DMTF • Established in 1993 to enable more effective management of millions of IT systems worldwide by bringing the IT industry together to collaborate on the development, validation and promotion of systems management standards. • The group spans the industry with 160 member companies and organizations, and more than 4,000 active participants crossing 43 countries. • Strong Alliance Partnership with GICTF and other Organizations • The DMTF board of directors is led by 17 innovative, industry-leading technology companies. They include; Broadcom Corporation; CA Technologies.; Cisco; Citrix Systems, Inc.; Fujitsu; HP; Hitachi, Ltd.; Huawei; IBM; Intel Corporation; Microsoft Corporation; NetApp; Oracle; Software AG; SunGard Availability Services; Telecom Italia and VMware, Inc.
  • 38. Open Virtualization Format (OVF) XML myapp.ovf A standard packaging format for virtual machines A distribution format for VMs Supports single VM & multiple VM configurations Optimized for distribution & simple automation Vendor and platform independent Now an ANSI and ISO standard myapp.mf myapp.cert An OVF package consists of One OVF descriptor with extension .ovf zero or one OVF manifest (w/ extension .mf) zero or one OVF certificate (w/ extension .cert) zero or more disk image files zero or more additional resource files (such as ISO images) web.xxx images.iso OVF Package (myapp.ova) OVF 2 (Recently Released): brings an enhanced set of networking capabilities making it applicable to a broader range of use cases that are emerging as industry enters the Cloud era.
  • 39. Cloud Infrastructure Management Interface (CIMI) Model Scope: Core IaaS functionality Deploying and managing: Machines, Volumes, Networks, Monitoring, etc. Client: VM/application developer, deployer and administrator Server: IaaS Cloud Provider Version 1.1 is released and implemented CIMI REST/HTTP-Based Protocol Specification currently describes a REST/HTTP binding to the model. Other bindings are Considered. Follows REST principles and describes mapping of the HTTP protocol verbs to operations on the model. Standard HTTP status codes are used to convey the results of the operations. Serialization formats for the message body include JSON and XML Other features: Cloud Entry Point to manage Systems, Machines, Volumes, and Networks; Grouping of resources meant to be managed as a single unit; Metering and Monitoring support; Resource metadata; Events and event logging; Jobs; Dynamic Discovery of a provider’s resources characteristics; Entity creation using Templates
  • 40. Cloud Auditing Data Federation (CADF) Working Group Scope / Objectives Develop Standards for the Federation of Cloud Auditing Data By Specifying a Normative, Prescriptive Auditing Event Data Format along with Interface Definitions and a compatible Component and Interaction model. The Data Model will include support for: Classification by Extensible Event Taxonomies to categorize cloud provider IT Resources, event Actions and Outcomes. Federation of Customized Auditing Reports and Logs - event data will support federation and be composable into customizable reports and logs. The Interface Model includes: Definition of Service Methods to Manage and Federate the Data Model’s Events, Logs and Reports Interfaces will support audit data Submission, Import and Export, Query and Subscription. The Component and Interaction Model will Demonstrate how the Interfaces and Data Format can be used by Cloud Providers and Consumers to Support Cloud Auditing use cases. Future work may include Profiles that extend the core data and interface specifications to accommodate particular methods of consumption
  • 41. DMTF NSMWG Focus: Virtualized and Hybrid Network Environment Management Apps  and  Services  that  Utilize   Virtualized  L3  Resource/Entities     Apps  and  Services  that  Utilize   Virtualized  Network  Entities     Management  of  Virtualized   Network  Entities vNE  Management  API Virtualized  Network  Entities Network  Entities  Abstraction Edge/Core/Border                                      Router Fire  Wall * AAA   Server … DNS D N S … Balancer Load   Physical    and  Virtual  Network  Entities    
  • 42. Software Entitlement Working Group Purpose: To extend the Common Information Model to capture software entitlement and usage metrics and to deliver the associated profile. Based on ISO/IEC 19770-2 Software Identification Tags Driven by a request for JP Morgan Chase. 1. Update CIM to support Software Entitlement and Usage Metrics – Q4 2013 2. Create CIM Software Entitlement and Usage Metrics Profile - Q1 2014 For more information www.dmtf.org/cloud www.dmtf.org/OVF 7
  • 43. 013.3 Landscape of Cloud SLA Management End User Requirements TMF TR174 ECLC VPC Requirements TMF GB963 Cloud SLA App. Note NIST CC RA/ Taxonomy/SLA ! TMF Multicloud catalyst CSCC – Practical Guide to Cloud SLA TMF GB917.V3 SLAM Handbook ! ITU-T FGCC Cloud Ecosystem Best Practices/Guidebooks Architecture Specification Key inputs to TMF061 SES RA TMF GB922 SID DMTF CMWG DSP-IS0103 DSP-IS0102 DSP-IS0101 ! TMF TR178 Enabling E2E Cloud SLA Management OGF GFD.192 WS-Agreement OASIS TOSCA DMTF CMWG DSP0263 TMF617 SES SMI DMTF CMWG DSP2027 DSP0263 Meta Models Interface Specification Cloud SLA Measurements OGF GFD.192 GFD.193 WS-Agreement WS-Agreement Negotiation DMTF CMWG & SVPC VN QoS Profiles SPEC OSG Cloud Benchmark TMF GB963 Cloud SLA App. Note ISMA CSMIC ! © 2013 TM Forum | 

  • 44. Cloud Plugfest Developer Series: (Multiple Partners) Developer-oriented inperson standards and software testing series OPEN TO ALL! http:// cloudplugfest.org Cloud Plugfest 10 just completed! Continuing series
 co-sponsored by OGF, DMTF, SNIA, OASIS, ETSI, OCEAN and OW2! 9 previous events held so far! Easy to get involved and join in events as developers or project researchers! Cloud Interoperability Week Sep. 2013! Alan Sill, TTU November 20, 2013 !44
  • 45.
  • 46. NIST SAJACC Public Process http://collaborate.nist.gov/twiki-cloud-computing/bin/view/CloudComputing/SAJACC Alan Sill, TTU November 20, 2013 !46
  • 47. ( Internal(Group(Report( Feb(12,(2013 Special(Publication(5001273(Special(Publication(5001273 ! SAJACC Working Group Recommendations to NIST National Institute of Standards and Technology NIST Cloud Computing Standards Acceleration to Jumpstart Adoption of Cloud Computing (SAJACC) Working Group Phase I group report and recommendations
  • 48. NIST SAJACC Phase I Cloud Computing Use Cases • • • Public project to define testable use cases that can provide the basis for independent evaluation of cloud standards, products and processes. Phase I completed and working group report “SAJACC Working Group Recommendations to NIST” delivered Feb. 12, 2013. Working group continues with Phase II to define and refine use cases with greater technical detail.
  • 49. Example Work In Progress: Reorganize and rewrite previous SAJACC Use Cases
  • 50. Example Work In Progress: Incorporate input from other ongoing NIST cloud computing working groups
  • 51. Example Work In Progress: Greatly improve content
  • 52. Example Work In Progress: Include diagrams where appropriate to improve clarity of the logic sequence and workflow of a complex operation, step or procedure.
  • 53. European Union “Standards & Interoperability for e-Infrastructure Implementation” (SIENA) Initiative (2010-2012) SIENA  (2010-­‐2012)  was  a  Support  AcAon  funded  by  the  European  Commission  under  FP7  (2007-­‐13)  CapaciQes  programme. Partners “A  coordinated  effort... Final Report: June 2012 ...towards  the  delivery  of  a  future                         e-­‐Infrastructures  Roadmap.... InternaAonal  Experts  REB  –  Roadmap   –  Special  Liaison   –  Industry  Expert   SLG   IEG   Editorial  Board GroupGroup ...aligned  with  the  needs  of  European  and  na>onal   ini>a>ves  and  the  evolving  world.” Standards  Development  OrganisaAons  (SDOs) Distributed  CompuAng  Infrastructure  (DCI)  IniAaAves Consolidated  Cloud  CompuAng  Workshops Alan Sill, TTU November 20, 2013 !53
  • 54. European Cloud Standards Coordination (New) Multi-organization open survey commissioned by EC, coordinated by ETSI along same lines as GICTF, NIST ra D In ft ro P re g s! s Alan Sill, TTU November 20, 2013 !54
  • 55. Summary p Many active projects are underway to document, map and extend the important role played by standards and software development with significant uptake in advanced distributed computing, including cloud, grid, networking and large-scale data processing, transfer and handling through innovative cooperation with many partners. p The CAC actively engages with partners and participants throughout the international arena to understand and promote best practices and standards in cloud and advanced distributed computing. p TTU is leveraging these standards to support a wide variety of flexible architectures for advanced scientific and business uses through the NSF Cloud and Autonomic Computing Center and is actively seeking international collaborators to extend this work more comprehensively through the cloud. Alan Sill, TTU November 20, 2013 !55