The document describes the EGI Federated Cloud, which federates public and private clouds across Europe and the world to provide cloud services for research communities at scale through open standards and an open marketplace of computing and storage resources from multiple providers. The EGI Federated Cloud aims to enable resilience, prevent vendor lock-in, and scale to user needs through the federation of heterogeneous cloud resources that are integrated into a common platform.

1. www.egi.euEGI-InSPIRE RI-261323
EGI-InSPIRE
www.egi.euEGI-InSPIRE RI-261323
The EGI Federated Cloud
David Wallom
University of Oxford
Chair, EGI Federated Cloud

2. www.egi.euEGI-InSPIRE RI-261323
Why federation?
• User load larger than a single in-house
system
• Single public providers introduce SPoF
• Multiple service providers give resilience
• But…
– Multiple service providers cause
management headaches
– Multiple interfaces cause development
headaches

3. www.egi.euEGI-InSPIRE RI-261323
Hardware
Hardware
Hardware
Hardware
Hardware
Cloud Management
Cloud Management
Cloud Management
Cloud Management
Cloud Management
User Communities
User Communities
User Communities
Federated
interfaces
Federated
services
• Heterogeneous implementation: no mandate
on the cloud technology.
• Standards and validation: Recommended and
common open standards for the interfaces and
images – OCCI, CDMI, OVF, GLUE2.
• Provider agnosticism: the only condition to
federate resources is to expose the chosen
interfaces and services.
• Resource integration: Cloud Computing to be
integrated into the existing production
infrastructure.
Principles of Federation

4. www.egi.euEGI-InSPIRE RI-261323
Value proposition
The EGI Federated Cloud is the federation of public and private
Clouds, offering Cloud Services to consumers in Europe and the rest
of the world
A cloud system able to
• Scale to user* needs presenting individually to each community
• Integrate multiple different providers to give resilience
• Prevent vendor lock-in
• Enable resource provision targeted towards the research
community
Standards based federation of IaaS cloud:
• Exposes a set of independent cloud services accessible to users
utilising a common standards profile
• Allows deployment of services across multiple providers and
capacity bursting
* Where user is no longer just the end user

5. www.egi.euEGI-InSPIRE RI-261323
EGI Cloud Infrastructure
5
EGI Core Platform
Federated
AAI
Service
Registry
Monitoring Accounting
Information
Discovery
Help and
Support
Security Co-
ordination
Training and
Outreach
EGICollaborationPlatform
EGI
Application
DB
Image
Repository
EGICloudServiceMarketplace
Sustainable
Business
Models
User Communitty
EGI Cloud Infrastructure Platform
Instance
Mgmt
Storage
Management
Cloud Management Stacks
(OpenStack, OpenNebula, Synnefo, …)
Providers Cloud Management Framework
(new one we don’t now about and don’t want to care about)
Standards
OCCI CDMI
OVF

6. www.egi.euEGI-InSPIRE RI-261323
Personalised Federations
EGI
Platforms
ELIXIR Cloud
Federation*
CSGw Cloud
Federation
DCH-RPCloud
Federation

7. www.egi.euEGI-InSPIRE RI-261323
Geographical dispersion
• 12 countries provide 15 certified
resources
– Czech Republic, Germany, Greece,
Hungary, Italy, Macedonia, Poland,
Slovakia, Spain, Sweden, Turkey,
United Kingdom
• 2 countries currently integrating
– Croatia, Finland
• 5 countries interested
– Bulgaria, France, Israel*, The
Netherlands, Switzerland
• Worldwide interest
– South Africa* (SAGrid)
– South Korea* (KISTI)
– United States* (NIST, NSF Centres)
* Not shown on map

8. www.egi.euEGI-InSPIRE RI-261323
EGI Marketplace
• Rich and diverse set of individual offerings
• Application/VM Image repository
• User community choice of provider at all levels
• Academic and commercial resource & service providers
• User community from the public and private sector
• Client tools at either the GUI (Broker), command- line or API level

9. www.egi.euEGI-InSPIRE RI-261323
The BioVel Portal
3/31/2015 9
Evalu
mo
BENELUX con
Ghent, 02. Apr

10. www.egi.euEGI-InSPIRE RI-261323
OpenModeller on the
Biovel Portal
3/31/2015 10
Evalua
mod
BENELUX confe
Ghent, 02. April
The Ecological Niche Modelling (ENM) Workflow takes as input
a file containing species occurrence points to create a model
with the openModeller Web Service.
• The EUBrazilOpenBio ENM service is
exposed through an extended
openModeller Web Service interface
• Multi-staging and multi-parametric oM
experiments are implemented through
COMPSs that dynamically creates the
virtual resources to execute the
operations.
• An OCCI connector is used for the VMs
management while data management
supports CDMI endpoints.
ENM Service (OMWS2)
VENUS-C Cloud Middleware
COMPSs Workflow
Orchestrator
OCCI CDMI
EGI Federated Cloud
Service available at
https://portal.biovel.eu/

11. www.egi.euEGI-InSPIRE RI-261323
Strengthening the underpinning platform
Technology Evolution
• Broader support for open standards in Cloud
management frameworks
– Configuration of interfaces to commercial cloud
frameworks
• New feature additions to foundational tools
depending on requests
– Accounting, monitoring, service discovery, Application
DB
• Innovate and deploy PaaS & SaaS
• Large improvements on documentation for all 3
stakeholder groups
11
ValueaddedservicesforUser
Communities

12. www.egi.euEGI-InSPIRE RI-261323
Conclusions
• Paving the way for a global federated cloud marketplace
– Established best practice
– Illustrating European leadership
– Open standards, open technology
– Open membership, open processes
– Open competition
• Aiming to become a philosophy on how we create federated e-
infrastructure
Launch capability – 5,000 cores, 225 TB storage
Q4 2014 (planned commitments) – 18,000 cores, 6000 TB storage
2020 (Goal) – 1,000,000 cores, 1 EB storage
12

13. www.egi.euEGI-InSPIRE RI-261323
Thank you!
Questions?
13
Task Force resources
Mailing List: fedcloud-tf@mailman.egi.eu
Wiki site: http://go.egi.eu/tf-fedclouds
GitHub: https://github.com/EGI-FCTF
Indico site: https://www.egi.eu/indico/categoryDisplay.py?categId=112