SlideShare une entreprise Scribd logo
1  sur  24
Télécharger pour lire hors ligne
Community	
  Network	
  	
  
     Cloud	
  Middleware	
  
             “A	
  Storage	
  Approach”	
  




    Students	
                    Supervisor	
  
 Antonio	
  Severien	
         Leandro	
  Navarro	
  
     severien@kth.se	
          leandro@ac.upc.edu	
  
             	
  
                                         	
  
Ioanna	
  Tsalochidou	
                  	
  
     ioannat@kth.se	
  	
  
Outline	
  
•     IntroducCon	
  
•     Cloud	
  Middleware	
  
•     ObjecCves	
  
•     OpenStack	
  
•     Experimental	
  Setup	
  
•     Results	
  
•     Future	
  Work	
  
•     Findings	
  
•     Summary	
  
06/12/12	
                                  2	
  
IntroducCon	
  


•  Community	
  Networks	
  Testbed	
  for	
  the	
  Future	
  Internet	
  
        –  Commodity	
  wireless	
  and	
  opCcal	
  links;	
  heterogeneous	
  nodes;	
  different	
  
           rouCng	
  protocols;	
  different	
  applicaCons	
  


•  Cloud	
  middleware	
  running	
  on	
  “wild-­‐area”	
  resources	
  
        –  	
  OpenStack,	
  OpenNebula	
  
        –  	
  Evaluate	
  scalability	
  and	
  “suitability”	
  to	
  provide	
  either;	
  compu.ng	
  or	
  
           storage	
  services	
  




06/12/12	
                                                                                                         3	
  
Cloud	
  Middleware	
  
•  Cloud	
  OperaCng	
  System	
  
        –  Controls	
  large	
  pools	
  of	
  compute,	
  networking	
  and	
  storage	
  
           resources	
  throughout	
  a	
  datacenter	
  

                                           Your	
  ApplicaCons	
  



                                                                                   Cloud	
  OperaCng	
  	
  
                                                                                       System	
  
                                                  Cl	
  
 Management	
  
    GUI	
                    Compute	
                               Storage	
  
                                               Networking	
  

                                     Standard	
  Hardware	
  
06/12/12	
                                                                                                4	
  
ObjecCves	
  
•  Observe	
  how	
  the	
  different	
  cloud	
  middlewares	
  behave	
  	
  
        –  On	
  unstable	
  network	
  environment	
  	
  
        –  On	
  scarce	
  hardware	
  resources	
  
           	
  
•  Create	
  a	
  methodology	
  to	
  be	
  used	
  on	
  CONFINE	
  
     	
  
•  Preliminary	
  benchmarking	
  
	
  
•  TesCng	
  
        –  Inject	
  delays	
  on	
  network	
  (Netem)	
  
        –  Measure	
  performance	
  (FileBench)	
  


06/12/12	
                                                                   5	
  
OpenStack	
  Conceptual	
  Architecture	
  




    06/12/12	
                                                                                                                             6	
  
Figure	
  taken	
  from	
  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐conceptual-­‐arch-­‐folsom.jpg	
  	
  
OpenStack	
  Logical	
  Architecture	
  




    06/12/12	
                                                                                                                                      7	
  
Figure	
  taken	
  from	
  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐logical-­‐arch-­‐folsom.jpg	
  	
  
OpenStack	
  Logical	
  Architecture	
  




    06/12/12	
                                                                                                                                      8	
  
Figure	
  taken	
  from	
  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐logical-­‐arch-­‐folsom.jpg	
  	
  
OpenStack	
  Storage	
  
Storage	
  Services	
  
        –  Block	
  Storage	
  (Cinder)	
  à	
  nova-­‐volume	
  (iSCSI/LVM)	
  
               •  Uses	
  LVM	
  to	
  create	
  and	
  manage	
  volumes,	
  and	
  exports	
  
                  them	
  via	
  iSCSI	
  	
  
        –  Object	
  Storage	
  (Swif)	
  
               •  Low	
  level	
  of	
  abstracCon	
  
               •  Good	
  for	
  staCc	
  content	
  (e.g.,	
  CDN)	
  
               •  HTTP	
  interface	
  with	
  REST	
  API	
  
        –  File	
  Storage	
  	
  	
  
               •  “none	
  na.ve	
  support”	
  (There	
  is	
  a	
  connector	
  for	
  
                  GlusterFS)	
  
        	
  
06/12/12	
                                                                                         9	
  
Cinder	
  (Nova-­‐volume)	
  

               Instance	
                                Instance	
     A	
  volume	
  can	
  be	
  	
  
                                                                        a`ached/detached	
  	
  
                                                                        from	
  running	
  instances	
  




                                     Volume	
  
                              Block	
  Storage	
  Store	
  



06/12/12	
                                                                                          10	
  
Cinder	
  (Block	
  Storage)	
  


                                                             Instance	
  

                                         Compute	
  




               Block	
  Storage	
     Block	
  Storage	
                    Block	
  Storage	
  

                                      Volume	
  Store	
  
06/12/12	
                                                                                         11	
  
Cinder	
  (Block	
  Storage)	
  


                                                             Instance	
  

                                         Compute	
  




               Block	
  Storage	
     Block	
  Storage	
                    Block	
  Storage	
  

                                      Volume	
  Store	
  
06/12/12	
                                                                                         12	
  
Running	
  Compute	
  Node	
  




Figures	
  taken	
  from	
  
h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/
content/images-­‐and-­‐instances.html	
  	
  
    06/12/12	
                                               13	
  
Experimental	
  Setup	
  
                          Cinder	
  Volume	
  Store	
  




                                                          Nova	
  Compute	
  &	
  Controller	
  



   •  FileBench	
  Workload	
  Generator	
  
               –  File	
  system	
  and	
  storage	
  benchmark	
  
               –  Variety	
  of	
  workloads	
  and	
  pre-­‐defined	
  workloads	
  for	
  
                  webserver,	
  file	
  server,	
  etc.	
  
               –  Reports	
  throughput	
  and	
  latency	
  
               –  Uses	
  Workload	
  Model	
  Language	
  (WML)	
  
06/12/12	
                                                                                         14	
  
Experimental	
  Setup	
  
Steps	
  for	
  experiments:	
  
1.  Off-­‐line	
  creaCon	
  of	
  volumes	
  
2.  At-­‐runCme	
  a`achment	
  of	
  volumes	
  to	
  instances	
  hosted	
  within	
  	
  
    the	
  same	
  availability	
  zones	
  
3.  Formakng	
  mounted	
  volumes	
  with	
  ext3	
  file	
  system	
  
4.  MounCng	
  the	
  forma`ed	
  volume	
  as	
  a	
  file	
  system	
  within	
  a	
  Linux	
  	
  
    instance	
  
5.  Subsequent	
  benchmarking…	
  


06/12/12	
                                                                                      15	
  
Experiment	
  Results	
  
Read	
  Experiments	
  
         	
  File	
  Size:	
  3GB	
  
         	
  IO	
  Size:	
  1MB	
  	
  
         	
  Threads:	
  1	
  
         	
  Caching:	
  disabled	
  
	
  	
  




      06/12/12	
                                                 16	
  
Experiment	
  Results	
  
Write	
  Experiments	
  
   	
  File	
  Size:	
  3GB	
  
   	
  IO	
  Size:	
  1MB	
  	
  
   	
  Threads:	
  1	
  
   	
  Caching:	
  disabled	
  




     06/12/12	
                                            17	
  
Future	
  Work	
  


•  Use	
  OpenNebula	
  and	
  perform	
  the	
  same	
  experiments	
  
•  Expand	
  this	
  work	
  to	
  run	
  on	
  a	
  larger	
  scale	
  
•  Use	
  CONFINE	
  testbed	
  for	
  experiments	
  




06/12/12	
                                                            18	
  
Future	
  Work	
  (Real	
  Deal)	
  




06/12/12	
                                            19	
  
Summary	
  

•  Cloud	
  Middleware:	
  nothing	
  but	
  a	
  resource	
  manager	
  
•  Deployed	
  OpenStack	
  in	
  a	
  micro	
  test-­‐environment	
  
•  Benchmarking:	
  diverse	
  workloads	
  
•  Community	
  Cloud…	
  it	
  is	
  possible,	
  but	
  with	
  
   restricCons	
  bounded	
  by	
  available	
  resources	
  




06/12/12	
                                                              20	
  
Findings	
  
•  OpenStack	
  
        –  Is	
  evolving	
  
        –  Needs	
  to	
  be	
  more	
  user-­‐friendly	
  
        –  Dynamic	
  configuraCon	
  
           	
  
•  Community	
  Cloud	
  
        –  Provide	
  services	
  that	
  require	
  less	
  resources	
  
        –  “Guarantee”	
  stability	
  and	
  availability	
  of	
  resources	
  




06/12/12	
                                                                          21	
  
Acknowledgments	
  
•  Thanks	
  to	
  Leandro	
  Navarro	
  
•  Thanks	
  to	
  Ying	
  for	
  clearing	
  the	
  clouds	
  from	
  the	
  cloud	
  
•  Thanks	
  to	
  Manos	
  and	
  Mudit	
  for	
  networking	
  
   assistance	
  
•  Thanks	
  to	
  Ioanna	
  for	
  accepCng	
  the	
  challenge	
  	
  
•  Thanks	
  to	
  the	
  OpenStack	
  community	
  
•  Thanks	
  to	
  the	
  Linux	
  community	
  


06/12/12	
                                                                           22	
  
References	
  
•     OpenStack:	
  h`p://www.openstack.org	
  
•     Ubuntu	
  Cloud:	
  h`p://www.ubuntu.com/cloud	
  	
  
•     OpenNebula:	
  h`p://opennebula.org/	
  
•     DevStack:	
  h`p://devstack.org/	
  
•     CONFINE:	
  h`p://confine-­‐project.eu/	
  
•     FileBench:	
  h`p://sourceforge.net/apps/mediawiki/filebench/	
  	
  
•     Netem:	
  
      h`p://www.linuxfoundaCon.org/collaborate/workgroups/
      networking/netem	
  	
  



06/12/12	
                                                              23	
  
Community cloud antonioseverien

Contenu connexe

Tendances

Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...Ceph Community
 
Considerations for Building Your Private Cloud.pdf
Considerations for Building Your Private Cloud.pdfConsiderations for Building Your Private Cloud.pdf
Considerations for Building Your Private Cloud.pdfOpenStack Foundation
 
At the Crossroads of HPC and Cloud Computing with Openstack
At the Crossroads of HPC and Cloud Computing with OpenstackAt the Crossroads of HPC and Cloud Computing with Openstack
At the Crossroads of HPC and Cloud Computing with OpenstackRyan Aydelott
 
Inside the Hadoop Machine @ VMworld
Inside the Hadoop Machine @ VMworldInside the Hadoop Machine @ VMworld
Inside the Hadoop Machine @ VMworldRichard McDougall
 
Cgroup resource mgmt_v1
Cgroup resource mgmt_v1Cgroup resource mgmt_v1
Cgroup resource mgmt_v1sprdd
 
NoSQL in der Cloud - Why?
NoSQL in der Cloud -  Why?NoSQL in der Cloud -  Why?
NoSQL in der Cloud - Why?adesso AG
 
Gluster Webinar: Introduction to GlusterFS
Gluster Webinar: Introduction to GlusterFSGluster Webinar: Introduction to GlusterFS
Gluster Webinar: Introduction to GlusterFSGlusterFS
 
Ensuring performance for real time packet processing in open stack white paper
Ensuring performance for real time packet processing in open stack white paperEnsuring performance for real time packet processing in open stack white paper
Ensuring performance for real time packet processing in open stack white paperhptoga
 
Setting up a private cloud for academic environment with OSS by Zoran Pantic ...
Setting up a private cloud for academic environment with OSS by Zoran Pantic ...Setting up a private cloud for academic environment with OSS by Zoran Pantic ...
Setting up a private cloud for academic environment with OSS by Zoran Pantic ...José Ferreiro
 
Container Attached Storage with OpenEBS - CNCF Paris Meetup
Container Attached Storage with OpenEBS - CNCF Paris MeetupContainer Attached Storage with OpenEBS - CNCF Paris Meetup
Container Attached Storage with OpenEBS - CNCF Paris MeetupMayaData Inc
 
From IaaS to PaaS to Docker Networking to … Cloud Networking Scalability
From IaaS to PaaS to Docker Networking to … Cloud Networking ScalabilityFrom IaaS to PaaS to Docker Networking to … Cloud Networking Scalability
From IaaS to PaaS to Docker Networking to … Cloud Networking ScalabilityDaoliCloud Ltd
 
Using the IBM XIV Storage System in OpenStack Cloud Environments
Using the IBM XIV Storage System in OpenStack Cloud Environments Using the IBM XIV Storage System in OpenStack Cloud Environments
Using the IBM XIV Storage System in OpenStack Cloud Environments IBM India Smarter Computing
 
ASPLOS2011 workshop RESoLVE "Effect of Disk Prefetching of Guest OS "
ASPLOS2011 workshop RESoLVE "Effect of Disk Prefetching of Guest OS "ASPLOS2011 workshop RESoLVE "Effect of Disk Prefetching of Guest OS "
ASPLOS2011 workshop RESoLVE "Effect of Disk Prefetching of Guest OS "Kuniyasu Suzaki
 
OpenStack Day Italy: openATTC as an open storage platform for OpenStack
OpenStack Day Italy: openATTC as an open storage platform for OpenStackOpenStack Day Italy: openATTC as an open storage platform for OpenStack
OpenStack Day Italy: openATTC as an open storage platform for OpenStackit-novum
 
Build Your Private Cloud with Ezilla and Haduzilla
Build Your Private Cloud with Ezilla and HaduzillaBuild Your Private Cloud with Ezilla and Haduzilla
Build Your Private Cloud with Ezilla and HaduzillaJazz Yao-Tsung Wang
 
OSS Presentation by Kevin Halgren
OSS Presentation by Kevin HalgrenOSS Presentation by Kevin Halgren
OSS Presentation by Kevin HalgrenOpenStorageSummit
 
CloudStackユーザ会〜仮想ルータの謎に迫る
CloudStackユーザ会〜仮想ルータの謎に迫るCloudStackユーザ会〜仮想ルータの謎に迫る
CloudStackユーザ会〜仮想ルータの謎に迫るsamemoon
 

Tendances (20)

Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
 
Considerations for Building Your Private Cloud.pdf
Considerations for Building Your Private Cloud.pdfConsiderations for Building Your Private Cloud.pdf
Considerations for Building Your Private Cloud.pdf
 
At the Crossroads of HPC and Cloud Computing with Openstack
At the Crossroads of HPC and Cloud Computing with OpenstackAt the Crossroads of HPC and Cloud Computing with Openstack
At the Crossroads of HPC and Cloud Computing with Openstack
 
Inside the Hadoop Machine @ VMworld
Inside the Hadoop Machine @ VMworldInside the Hadoop Machine @ VMworld
Inside the Hadoop Machine @ VMworld
 
Cgroup resource mgmt_v1
Cgroup resource mgmt_v1Cgroup resource mgmt_v1
Cgroup resource mgmt_v1
 
NoSQL in der Cloud - Why?
NoSQL in der Cloud -  Why?NoSQL in der Cloud -  Why?
NoSQL in der Cloud - Why?
 
Gluster Webinar: Introduction to GlusterFS
Gluster Webinar: Introduction to GlusterFSGluster Webinar: Introduction to GlusterFS
Gluster Webinar: Introduction to GlusterFS
 
Ensuring performance for real time packet processing in open stack white paper
Ensuring performance for real time packet processing in open stack white paperEnsuring performance for real time packet processing in open stack white paper
Ensuring performance for real time packet processing in open stack white paper
 
Setting up a private cloud for academic environment with OSS by Zoran Pantic ...
Setting up a private cloud for academic environment with OSS by Zoran Pantic ...Setting up a private cloud for academic environment with OSS by Zoran Pantic ...
Setting up a private cloud for academic environment with OSS by Zoran Pantic ...
 
Container Attached Storage with OpenEBS - CNCF Paris Meetup
Container Attached Storage with OpenEBS - CNCF Paris MeetupContainer Attached Storage with OpenEBS - CNCF Paris Meetup
Container Attached Storage with OpenEBS - CNCF Paris Meetup
 
From IaaS to PaaS to Docker Networking to … Cloud Networking Scalability
From IaaS to PaaS to Docker Networking to … Cloud Networking ScalabilityFrom IaaS to PaaS to Docker Networking to … Cloud Networking Scalability
From IaaS to PaaS to Docker Networking to … Cloud Networking Scalability
 
Inktank:ceph overview
Inktank:ceph overviewInktank:ceph overview
Inktank:ceph overview
 
Using the IBM XIV Storage System in OpenStack Cloud Environments
Using the IBM XIV Storage System in OpenStack Cloud Environments Using the IBM XIV Storage System in OpenStack Cloud Environments
Using the IBM XIV Storage System in OpenStack Cloud Environments
 
Hadoop on VMware
Hadoop on VMwareHadoop on VMware
Hadoop on VMware
 
ASPLOS2011 workshop RESoLVE "Effect of Disk Prefetching of Guest OS "
ASPLOS2011 workshop RESoLVE "Effect of Disk Prefetching of Guest OS "ASPLOS2011 workshop RESoLVE "Effect of Disk Prefetching of Guest OS "
ASPLOS2011 workshop RESoLVE "Effect of Disk Prefetching of Guest OS "
 
OpenStack Day Italy: openATTC as an open storage platform for OpenStack
OpenStack Day Italy: openATTC as an open storage platform for OpenStackOpenStack Day Italy: openATTC as an open storage platform for OpenStack
OpenStack Day Italy: openATTC as an open storage platform for OpenStack
 
Build Your Private Cloud with Ezilla and Haduzilla
Build Your Private Cloud with Ezilla and HaduzillaBuild Your Private Cloud with Ezilla and Haduzilla
Build Your Private Cloud with Ezilla and Haduzilla
 
OSS Presentation by Kevin Halgren
OSS Presentation by Kevin HalgrenOSS Presentation by Kevin Halgren
OSS Presentation by Kevin Halgren
 
CloudStackユーザ会〜仮想ルータの謎に迫る
CloudStackユーザ会〜仮想ルータの謎に迫るCloudStackユーザ会〜仮想ルータの謎に迫る
CloudStackユーザ会〜仮想ルータの謎に迫る
 
Openstorage Openstack
Openstorage OpenstackOpenstorage Openstack
Openstorage Openstack
 

En vedette

China mining quarrying equipment mfg. industry profile cic3611 sample pages
China mining quarrying equipment mfg. industry profile cic3611   sample pagesChina mining quarrying equipment mfg. industry profile cic3611   sample pages
China mining quarrying equipment mfg. industry profile cic3611 sample pagesBeijing Zeefer Consulting Ltd.
 
China recycling of non metal industry profile isic3720 sample pages
China recycling of non metal industry profile isic3720   sample pagesChina recycling of non metal industry profile isic3720   sample pages
China recycling of non metal industry profile isic3720 sample pagesBeijing Zeefer Consulting Ltd.
 
Appalachian Power Wytheville ED Forum - APCo ED Program of Work - John Smolak
Appalachian Power Wytheville ED Forum - APCo ED Program of Work - John SmolakAppalachian Power Wytheville ED Forum - APCo ED Program of Work - John Smolak
Appalachian Power Wytheville ED Forum - APCo ED Program of Work - John SmolakAEP Economic & Business Development
 
Appalachian Power WV ED Forum - AEP ED Program of Work - Mark James
Appalachian Power WV ED Forum - AEP ED Program of Work - Mark JamesAppalachian Power WV ED Forum - AEP ED Program of Work - Mark James
Appalachian Power WV ED Forum - AEP ED Program of Work - Mark JamesAEP Economic & Business Development
 
Build a Successful Social and Mobile Business
Build a Successful Social and Mobile BusinessBuild a Successful Social and Mobile Business
Build a Successful Social and Mobile BusinessProlifics
 
Google Travel Trends Q1 2013 - Malaysia
Google Travel Trends Q1 2013 - MalaysiaGoogle Travel Trends Q1 2013 - Malaysia
Google Travel Trends Q1 2013 - MalaysiaCorinne Wan
 
Experian Hitwise Travel Data - March 2012
Experian Hitwise Travel Data - March 2012Experian Hitwise Travel Data - March 2012
Experian Hitwise Travel Data - March 2012Corinne Wan
 

En vedette (7)

China mining quarrying equipment mfg. industry profile cic3611 sample pages
China mining quarrying equipment mfg. industry profile cic3611   sample pagesChina mining quarrying equipment mfg. industry profile cic3611   sample pages
China mining quarrying equipment mfg. industry profile cic3611 sample pages
 
China recycling of non metal industry profile isic3720 sample pages
China recycling of non metal industry profile isic3720   sample pagesChina recycling of non metal industry profile isic3720   sample pages
China recycling of non metal industry profile isic3720 sample pages
 
Appalachian Power Wytheville ED Forum - APCo ED Program of Work - John Smolak
Appalachian Power Wytheville ED Forum - APCo ED Program of Work - John SmolakAppalachian Power Wytheville ED Forum - APCo ED Program of Work - John Smolak
Appalachian Power Wytheville ED Forum - APCo ED Program of Work - John Smolak
 
Appalachian Power WV ED Forum - AEP ED Program of Work - Mark James
Appalachian Power WV ED Forum - AEP ED Program of Work - Mark JamesAppalachian Power WV ED Forum - AEP ED Program of Work - Mark James
Appalachian Power WV ED Forum - AEP ED Program of Work - Mark James
 
Build a Successful Social and Mobile Business
Build a Successful Social and Mobile BusinessBuild a Successful Social and Mobile Business
Build a Successful Social and Mobile Business
 
Google Travel Trends Q1 2013 - Malaysia
Google Travel Trends Q1 2013 - MalaysiaGoogle Travel Trends Q1 2013 - Malaysia
Google Travel Trends Q1 2013 - Malaysia
 
Experian Hitwise Travel Data - March 2012
Experian Hitwise Travel Data - March 2012Experian Hitwise Travel Data - March 2012
Experian Hitwise Travel Data - March 2012
 

Similaire à Community cloud antonioseverien

Shannon McFarland OpenStack/Cisco Intro
Shannon McFarland OpenStack/Cisco IntroShannon McFarland OpenStack/Cisco Intro
Shannon McFarland OpenStack/Cisco IntroShannon McFarland
 
Building an open source cloud storage platform for OpenStack - openATTIC
Building an open source cloud storage platform for OpenStack - openATTICBuilding an open source cloud storage platform for OpenStack - openATTIC
Building an open source cloud storage platform for OpenStack - openATTICit-novum
 
Ceph and Apache CloudStack
Ceph and Apache CloudStackCeph and Apache CloudStack
Ceph and Apache CloudStackke4qqq
 
Storage as a service and OpenStack Cinder
Storage as a service and OpenStack CinderStorage as a service and OpenStack Cinder
Storage as a service and OpenStack Cinderopenstackindia
 
Ceph Day Santa Clara: Ceph and Apache CloudStack
Ceph Day Santa Clara: Ceph and Apache CloudStack Ceph Day Santa Clara: Ceph and Apache CloudStack
Ceph Day Santa Clara: Ceph and Apache CloudStack Ceph Community
 
Open Stack Cheng Du Swift Alex Yang
Open Stack Cheng Du Swift Alex YangOpen Stack Cheng Du Swift Alex Yang
Open Stack Cheng Du Swift Alex YangOpenCity Community
 
OpenEBS; asymmetrical block layer in user-space breaking the million IOPS bar...
OpenEBS; asymmetrical block layer in user-space breaking the million IOPS bar...OpenEBS; asymmetrical block layer in user-space breaking the million IOPS bar...
OpenEBS; asymmetrical block layer in user-space breaking the million IOPS bar...MayaData
 
Mastering OpenStack - Episode 11 - Scaling Out
Mastering OpenStack - Episode 11 - Scaling OutMastering OpenStack - Episode 11 - Scaling Out
Mastering OpenStack - Episode 11 - Scaling OutRoozbeh Shafiee
 
Cisco: Cassandra adoption on Cisco UCS & OpenStack
Cisco: Cassandra adoption on Cisco UCS & OpenStackCisco: Cassandra adoption on Cisco UCS & OpenStack
Cisco: Cassandra adoption on Cisco UCS & OpenStackDataStax Academy
 
Sanger OpenStack presentation March 2017
Sanger OpenStack presentation March 2017Sanger OpenStack presentation March 2017
Sanger OpenStack presentation March 2017Dave Holland
 
Swift Architecture and Practice, by Alex Yang
Swift Architecture and Practice, by Alex YangSwift Architecture and Practice, by Alex Yang
Swift Architecture and Practice, by Alex YangHui Cheng
 
Running your Java EE applications in the Cloud
Running your Java EE applications in the CloudRunning your Java EE applications in the Cloud
Running your Java EE applications in the CloudArun Gupta
 
Distributed Block-level Storage Management for OpenStack, by Danile lee
Distributed Block-level Storage Management for OpenStack, by Danile leeDistributed Block-level Storage Management for OpenStack, by Danile lee
Distributed Block-level Storage Management for OpenStack, by Danile leeHui Cheng
 
Danile lee -open stackblocklevelstorage
Danile lee -open stackblocklevelstorageDanile lee -open stackblocklevelstorage
Danile lee -open stackblocklevelstorageOpenCity Community
 
Cloud Storage - Technical Whitepaper - SolidFire
Cloud  Storage - Technical Whitepaper - SolidFireCloud  Storage - Technical Whitepaper - SolidFire
Cloud Storage - Technical Whitepaper - SolidFireThe World Bank
 

Similaire à Community cloud antonioseverien (20)

Shannon McFarland OpenStack/Cisco Intro
Shannon McFarland OpenStack/Cisco IntroShannon McFarland OpenStack/Cisco Intro
Shannon McFarland OpenStack/Cisco Intro
 
How swift is your Swift - SD.pptx
How swift is your Swift - SD.pptxHow swift is your Swift - SD.pptx
How swift is your Swift - SD.pptx
 
Building an open source cloud storage platform for OpenStack - openATTIC
Building an open source cloud storage platform for OpenStack - openATTICBuilding an open source cloud storage platform for OpenStack - openATTIC
Building an open source cloud storage platform for OpenStack - openATTIC
 
Java one 2015 - v1
Java one   2015 - v1Java one   2015 - v1
Java one 2015 - v1
 
Ceph and Apache CloudStack
Ceph and Apache CloudStackCeph and Apache CloudStack
Ceph and Apache CloudStack
 
Storage as a service and OpenStack Cinder
Storage as a service and OpenStack CinderStorage as a service and OpenStack Cinder
Storage as a service and OpenStack Cinder
 
Ceph Day Santa Clara: Ceph and Apache CloudStack
Ceph Day Santa Clara: Ceph and Apache CloudStack Ceph Day Santa Clara: Ceph and Apache CloudStack
Ceph Day Santa Clara: Ceph and Apache CloudStack
 
Open Stack Cheng Du Swift Alex Yang
Open Stack Cheng Du Swift Alex YangOpen Stack Cheng Du Swift Alex Yang
Open Stack Cheng Du Swift Alex Yang
 
OpenEBS; asymmetrical block layer in user-space breaking the million IOPS bar...
OpenEBS; asymmetrical block layer in user-space breaking the million IOPS bar...OpenEBS; asymmetrical block layer in user-space breaking the million IOPS bar...
OpenEBS; asymmetrical block layer in user-space breaking the million IOPS bar...
 
final_rac
final_racfinal_rac
final_rac
 
Building FOSS clouds
Building FOSS cloudsBuilding FOSS clouds
Building FOSS clouds
 
Mastering OpenStack - Episode 11 - Scaling Out
Mastering OpenStack - Episode 11 - Scaling OutMastering OpenStack - Episode 11 - Scaling Out
Mastering OpenStack - Episode 11 - Scaling Out
 
Cisco: Cassandra adoption on Cisco UCS & OpenStack
Cisco: Cassandra adoption on Cisco UCS & OpenStackCisco: Cassandra adoption on Cisco UCS & OpenStack
Cisco: Cassandra adoption on Cisco UCS & OpenStack
 
Sanger OpenStack presentation March 2017
Sanger OpenStack presentation March 2017Sanger OpenStack presentation March 2017
Sanger OpenStack presentation March 2017
 
Open stackapac swift_alexyang
Open stackapac swift_alexyangOpen stackapac swift_alexyang
Open stackapac swift_alexyang
 
Swift Architecture and Practice, by Alex Yang
Swift Architecture and Practice, by Alex YangSwift Architecture and Practice, by Alex Yang
Swift Architecture and Practice, by Alex Yang
 
Running your Java EE applications in the Cloud
Running your Java EE applications in the CloudRunning your Java EE applications in the Cloud
Running your Java EE applications in the Cloud
 
Distributed Block-level Storage Management for OpenStack, by Danile lee
Distributed Block-level Storage Management for OpenStack, by Danile leeDistributed Block-level Storage Management for OpenStack, by Danile lee
Distributed Block-level Storage Management for OpenStack, by Danile lee
 
Danile lee -open stackblocklevelstorage
Danile lee -open stackblocklevelstorageDanile lee -open stackblocklevelstorage
Danile lee -open stackblocklevelstorage
 
Cloud Storage - Technical Whitepaper - SolidFire
Cloud  Storage - Technical Whitepaper - SolidFireCloud  Storage - Technical Whitepaper - SolidFire
Cloud Storage - Technical Whitepaper - SolidFire
 

Plus de Antonio Severien

Scalable Distributed Real-Time Clustering for Big Data Streams
Scalable Distributed Real-Time Clustering for Big Data StreamsScalable Distributed Real-Time Clustering for Big Data Streams
Scalable Distributed Real-Time Clustering for Big Data StreamsAntonio Severien
 
Scalable Distributed Real-Time Clustering for Big Data Streams
Scalable Distributed Real-Time Clustering for Big Data StreamsScalable Distributed Real-Time Clustering for Big Data Streams
Scalable Distributed Real-Time Clustering for Big Data StreamsAntonio Severien
 
On Pragmatism and Scientific Freedom
On Pragmatism and Scientific FreedomOn Pragmatism and Scientific Freedom
On Pragmatism and Scientific FreedomAntonio Severien
 

Plus de Antonio Severien (6)

Scalable Distributed Real-Time Clustering for Big Data Streams
Scalable Distributed Real-Time Clustering for Big Data StreamsScalable Distributed Real-Time Clustering for Big Data Streams
Scalable Distributed Real-Time Clustering for Big Data Streams
 
Scalable Distributed Real-Time Clustering for Big Data Streams
Scalable Distributed Real-Time Clustering for Big Data StreamsScalable Distributed Real-Time Clustering for Big Data Streams
Scalable Distributed Real-Time Clustering for Big Data Streams
 
NoSQL: Cassadra vs. HBase
NoSQL: Cassadra vs. HBaseNoSQL: Cassadra vs. HBase
NoSQL: Cassadra vs. HBase
 
On Pragmatism and Scientific Freedom
On Pragmatism and Scientific FreedomOn Pragmatism and Scientific Freedom
On Pragmatism and Scientific Freedom
 
Relational Cloud
Relational CloudRelational Cloud
Relational Cloud
 
Soap vs rest
Soap vs restSoap vs rest
Soap vs rest
 

Dernier

A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 

Dernier (20)

A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 

Community cloud antonioseverien

  • 1. Community  Network     Cloud  Middleware   “A  Storage  Approach”   Students   Supervisor   Antonio  Severien   Leandro  Navarro   severien@kth.se   leandro@ac.upc.edu       Ioanna  Tsalochidou     ioannat@kth.se    
  • 2. Outline   •  IntroducCon   •  Cloud  Middleware   •  ObjecCves   •  OpenStack   •  Experimental  Setup   •  Results   •  Future  Work   •  Findings   •  Summary   06/12/12   2  
  • 3. IntroducCon   •  Community  Networks  Testbed  for  the  Future  Internet   –  Commodity  wireless  and  opCcal  links;  heterogeneous  nodes;  different   rouCng  protocols;  different  applicaCons   •  Cloud  middleware  running  on  “wild-­‐area”  resources   –   OpenStack,  OpenNebula   –   Evaluate  scalability  and  “suitability”  to  provide  either;  compu.ng  or   storage  services   06/12/12   3  
  • 4. Cloud  Middleware   •  Cloud  OperaCng  System   –  Controls  large  pools  of  compute,  networking  and  storage   resources  throughout  a  datacenter   Your  ApplicaCons   Cloud  OperaCng     System   Cl   Management   GUI   Compute   Storage   Networking   Standard  Hardware   06/12/12   4  
  • 5. ObjecCves   •  Observe  how  the  different  cloud  middlewares  behave     –  On  unstable  network  environment     –  On  scarce  hardware  resources     •  Create  a  methodology  to  be  used  on  CONFINE     •  Preliminary  benchmarking     •  TesCng   –  Inject  delays  on  network  (Netem)   –  Measure  performance  (FileBench)   06/12/12   5  
  • 6. OpenStack  Conceptual  Architecture   06/12/12   6   Figure  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐conceptual-­‐arch-­‐folsom.jpg    
  • 7. OpenStack  Logical  Architecture   06/12/12   7   Figure  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐logical-­‐arch-­‐folsom.jpg    
  • 8. OpenStack  Logical  Architecture   06/12/12   8   Figure  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐logical-­‐arch-­‐folsom.jpg    
  • 9. OpenStack  Storage   Storage  Services   –  Block  Storage  (Cinder)  à  nova-­‐volume  (iSCSI/LVM)   •  Uses  LVM  to  create  and  manage  volumes,  and  exports   them  via  iSCSI     –  Object  Storage  (Swif)   •  Low  level  of  abstracCon   •  Good  for  staCc  content  (e.g.,  CDN)   •  HTTP  interface  with  REST  API   –  File  Storage       •  “none  na.ve  support”  (There  is  a  connector  for   GlusterFS)     06/12/12   9  
  • 10. Cinder  (Nova-­‐volume)   Instance   Instance   A  volume  can  be     a`ached/detached     from  running  instances   Volume   Block  Storage  Store   06/12/12   10  
  • 11. Cinder  (Block  Storage)   Instance   Compute   Block  Storage   Block  Storage   Block  Storage   Volume  Store   06/12/12   11  
  • 12. Cinder  (Block  Storage)   Instance   Compute   Block  Storage   Block  Storage   Block  Storage   Volume  Store   06/12/12   12  
  • 13. Running  Compute  Node   Figures  taken  from   h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/ content/images-­‐and-­‐instances.html     06/12/12   13  
  • 14. Experimental  Setup   Cinder  Volume  Store   Nova  Compute  &  Controller   •  FileBench  Workload  Generator   –  File  system  and  storage  benchmark   –  Variety  of  workloads  and  pre-­‐defined  workloads  for   webserver,  file  server,  etc.   –  Reports  throughput  and  latency   –  Uses  Workload  Model  Language  (WML)   06/12/12   14  
  • 15. Experimental  Setup   Steps  for  experiments:   1.  Off-­‐line  creaCon  of  volumes   2.  At-­‐runCme  a`achment  of  volumes  to  instances  hosted  within     the  same  availability  zones   3.  Formakng  mounted  volumes  with  ext3  file  system   4.  MounCng  the  forma`ed  volume  as  a  file  system  within  a  Linux     instance   5.  Subsequent  benchmarking…   06/12/12   15  
  • 16. Experiment  Results   Read  Experiments    File  Size:  3GB    IO  Size:  1MB      Threads:  1    Caching:  disabled       06/12/12   16  
  • 17. Experiment  Results   Write  Experiments    File  Size:  3GB    IO  Size:  1MB      Threads:  1    Caching:  disabled   06/12/12   17  
  • 18. Future  Work   •  Use  OpenNebula  and  perform  the  same  experiments   •  Expand  this  work  to  run  on  a  larger  scale   •  Use  CONFINE  testbed  for  experiments   06/12/12   18  
  • 19. Future  Work  (Real  Deal)   06/12/12   19  
  • 20. Summary   •  Cloud  Middleware:  nothing  but  a  resource  manager   •  Deployed  OpenStack  in  a  micro  test-­‐environment   •  Benchmarking:  diverse  workloads   •  Community  Cloud…  it  is  possible,  but  with   restricCons  bounded  by  available  resources   06/12/12   20  
  • 21. Findings   •  OpenStack   –  Is  evolving   –  Needs  to  be  more  user-­‐friendly   –  Dynamic  configuraCon     •  Community  Cloud   –  Provide  services  that  require  less  resources   –  “Guarantee”  stability  and  availability  of  resources   06/12/12   21  
  • 22. Acknowledgments   •  Thanks  to  Leandro  Navarro   •  Thanks  to  Ying  for  clearing  the  clouds  from  the  cloud   •  Thanks  to  Manos  and  Mudit  for  networking   assistance   •  Thanks  to  Ioanna  for  accepCng  the  challenge     •  Thanks  to  the  OpenStack  community   •  Thanks  to  the  Linux  community   06/12/12   22  
  • 23. References   •  OpenStack:  h`p://www.openstack.org   •  Ubuntu  Cloud:  h`p://www.ubuntu.com/cloud     •  OpenNebula:  h`p://opennebula.org/   •  DevStack:  h`p://devstack.org/   •  CONFINE:  h`p://confine-­‐project.eu/   •  FileBench:  h`p://sourceforge.net/apps/mediawiki/filebench/     •  Netem:   h`p://www.linuxfoundaCon.org/collaborate/workgroups/ networking/netem     06/12/12   23