SlideShare une entreprise Scribd logo
1  sur  60
Télécharger pour lire hors ligne
OpenStack and CERN


                  Tim Bell
              Tim.Bell@cern.ch
                @noggin143

First OpenStack Switzerland User Group Meeting
              15th November 2012
What is OpenStack ?
• OpenStack is a cloud operating system that controls large
  pools of compute, storage, and networking resources
  throughout a datacenter, all managed through a dashboard
  that gives administrators control while empowering their users
  to provision resources through a web interface




OpenStack Swiss User Group   Tim Bell, CERN                    2
Principles
• Open Source
      – Apache 2.0 license, NO ‘enterprise’ version
• Open Design
      – Open Design Summit, anyone is able to define core architecture
• Open Development
      – Anyone can involve development process via Launchpad & Github
• Open Community
      – OpenStack Foundation in 2012, Now 190+ companies, 3000+
        developers, 6000+ members




OpenStack Swiss User Group         Tim Bell, CERN                        3
OpenStack Swiss User Group   Tim Bell, CERN   4
OpenStack Cloud Components
•   Nova – Compute Layer
•   Swift – Object Store
•   Quantum – Networking
•   Horizon – Dashboard
•   Cinder – Block Storage
•   Keystone – Identity
•   Glance – Image management

• Each component has an API and is pluggable
• Other non-core projects interact with these components
OpenStack Swiss User Group   Tim Bell, CERN                5
OpenStack Folsom




OpenStack Swiss User Group        Tim Bell, CERN   6
October Summit in San Diego
• 1,400 people attended with 320 talks and up to 8 parallel
  streams
      – Double the spring 2012 summit in San Francisco
• International involvement is increasing
      – Asia especially China
      – Europe
• Companies and Open Source community generally working
  well
      – Transparency and shared goals




OpenStack Swiss User Group        Tim Bell, CERN              7
Talent Competition




OpenStack Swiss User Group         Tim Bell, CERN   8
What’s new from the summit ?
Component                     Folsom                              Grizzly (plan for Q2/2014)
Nova (Compute)                Host Aggregates                     Cells
                              Hyper-V/PowerVM support             Bare metal support
Cinder (Block Storage)        Now in core                         Multiple backends
                              NFS as a block device               QoS for backends
                                                                  Resize
Glance                        Replicated images                   Incremental images
                              New client
Keystone                      PKI support                         Domains
                              LDAP support for Active Directory   User Groups
Horizon                       Support for volumes                 Realtime notifications
                                                                  Cross project signalling
Swift                         Versioned objects                   Multi-range get
                              SSD acceleration
Quantum                       Now in core                         Security groups
                              Pluggable backends                  High Availability

 OpenStack Swiss User Group                  Tim Bell, CERN                                  9
Upcoming Projects
• Ceilometer
      – Metering and billing
• Heat
      – Cloud orchestration
• Red Dwarf
      – Database as a Service – being refactored to be on top of Nova
• Equilibrium
      – Load Balancing as a Service – 3 proposals being merged to 1
• DNS as a Service
      – May become part of Quantum
• High Availability Nova Controller
      – Cisco, Hastexo proposals
OpenStack Swiss User Group         Tim Bell, CERN                       10
OpenStack Foundation
• The OpenStack Foundation is an independent body providing
  shared resources to help achieve the OpenStack Mission by
  Protecting, Empowering, and Promoting OpenStack software
  and the community around it, including users, developers and
  the entire ecosystem.
• Provides
      –   Promotion of the OpenStack brand
      –   Event management such as Summits, User Groups, …
      –   Legal coverage of trademark, contributions
      –   Continuous integration and Testing infrastructure
      –   Developer tools to ease contribution


OpenStack Swiss User Group         Tim Bell, CERN             11
OpenStack Board Structure
• ”Platinum Members” are companies which make a significant
  strategic commitment to OpenStack in funding and resources.
  Platinum Members each appoint a representative to the Board
  of Directors
• ”Gold Members” are companies which provide funding and
  resources, but at a lower level than Platinum Members.
  Associate Members as a class elect representatives to the
  Board of Directors.
• "Individual Members" who participate on their own or as part
  of their paid employment. It’s free to join as an Individual
  Member and Individual Members have the right to run for, and
  vote for, a number of leadership positions.
OpenStack Swiss User Group   Tim Bell, CERN                 12
OpenStack Swiss User Group   Tim Bell, CERN   13
Individual Members
• Elected by the membership of the foundation
   • Rob Hirschfeld (DELL)
   • Monty Taylor (HP)
   • Hui Cheng (SINA)
   • Yujie Du (99 Cloud)
   • Troy Toman (Rackspace)
   • Tim Bell (CERN)
   • Tristan Goode (Aptira)
   • Jesse Andreas (Nebula)
• No company can have more than 2 directors
• Rules for individual member voting are currently under
  discussion with the community to find best ways of representing
  all the members
 OpenStack Swiss User Group         Tim Bell, CERN              14
Foundation Governance




OpenStack Swiss User Group           Tim Bell, CERN   15
What is CERN ?
• Conseil Européen pour la
  Recherche Nucléaire – aka
  European Laboratory for
  Particle Physics
• Between Geneva and the
  Jura mountains, straddling
  the Swiss-French border
• Founded in 1954 with an
  international treaty
• Our business is fundamental
  physics , what is the
  universe made of and how
  does it work
  OpenStack Swiss User Group       Tim Bell, CERN   16
Answering fundamental questions…
• How to explain particles have mass?
   We have theories and accumulating experimental evidence.. Getting close…

• What is 96% of the universe made of ?
   We can only see 4% of its estimated mass!

• Why isn’t there anti-matter
  in the universe?
   Nature should be symmetric…

• What was the state of matter just
  after the « Big Bang » ?
   Travelling back to the earliest instants of
   the universe would help…

OpenStack Swiss User Group             Tim Bell, CERN                         17
The Large Hadron Collider




OpenStack Swiss User Group   Tim Bell, CERN   18
The Large Hadron Collider (LHC) tunnel




OpenStack Swiss User Group   Tim Bell, CERN
                                              19
OpenStack Swiss User Group   Tim Bell, CERN   20
Accumulating events in 2009-2011




OpenStack Swiss User Group    Tim Bell, CERN        21
OpenStack Swiss User Group   Tim Bell, CERN   22
Heavy Ion Collisions




OpenStack Swiss User Group          Tim Bell, CERN   23
OpenStack Swiss User Group   Tim Bell, CERN   24
Tier-0 (CERN):
                                                               •Data recording
                                                               •Initial data reconstruction
                                                               •Data distribution



                                                              Tier-1 (11 centres):
                                                              •Permanent storage
                                                              •Re-processing
                                                              •Analysis


                                                              Tier-2 (~200 centres):
                                                              • Simulation
                                                              • End-user analysis


• Data is recorded at CERN and Tier-1s and analysed in the Worldwide LHC Computing Grid
• In a normal day, the grid provides 100,000 CPU days executing over 2 million jobs
   OpenStack Swiss User Group          Tim Bell, CERN                                25
OpenStack Swiss User Group   Tim Bell, CERN   26
45,000 tapes holding 73PB of physics data




OpenStack Swiss User Group           Tim Bell, CERN              27
New data centre to expand capacity
                                              • Data centre in Geneva
                                                at the limit of
                                                electrical capacity at
                                                3.5MW
                                              • New centre chosen in
                                                Budapest, Hungary
                                              • Additional 2.7MW of
                                                usable power
                                              • Hands off facility
                                              • Deploying from 2013
                                                with 200Gbit/s
OpenStack Swiss User Group   Tim Bell, CERN
                                                network to CERN        28
Time to change strategy
• Rationale
      – Need to manage twice the servers as today
      – No increase in staff numbers
      – Tools becoming increasingly brittle and will not scale as-is
• Approach
      – CERN is no longer a special case for compute
      – Adopt an open source tool chain model
      – Our engineers rapidly iterate
             • Evaluate solutions in the problem domain
             • Identify functional gaps and challenge them
             • Select first choice but be prepared to change in future
      – Contribute new function back to the community

OpenStack Swiss User Group               Tim Bell, CERN                  29
Building Blocks
                                 mcollective, yum              Bamboo

      Puppet
                                              AIMS/PXE
                                               Foreman                  JIRA

   OpenStack
     Nova


                                                                               git



                                                                        Koji, Mock
                                               Yum repo
 Active Directory /                              Pulp
       LDAP




                                                          Lemon /
        Hardware
                                                          Hadoop
        database
                               Puppet-DB
OpenStack Swiss User Group         Tim Bell, CERN                                30
Prepare the move to the clouds
• Improve operational efficiency
      – Machine ordering, reception and testing
      – Hardware interventions with long running programs
      – Multiple operating system demand
• Improve resource efficiency
      – Exploit idle resources, especially waiting for disk and tape I/O
      – Highly variable load such as interactive or build machines
• Enable cloud architectures
      – Gradual migration to cloud interfaces and workflows
• Improve responsiveness
      – Self-Service with coffee break response time


OpenStack Swiss User Group           Tim Bell, CERN                        31
Service Model
                                 • Pets are given names like
                                   pussinboots.cern.ch
                                 • They are unique, lovingly hand raised
                                   and cared for
                                 • When they get ill, you nurse them back
                                   to health

                                 • Cattle are given numbers like
                                   vm0042.cern.ch
                                 • They are almost identical to other cattle
                                 • When they get ill, you get another one



          • Future application architectures should use Cattle but Pets with
            strong configuration management are viable and still needed
OpenStack Swiss User Group            Tim Bell, CERN                           32
Current Status of OpenStack at CERN
• Focus on the Cattle to start with
• Working on an Essex code base from the EPEL repository
      – Excellent experience with the Fedora cloud-sig team
      – Cloud-init for contextualisation, oz for images with RHEL/Fedora
• Components
      – Current focus is on Nova with KVM and Hyper-V
      – Keystone running with Active Directory and Glance for Linux and
        Windows images
• Pre-production facility with around 200 Hypervisors, with
  2000 VMs integrated with CERN infrastructure, Puppet
  deployed and used for simulation of magnet placement using
  LHC@Home and batch physics programs
OpenStack Swiss User Group         Tim Bell, CERN                          33
OpenStack Swiss User Group   Tim Bell, CERN   34
Next Steps
• Deploy into production at the start of 2013 with Folsom running the Grid
  software on top of OpenStack IaaS
• Support multi-site operations with 2nd data centre in Hungary
• Exploit new functionality
    – Ceilometer for metering
    – Bare metal for non-virtualised use cases such as high I/O servers
    – X.509 user certificate authentication
    – Load balancing as a service
• Support the pets with live migration and external block storage such as
  Gluster


Ramping to 15K hypervisors with 100K to
300K VMs by 2015
OpenStack Swiss User Group        Tim Bell, CERN                             35
Conclusions
• Production at CERN in next few months on Folsom
      – Our emphasis will shift to focus on stability
      – Work together with others on scaling improvements
• Community is key to shared success
      – Foundation gives a structure for collaboration
      – Our problems are often resolved before we raise them
      – Packaging teams are producing reliable builds promptly
• CERN contributes and benefits
      – Thanks to everyone for their efforts and enthusiasm
      – Not just code but documentation, tests, blogs, …
OpenStack Swiss User Group      Tim Bell, CERN                   36
OpenStack Swiss User Group   Tim Bell, CERN   37
References
CERN                                            http://public.web.cern.ch/public/
Scientific Linux                                http://www.scientificlinux.org/
Worldwide LHC Computing Grid                    http://lcg.web.cern.ch/lcg/
                                                http://rtm.hep.ph.ic.ac.uk/
Jobs                                            http://cern.ch/jobs
Detailed Report on Agile Infrastructure         http://cern.ch/go/N8wp
Talk on OpenStack at San Diego Summit           http://www.openstack.org/summit/san-
                                                diego-2012/openstack-summit-
                                                sessions/presentation/accelerating-
                                                science-with-openstack




 OpenStack Swiss User Group               Tim Bell, CERN                               38
Backup Slides




OpenStack Swiss User Group   Tim Bell, CERN   39
Community collaboration on an international scale




OpenStack Swiss User Group   Tim Bell, CERN            40
Our Challenges - Data storage




                              •   >20 years retention
                              •   6GB/s average
                              •   25GB/s peaks
                              •   30PB/year to record

OpenStack Swiss User Group           Tim Bell, CERN     41
•     Data Centre by Numbers
        – Hardware installation & retirement
                  •    ~7,000 hardware movements/year; ~1,800 disk failures/year


          Racks                              828    Disks                                  64,109         Tape Drives                 160
          Servers                         11,728    Raw disk capacity (TiB)                63,289         Tape Cartridges           45,000
          Processors                      15,694    Memory modules                         56,014         Tape slots                56,000
          Cores                           64,238    Memory capacity (TiB)                       158       Tape Capacity (TiB)       73,000
          HEPSpec06                      482,507    RAID controllers                           3,749
                                                                                                          High Speed Routers
                                                                                                                                       24
                       Xeon    Xeon Xeon                        Other Fujitsu                             (640 Mbps → 2.4 Tbps)
                       3GHz    5150 5160 Xeon                    0%    3%
       Xeon             4%      2% 10% E5335
                                                                                                          Ethernet Switches           350
       L5520                              7% Xeon                               Hitachi
        33%                                                                      23%                      10 Gbps ports              2,000
                                            E5345
                                             14%                                                 HP       Switching Capacity      4.8 Tbps
                                                                                     Seagate
                                                                                                 0%
                                                                                      15%
                                                                                                          1 Gbps ports              16,939
                                                                                                Maxtor
                                                    Western                                      0%       10 Gbps ports               558
                                           Xeon
               Xeon                                 Digital
                                           E5405
                               Xeon                  59%
               L5420                        6%                                                         IT Power Consumption       2,456 KW
                8%             E5410
                                16%
                                                                                                       Total Power Consumption    3,890 KW




    OpenStack Swiss User Group                                Tim Bell, CERN                                                                 42
Public Procurement Purchase Model
Step                                     Time (Days)         Elapsed (Days)
User expresses requirement                                                     0
Market Survey prepared                                 15                     15
Market Survey for possible vendors                     30                     45
Specifications prepared                                15                     60
Vendor responses                                       30                     90
Test systems evaluated                                 30                     120
Offers adjudicated                                     10                     130
Finance committee                                      30                     160
Hardware delivered                                     90                     250
Burn in and acceptance                     30 days typical                    280
                                           380 worst case
Total                                                            280+ Days
OpenStack Swiss User Group           Tim Bell, CERN                                 43
Training and Support
•   Buy the book rather than guru mentoring
•   Follow the mailing lists to learn
•   Newcomers are rapidly productive (and often know more than us)
•   Community and Enterprise support means we’re not on our own




OpenStack Swiss User Group        Tim Bell, CERN                     44
Staff Motivation
• Skills valuable outside of CERN when an engineer’s contracts
  end




OpenStack Swiss User Group   Tim Bell, CERN                      45
When communities combine…
• OpenStack’s many components and options make
  configuration complex out of the box
• Puppet forge module from PuppetLabs does our configuration
• The Foreman adds OpenStack provisioning for user kiosk to a
  configured machine in 15 minutes




OpenStack Swiss User Group   Tim Bell, CERN                 46
Foreman to manage Puppetized VM




OpenStack Swiss User Group   Tim Bell, CERN      47
Supporting the Pets with OpenStack
• Network
      – Interfacing with legacy site DNS and IP management
      – Ensuring Kerberos identity before VM start
• Puppet
      – Ease use of configuration management tools with our users
      – Exploit mcollective for orchestration/delegation
• External Block Storage
      – Currently using nova-volume with Gluster backing store
• Live migration to maximise availability
      – KVM live migration using Gluster
      – KVM and Hyper-V block migration

OpenStack Swiss User Group         Tim Bell, CERN                   48
Active Directory Integration
• CERN’s Active Directory
     –   Unified identity management across the site
     –   44,000 users
     –   29,000 groups
     –   200 arrivals/departures per month
• Full integration with Active Directory via LDAP
     – Uses the OpenLDAP backend with some particular configuration
       settings
     – Aim for minimal changes to Active Directory
     – 7 patches submitted around hard coded values and additional filtering
• Now in use in our pre-production instance
     – Map project roles (admins, members) to groups
     – Documentation in the OpenStack wiki
OpenStack Swiss User Group          Tim Bell, CERN                         49
Welcome Back Hyper-V!
• We currently use Hyper-V/System Centre for our server
  consolidation activities
      – But need to scale to 100x current installation size
• Choice of hypervisors should be tactical
      – Performance
      – Compatibility/Support with integration components
      – Image migration from legacy environments
• CERN is working closely with the Hyper-V OpenStack team
      – Puppet to configure hypervisors on Windows
      – Most functions work well but further work on Console, Ceilometer, …


OpenStack Swiss User Group          Tim Bell, CERN                            50
What are we missing (or haven’t found yet) ?
• Best practice for
      – Monitoring and KPIs as part of core functionality
      – Guest disaster recovery
      – Migration between versions of OpenStack
• Roles within multi-user projects
      – VM owner allowed to manage their own resources (start/stop/delete)
      – Project admins allowed to manage all resources
      – Other members should not have high rights over other members VMs
• Global quota management for non-elastic private cloud
      – Manage resource prioritisation and allocation centrally
      – Capacity management / utilisation for planning

OpenStack Swiss User Group          Tim Bell, CERN                       51
Opportunistic Clouds in online experiment farms
• The CERN experiments have farms of 1000s of Linux servers
  close to the detectors to filter the 1PByte/s down to 6GByte/s
  to be recorded to tape
• When the accelerator is not running, these machines are
  currently idle
      – Accelerator has regular maintenance slots of several days
      – Long Shutdown due from March 2013-November 2014
• One of the experiments are deploying OpenStack on their farm
      – Simulation (low I/O, high CPU)
      – Analysis (high I/O, high CPU, high network)


OpenStack Swiss User Group         Tim Bell, CERN                   52
Federated European Clouds
• Two significant European projects around Federated Clouds
      – European Grid Initiative Federated Cloud as a federation of grid sites providing
        IaaS
      – HELiX Nebula European Union funded project to create a scientific cloud
        based on commercial providers
                                                                   EGI Federated Cloud Sites
                                                        CESGA        CESNET       INFN         SARA


                                                        Cyfronet     FZ Jülich    SZTAKI       IPHC


                                                        GRIF         GRNET        KTH          Oxford


                                                        GWDG         IGI          TCD          IN2P3


                                                        STFC


OpenStack Swiss User Group             Tim Bell, CERN                                                   53
Federated Cloud Commonalities
• Basic building blocks
      – Each site gives an IaaS endpoint with an API and common security
        policy
             • OCCI? CDMI ? Libcloud ? Jclouds ?
      – Image stores available across the sites
      – Federated identity management based on X.509 certificates
      – Consolidation of accounting information to validate pledges and usage
• Multiple cloud technologies
      – OpenStack
      – OpenNebula
      – Proprietary

OpenStack Swiss User Group              Tim Bell, CERN                      54
OpenStack Swiss User Group   Tim Bell, CERN   55
CERN’s tools
• The world’s most powerful accelerator: LHC
      –   A 27 km long tunnel filled with high-tech instruments
      –   Equipped with thousands of superconducting magnets
      –   Accelerates particles to energies never before obtained
      –   Produces particle collisions creating microscopic “big bangs”
• Very large sophisticated detectors
      – Four experiments each the size of a cathedral
      – Hundred million measurement channels each
      – Data acquisition systems treating Petabytes per second
• Top level computing to distribute and analyse the data
      – A Computing Grid linking ~200 computer centres around the globe
      – Sufficient computing power and storage to handle 25 Petabytes per
        year, making them available to thousands of physicists for analysis
OpenStack Swiss User Group           Tim Bell, CERN                           56
Our Infrastructure
• Hardware is generally based on commodity, white-box servers
      – Open tendering process based on SpecInt/CHF, CHF/Watt and GB/CHF
      – Compute nodes typically dual processor, 2GB per core
      – Bulk storage on 24x2TB disk storage-in-a-box with a RAID card
• Vast majority of servers run Scientific Linux, developed by
  Fermilab and CERN, based on Redhat Enterprise
      – Focus is on stability in view of the number of centres on the WLCG




OpenStack Swiss User Group         Tim Bell, CERN                            57
New architecture data flows




OpenStack Swiss User Group   Tim Bell, CERN   58
500
                                                1500
                                                                 2000
                                                                        2500
                                                                               3000
                                                                                      3500




                                       1000




                             0
 Mar-10

      Apr-10

May-10

        Jun-10

              Jul-10

   Aug-10

     Sep-10




OpenStack Swiss User Group
       Oct-10

  Nov-10

    Dec-10

         Jan-11

     Feb-11

 Mar-11

      Apr-11

May-11

        Jun-11

              Jul-11




Tim Bell, CERN
   Aug-11

     Sep-11

       Oct-11

  Nov-11

    Dec-11

         Jan-12

     Feb-12

 Mar-12

      Apr-12

May-12
                                                                                             Virtualisation on SCVMM/Hyper-V




        Jun-12

              Jul-12

   Aug-12

     Sep-12
59
                                              Linux




       Oct-12
                                                       Windows
Scaling up with Puppet and OpenStack
• Use LHC@Home based on BOINC for simulating magnetics
  guiding particles around the LHC
• Naturally, there is a puppet module puppet-boinc
• 1000 VMs spun up to stress test the hypervisors with Puppet,
  Foreman and OpenStack




OpenStack Swiss User Group   Tim Bell, CERN                      60

Contenu connexe

Tendances

Openstack Installation (ver. liberty)
Openstack Installation (ver. liberty)Openstack Installation (ver. liberty)
Openstack Installation (ver. liberty)Eggy Cheng
 
Scheduled Scientific Data Releases Using .backup Volumes
Scheduled Scientific Data Releases Using .backup VolumesScheduled Scientific Data Releases Using .backup Volumes
Scheduled Scientific Data Releases Using .backup Volumesretsamedoc
 
OpenStack - An Overview
OpenStack - An OverviewOpenStack - An Overview
OpenStack - An Overviewgraziol
 
Mastering OpenStack - Episode 07 - Compute Nodes
Mastering OpenStack - Episode 07 - Compute NodesMastering OpenStack - Episode 07 - Compute Nodes
Mastering OpenStack - Episode 07 - Compute NodesRoozbeh Shafiee
 
Build Your Own Open Source Cloud
Build Your Own Open Source CloudBuild Your Own Open Source Cloud
Build Your Own Open Source CloudAdrian Otto
 
Learning to Scale OpenStack
Learning to Scale OpenStackLearning to Scale OpenStack
Learning to Scale OpenStackRainya Mosher
 
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...Ceph Community
 
Openstack Global Meetup
Openstack Global Meetup Openstack Global Meetup
Openstack Global Meetup openstackindia
 
Cloud Storage - Technical Whitepaper - SolidFire
Cloud  Storage - Technical Whitepaper - SolidFireCloud  Storage - Technical Whitepaper - SolidFire
Cloud Storage - Technical Whitepaper - SolidFireThe World Bank
 
20120524 cern data centre evolution v2
20120524 cern data centre evolution v220120524 cern data centre evolution v2
20120524 cern data centre evolution v2Tim Bell
 
Accelerating Science with OpenStack.pptx
Accelerating Science with OpenStack.pptxAccelerating Science with OpenStack.pptx
Accelerating Science with OpenStack.pptxOpenStack Foundation
 
20121017 OpenStack CERN Accelerating Science
20121017 OpenStack CERN Accelerating Science20121017 OpenStack CERN Accelerating Science
20121017 OpenStack CERN Accelerating ScienceTim Bell
 
Mastering OpenStack - Episode 08 - Storage Decisions
Mastering OpenStack - Episode 08 - Storage DecisionsMastering OpenStack - Episode 08 - Storage Decisions
Mastering OpenStack - Episode 08 - Storage DecisionsRoozbeh Shafiee
 
Build Your Private Cloud with Ezilla and Haduzilla
Build Your Private Cloud with Ezilla and HaduzillaBuild Your Private Cloud with Ezilla and Haduzilla
Build Your Private Cloud with Ezilla and HaduzillaJazz Yao-Tsung Wang
 
20121205 open stack_accelerating_science_v3
20121205 open stack_accelerating_science_v320121205 open stack_accelerating_science_v3
20121205 open stack_accelerating_science_v3Tim Bell
 
Introduction To OpenStack
Introduction To OpenStackIntroduction To OpenStack
Introduction To OpenStackHaim Ateya
 
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...Masaaki Nakagawa
 
Mastering OpenStack - Episode 10 - Storage Decisions
Mastering OpenStack - Episode 10 - Storage DecisionsMastering OpenStack - Episode 10 - Storage Decisions
Mastering OpenStack - Episode 10 - Storage DecisionsRoozbeh Shafiee
 
Open stack Architecture and Use Cases
Open stack Architecture and Use CasesOpen stack Architecture and Use Cases
Open stack Architecture and Use CasesAhmad Tfaily
 

Tendances (20)

Openstack Installation (ver. liberty)
Openstack Installation (ver. liberty)Openstack Installation (ver. liberty)
Openstack Installation (ver. liberty)
 
Scheduled Scientific Data Releases Using .backup Volumes
Scheduled Scientific Data Releases Using .backup VolumesScheduled Scientific Data Releases Using .backup Volumes
Scheduled Scientific Data Releases Using .backup Volumes
 
OpenStack - An Overview
OpenStack - An OverviewOpenStack - An Overview
OpenStack - An Overview
 
Mastering OpenStack - Episode 07 - Compute Nodes
Mastering OpenStack - Episode 07 - Compute NodesMastering OpenStack - Episode 07 - Compute Nodes
Mastering OpenStack - Episode 07 - Compute Nodes
 
Build Your Own Open Source Cloud
Build Your Own Open Source CloudBuild Your Own Open Source Cloud
Build Your Own Open Source Cloud
 
Learning to Scale OpenStack
Learning to Scale OpenStackLearning to Scale OpenStack
Learning to Scale OpenStack
 
DneprPy #0: Openstack
DneprPy #0: OpenstackDneprPy #0: Openstack
DneprPy #0: Openstack
 
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
 
Openstack Global Meetup
Openstack Global Meetup Openstack Global Meetup
Openstack Global Meetup
 
Cloud Storage - Technical Whitepaper - SolidFire
Cloud  Storage - Technical Whitepaper - SolidFireCloud  Storage - Technical Whitepaper - SolidFire
Cloud Storage - Technical Whitepaper - SolidFire
 
20120524 cern data centre evolution v2
20120524 cern data centre evolution v220120524 cern data centre evolution v2
20120524 cern data centre evolution v2
 
Accelerating Science with OpenStack.pptx
Accelerating Science with OpenStack.pptxAccelerating Science with OpenStack.pptx
Accelerating Science with OpenStack.pptx
 
20121017 OpenStack CERN Accelerating Science
20121017 OpenStack CERN Accelerating Science20121017 OpenStack CERN Accelerating Science
20121017 OpenStack CERN Accelerating Science
 
Mastering OpenStack - Episode 08 - Storage Decisions
Mastering OpenStack - Episode 08 - Storage DecisionsMastering OpenStack - Episode 08 - Storage Decisions
Mastering OpenStack - Episode 08 - Storage Decisions
 
Build Your Private Cloud with Ezilla and Haduzilla
Build Your Private Cloud with Ezilla and HaduzillaBuild Your Private Cloud with Ezilla and Haduzilla
Build Your Private Cloud with Ezilla and Haduzilla
 
20121205 open stack_accelerating_science_v3
20121205 open stack_accelerating_science_v320121205 open stack_accelerating_science_v3
20121205 open stack_accelerating_science_v3
 
Introduction To OpenStack
Introduction To OpenStackIntroduction To OpenStack
Introduction To OpenStack
 
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
OpenStack Summit Tokyo - Know-how of Challlenging Deploy/Operation NTT DOCOMO...
 
Mastering OpenStack - Episode 10 - Storage Decisions
Mastering OpenStack - Episode 10 - Storage DecisionsMastering OpenStack - Episode 10 - Storage Decisions
Mastering OpenStack - Episode 10 - Storage Decisions
 
Open stack Architecture and Use Cases
Open stack Architecture and Use CasesOpen stack Architecture and Use Cases
Open stack Architecture and Use Cases
 

Similaire à 20121115 open stack_ch_user_group_v1.2

CERN User Story
CERN User StoryCERN User Story
CERN User StoryTim Bell
 
The OpenStack Cloud at CERN - OpenStack Nordic
The OpenStack Cloud at CERN - OpenStack NordicThe OpenStack Cloud at CERN - OpenStack Nordic
The OpenStack Cloud at CERN - OpenStack NordicTim Bell
 
OpenStack at CERN : A 5 year perspective
OpenStack at CERN : A 5 year perspectiveOpenStack at CERN : A 5 year perspective
OpenStack at CERN : A 5 year perspectiveTim Bell
 
CERN & Huawei collaboration to improve OpenStack for running large scale scie...
CERN & Huawei collaboration to improve OpenStack for running large scale scie...CERN & Huawei collaboration to improve OpenStack for running large scale scie...
CERN & Huawei collaboration to improve OpenStack for running large scale scie...Helix Nebula The Science Cloud
 
CERN Mass and Agility talk at OSCON 2014
CERN Mass and Agility talk at OSCON 2014CERN Mass and Agility talk at OSCON 2014
CERN Mass and Agility talk at OSCON 2014Tim Bell
 
CERN Data Centre Evolution
CERN Data Centre EvolutionCERN Data Centre Evolution
CERN Data Centre EvolutionGavin McCance
 
Webinar - Introduction to Ceph and OpenStack
Webinar - Introduction to Ceph and OpenStackWebinar - Introduction to Ceph and OpenStack
Webinar - Introduction to Ceph and OpenStackCeph Community
 
Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014
Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014
Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014Belmiro Moreira
 
Cern Cloud Architecture - February, 2016
Cern Cloud Architecture - February, 2016Cern Cloud Architecture - February, 2016
Cern Cloud Architecture - February, 2016Belmiro Moreira
 
2011 boston open stack meetup 11 29_r1jmm
2011 boston open stack meetup 11 29_r1jmm2011 boston open stack meetup 11 29_r1jmm
2011 boston open stack meetup 11 29_r1jmmDellCloudEdge
 
OpenStack 101 - All Things Open 2015
OpenStack 101 - All Things Open 2015OpenStack 101 - All Things Open 2015
OpenStack 101 - All Things Open 2015Mark Voelker
 
Deep Dive Into the CERN Cloud Infrastructure - November, 2013
Deep Dive Into the CERN Cloud Infrastructure - November, 2013Deep Dive Into the CERN Cloud Infrastructure - November, 2013
Deep Dive Into the CERN Cloud Infrastructure - November, 2013Belmiro Moreira
 
OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack - in...
OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  in...OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  in...
OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack - in...IndicThreads
 
OpenStack Juno The Complete Lowdown and Tales from the Summit
OpenStack Juno The Complete Lowdown and Tales from the SummitOpenStack Juno The Complete Lowdown and Tales from the Summit
OpenStack Juno The Complete Lowdown and Tales from the SummitNati Shalom
 
Openstackoverview-DEC2013
Openstackoverview-DEC2013Openstackoverview-DEC2013
Openstackoverview-DEC2013Michael Lessard
 
The World Wide Distributed Computing Architecture of the LHC Datagrid
The World Wide Distributed Computing Architecture of the LHC DatagridThe World Wide Distributed Computing Architecture of the LHC Datagrid
The World Wide Distributed Computing Architecture of the LHC DatagridSwiss Big Data User Group
 
London Ceph Day: Ceph at CERN
London Ceph Day: Ceph at CERNLondon Ceph Day: Ceph at CERN
London Ceph Day: Ceph at CERNCeph Community
 
Manila on CephFS at CERN (OpenStack Summit Boston, 11 May 2017)
Manila on CephFS at CERN (OpenStack Summit Boston, 11 May 2017)Manila on CephFS at CERN (OpenStack Summit Boston, 11 May 2017)
Manila on CephFS at CERN (OpenStack Summit Boston, 11 May 2017)Arne Wiebalck
 
Dell openstack cloud with inktank ceph – large scale customer deployment
Dell openstack cloud with inktank ceph – large scale customer deploymentDell openstack cloud with inktank ceph – large scale customer deployment
Dell openstack cloud with inktank ceph – large scale customer deploymentKamesh Pemmaraju
 

Similaire à 20121115 open stack_ch_user_group_v1.2 (20)

CERN User Story
CERN User StoryCERN User Story
CERN User Story
 
The OpenStack Cloud at CERN - OpenStack Nordic
The OpenStack Cloud at CERN - OpenStack NordicThe OpenStack Cloud at CERN - OpenStack Nordic
The OpenStack Cloud at CERN - OpenStack Nordic
 
OpenStack at CERN : A 5 year perspective
OpenStack at CERN : A 5 year perspectiveOpenStack at CERN : A 5 year perspective
OpenStack at CERN : A 5 year perspective
 
CERN & Huawei collaboration to improve OpenStack for running large scale scie...
CERN & Huawei collaboration to improve OpenStack for running large scale scie...CERN & Huawei collaboration to improve OpenStack for running large scale scie...
CERN & Huawei collaboration to improve OpenStack for running large scale scie...
 
CERN Mass and Agility talk at OSCON 2014
CERN Mass and Agility talk at OSCON 2014CERN Mass and Agility talk at OSCON 2014
CERN Mass and Agility talk at OSCON 2014
 
CERN Data Centre Evolution
CERN Data Centre EvolutionCERN Data Centre Evolution
CERN Data Centre Evolution
 
Webinar - Introduction to Ceph and OpenStack
Webinar - Introduction to Ceph and OpenStackWebinar - Introduction to Ceph and OpenStack
Webinar - Introduction to Ceph and OpenStack
 
Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014
Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014
Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014
 
Cern Cloud Architecture - February, 2016
Cern Cloud Architecture - February, 2016Cern Cloud Architecture - February, 2016
Cern Cloud Architecture - February, 2016
 
2011 boston open stack meetup 11 29_r1jmm
2011 boston open stack meetup 11 29_r1jmm2011 boston open stack meetup 11 29_r1jmm
2011 boston open stack meetup 11 29_r1jmm
 
OpenStack 101
OpenStack 101OpenStack 101
OpenStack 101
 
OpenStack 101 - All Things Open 2015
OpenStack 101 - All Things Open 2015OpenStack 101 - All Things Open 2015
OpenStack 101 - All Things Open 2015
 
Deep Dive Into the CERN Cloud Infrastructure - November, 2013
Deep Dive Into the CERN Cloud Infrastructure - November, 2013Deep Dive Into the CERN Cloud Infrastructure - November, 2013
Deep Dive Into the CERN Cloud Infrastructure - November, 2013
 
OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack - in...
OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  in...OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack -  in...
OpenStack Ecosystem – Xen Cloud Platform and Integration into OpenStack - in...
 
OpenStack Juno The Complete Lowdown and Tales from the Summit
OpenStack Juno The Complete Lowdown and Tales from the SummitOpenStack Juno The Complete Lowdown and Tales from the Summit
OpenStack Juno The Complete Lowdown and Tales from the Summit
 
Openstackoverview-DEC2013
Openstackoverview-DEC2013Openstackoverview-DEC2013
Openstackoverview-DEC2013
 
The World Wide Distributed Computing Architecture of the LHC Datagrid
The World Wide Distributed Computing Architecture of the LHC DatagridThe World Wide Distributed Computing Architecture of the LHC Datagrid
The World Wide Distributed Computing Architecture of the LHC Datagrid
 
London Ceph Day: Ceph at CERN
London Ceph Day: Ceph at CERNLondon Ceph Day: Ceph at CERN
London Ceph Day: Ceph at CERN
 
Manila on CephFS at CERN (OpenStack Summit Boston, 11 May 2017)
Manila on CephFS at CERN (OpenStack Summit Boston, 11 May 2017)Manila on CephFS at CERN (OpenStack Summit Boston, 11 May 2017)
Manila on CephFS at CERN (OpenStack Summit Boston, 11 May 2017)
 
Dell openstack cloud with inktank ceph – large scale customer deployment
Dell openstack cloud with inktank ceph – large scale customer deploymentDell openstack cloud with inktank ceph – large scale customer deployment
Dell openstack cloud with inktank ceph – large scale customer deployment
 

Plus de Tim Bell

CERN IT Monitoring
CERN IT Monitoring CERN IT Monitoring
CERN IT Monitoring Tim Bell
 
CERN Status at OpenStack Shanghai Summit November 2019
CERN Status at OpenStack Shanghai Summit November 2019CERN Status at OpenStack Shanghai Summit November 2019
CERN Status at OpenStack Shanghai Summit November 2019Tim Bell
 
20190620 accelerating containers v3
20190620 accelerating containers v320190620 accelerating containers v3
20190620 accelerating containers v3Tim Bell
 
20190314 cern register v3
20190314 cern register v320190314 cern register v3
20190314 cern register v3Tim Bell
 
20181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v320181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v3Tim Bell
 
20181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v320181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v3Tim Bell
 
20170926 cern cloud v4
20170926 cern cloud v420170926 cern cloud v4
20170926 cern cloud v4Tim Bell
 
20161025 OpenStack at CERN Barcelona
20161025 OpenStack at CERN Barcelona20161025 OpenStack at CERN Barcelona
20161025 OpenStack at CERN BarcelonaTim Bell
 
20150924 rda federation_v1
20150924 rda federation_v120150924 rda federation_v1
20150924 rda federation_v1Tim Bell
 
OpenStack Paris 2014 - Federation, are we there yet ?
OpenStack Paris 2014 - Federation, are we there yet ?OpenStack Paris 2014 - Federation, are we there yet ?
OpenStack Paris 2014 - Federation, are we there yet ?Tim Bell
 
20140509 cern open_stack_linuxtag_v3
20140509 cern open_stack_linuxtag_v320140509 cern open_stack_linuxtag_v3
20140509 cern open_stack_linuxtag_v3Tim Bell
 
Open stack operations feedback loop v1.4
Open stack operations feedback loop v1.4Open stack operations feedback loop v1.4
Open stack operations feedback loop v1.4Tim Bell
 
CERN clouds and culture at GigaOm London 2013
CERN clouds and culture at GigaOm London 2013CERN clouds and culture at GigaOm London 2013
CERN clouds and culture at GigaOm London 2013Tim Bell
 
20130529 openstack cee_day_v6
20130529 openstack cee_day_v620130529 openstack cee_day_v6
20130529 openstack cee_day_v6Tim Bell
 
Academic cloud experiences cern v4
Academic cloud experiences cern v4Academic cloud experiences cern v4
Academic cloud experiences cern v4Tim Bell
 
Ceilometer lsf-intergration-openstack-summit
Ceilometer lsf-intergration-openstack-summitCeilometer lsf-intergration-openstack-summit
Ceilometer lsf-intergration-openstack-summitTim Bell
 
Havana survey results-final-v2
Havana survey results-final-v2Havana survey results-final-v2
Havana survey results-final-v2Tim Bell
 
Havana survey results-final
Havana survey results-finalHavana survey results-final
Havana survey results-finalTim Bell
 
20121017 OpenStack Accelerating Science
20121017 OpenStack Accelerating Science20121017 OpenStack Accelerating Science
20121017 OpenStack Accelerating ScienceTim Bell
 
Accelerating science with Puppet
Accelerating science with PuppetAccelerating science with Puppet
Accelerating science with PuppetTim Bell
 

Plus de Tim Bell (20)

CERN IT Monitoring
CERN IT Monitoring CERN IT Monitoring
CERN IT Monitoring
 
CERN Status at OpenStack Shanghai Summit November 2019
CERN Status at OpenStack Shanghai Summit November 2019CERN Status at OpenStack Shanghai Summit November 2019
CERN Status at OpenStack Shanghai Summit November 2019
 
20190620 accelerating containers v3
20190620 accelerating containers v320190620 accelerating containers v3
20190620 accelerating containers v3
 
20190314 cern register v3
20190314 cern register v320190314 cern register v3
20190314 cern register v3
 
20181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v320181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v3
 
20181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v320181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v3
 
20170926 cern cloud v4
20170926 cern cloud v420170926 cern cloud v4
20170926 cern cloud v4
 
20161025 OpenStack at CERN Barcelona
20161025 OpenStack at CERN Barcelona20161025 OpenStack at CERN Barcelona
20161025 OpenStack at CERN Barcelona
 
20150924 rda federation_v1
20150924 rda federation_v120150924 rda federation_v1
20150924 rda federation_v1
 
OpenStack Paris 2014 - Federation, are we there yet ?
OpenStack Paris 2014 - Federation, are we there yet ?OpenStack Paris 2014 - Federation, are we there yet ?
OpenStack Paris 2014 - Federation, are we there yet ?
 
20140509 cern open_stack_linuxtag_v3
20140509 cern open_stack_linuxtag_v320140509 cern open_stack_linuxtag_v3
20140509 cern open_stack_linuxtag_v3
 
Open stack operations feedback loop v1.4
Open stack operations feedback loop v1.4Open stack operations feedback loop v1.4
Open stack operations feedback loop v1.4
 
CERN clouds and culture at GigaOm London 2013
CERN clouds and culture at GigaOm London 2013CERN clouds and culture at GigaOm London 2013
CERN clouds and culture at GigaOm London 2013
 
20130529 openstack cee_day_v6
20130529 openstack cee_day_v620130529 openstack cee_day_v6
20130529 openstack cee_day_v6
 
Academic cloud experiences cern v4
Academic cloud experiences cern v4Academic cloud experiences cern v4
Academic cloud experiences cern v4
 
Ceilometer lsf-intergration-openstack-summit
Ceilometer lsf-intergration-openstack-summitCeilometer lsf-intergration-openstack-summit
Ceilometer lsf-intergration-openstack-summit
 
Havana survey results-final-v2
Havana survey results-final-v2Havana survey results-final-v2
Havana survey results-final-v2
 
Havana survey results-final
Havana survey results-finalHavana survey results-final
Havana survey results-final
 
20121017 OpenStack Accelerating Science
20121017 OpenStack Accelerating Science20121017 OpenStack Accelerating Science
20121017 OpenStack Accelerating Science
 
Accelerating science with Puppet
Accelerating science with PuppetAccelerating science with Puppet
Accelerating science with Puppet
 

Dernier

Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdfPaige Cruz
 
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK GuideIEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK GuideHironori Washizaki
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
Governance in SharePoint Premium:What's in the box?
Governance in SharePoint Premium:What's in the box?Governance in SharePoint Premium:What's in the box?
Governance in SharePoint Premium:What's in the box?Juan Carlos Gonzalez
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024Alexander Turgeon
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 

Dernier (20)

Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf
 
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK GuideIEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
Governance in SharePoint Premium:What's in the box?
Governance in SharePoint Premium:What's in the box?Governance in SharePoint Premium:What's in the box?
Governance in SharePoint Premium:What's in the box?
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 

20121115 open stack_ch_user_group_v1.2

  • 1. OpenStack and CERN Tim Bell Tim.Bell@cern.ch @noggin143 First OpenStack Switzerland User Group Meeting 15th November 2012
  • 2. What is OpenStack ? • OpenStack is a cloud operating system that controls large pools of compute, storage, and networking resources throughout a datacenter, all managed through a dashboard that gives administrators control while empowering their users to provision resources through a web interface OpenStack Swiss User Group Tim Bell, CERN 2
  • 3. Principles • Open Source – Apache 2.0 license, NO ‘enterprise’ version • Open Design – Open Design Summit, anyone is able to define core architecture • Open Development – Anyone can involve development process via Launchpad & Github • Open Community – OpenStack Foundation in 2012, Now 190+ companies, 3000+ developers, 6000+ members OpenStack Swiss User Group Tim Bell, CERN 3
  • 4. OpenStack Swiss User Group Tim Bell, CERN 4
  • 5. OpenStack Cloud Components • Nova – Compute Layer • Swift – Object Store • Quantum – Networking • Horizon – Dashboard • Cinder – Block Storage • Keystone – Identity • Glance – Image management • Each component has an API and is pluggable • Other non-core projects interact with these components OpenStack Swiss User Group Tim Bell, CERN 5
  • 6. OpenStack Folsom OpenStack Swiss User Group Tim Bell, CERN 6
  • 7. October Summit in San Diego • 1,400 people attended with 320 talks and up to 8 parallel streams – Double the spring 2012 summit in San Francisco • International involvement is increasing – Asia especially China – Europe • Companies and Open Source community generally working well – Transparency and shared goals OpenStack Swiss User Group Tim Bell, CERN 7
  • 8. Talent Competition OpenStack Swiss User Group Tim Bell, CERN 8
  • 9. What’s new from the summit ? Component Folsom Grizzly (plan for Q2/2014) Nova (Compute) Host Aggregates Cells Hyper-V/PowerVM support Bare metal support Cinder (Block Storage) Now in core Multiple backends NFS as a block device QoS for backends Resize Glance Replicated images Incremental images New client Keystone PKI support Domains LDAP support for Active Directory User Groups Horizon Support for volumes Realtime notifications Cross project signalling Swift Versioned objects Multi-range get SSD acceleration Quantum Now in core Security groups Pluggable backends High Availability OpenStack Swiss User Group Tim Bell, CERN 9
  • 10. Upcoming Projects • Ceilometer – Metering and billing • Heat – Cloud orchestration • Red Dwarf – Database as a Service – being refactored to be on top of Nova • Equilibrium – Load Balancing as a Service – 3 proposals being merged to 1 • DNS as a Service – May become part of Quantum • High Availability Nova Controller – Cisco, Hastexo proposals OpenStack Swiss User Group Tim Bell, CERN 10
  • 11. OpenStack Foundation • The OpenStack Foundation is an independent body providing shared resources to help achieve the OpenStack Mission by Protecting, Empowering, and Promoting OpenStack software and the community around it, including users, developers and the entire ecosystem. • Provides – Promotion of the OpenStack brand – Event management such as Summits, User Groups, … – Legal coverage of trademark, contributions – Continuous integration and Testing infrastructure – Developer tools to ease contribution OpenStack Swiss User Group Tim Bell, CERN 11
  • 12. OpenStack Board Structure • ”Platinum Members” are companies which make a significant strategic commitment to OpenStack in funding and resources. Platinum Members each appoint a representative to the Board of Directors • ”Gold Members” are companies which provide funding and resources, but at a lower level than Platinum Members. Associate Members as a class elect representatives to the Board of Directors. • "Individual Members" who participate on their own or as part of their paid employment. It’s free to join as an Individual Member and Individual Members have the right to run for, and vote for, a number of leadership positions. OpenStack Swiss User Group Tim Bell, CERN 12
  • 13. OpenStack Swiss User Group Tim Bell, CERN 13
  • 14. Individual Members • Elected by the membership of the foundation • Rob Hirschfeld (DELL) • Monty Taylor (HP) • Hui Cheng (SINA) • Yujie Du (99 Cloud) • Troy Toman (Rackspace) • Tim Bell (CERN) • Tristan Goode (Aptira) • Jesse Andreas (Nebula) • No company can have more than 2 directors • Rules for individual member voting are currently under discussion with the community to find best ways of representing all the members OpenStack Swiss User Group Tim Bell, CERN 14
  • 15. Foundation Governance OpenStack Swiss User Group Tim Bell, CERN 15
  • 16. What is CERN ? • Conseil Européen pour la Recherche Nucléaire – aka European Laboratory for Particle Physics • Between Geneva and the Jura mountains, straddling the Swiss-French border • Founded in 1954 with an international treaty • Our business is fundamental physics , what is the universe made of and how does it work OpenStack Swiss User Group Tim Bell, CERN 16
  • 17. Answering fundamental questions… • How to explain particles have mass? We have theories and accumulating experimental evidence.. Getting close… • What is 96% of the universe made of ? We can only see 4% of its estimated mass! • Why isn’t there anti-matter in the universe? Nature should be symmetric… • What was the state of matter just after the « Big Bang » ? Travelling back to the earliest instants of the universe would help… OpenStack Swiss User Group Tim Bell, CERN 17
  • 18. The Large Hadron Collider OpenStack Swiss User Group Tim Bell, CERN 18
  • 19. The Large Hadron Collider (LHC) tunnel OpenStack Swiss User Group Tim Bell, CERN 19
  • 20. OpenStack Swiss User Group Tim Bell, CERN 20
  • 21. Accumulating events in 2009-2011 OpenStack Swiss User Group Tim Bell, CERN 21
  • 22. OpenStack Swiss User Group Tim Bell, CERN 22
  • 23. Heavy Ion Collisions OpenStack Swiss User Group Tim Bell, CERN 23
  • 24. OpenStack Swiss User Group Tim Bell, CERN 24
  • 25. Tier-0 (CERN): •Data recording •Initial data reconstruction •Data distribution Tier-1 (11 centres): •Permanent storage •Re-processing •Analysis Tier-2 (~200 centres): • Simulation • End-user analysis • Data is recorded at CERN and Tier-1s and analysed in the Worldwide LHC Computing Grid • In a normal day, the grid provides 100,000 CPU days executing over 2 million jobs OpenStack Swiss User Group Tim Bell, CERN 25
  • 26. OpenStack Swiss User Group Tim Bell, CERN 26
  • 27. 45,000 tapes holding 73PB of physics data OpenStack Swiss User Group Tim Bell, CERN 27
  • 28. New data centre to expand capacity • Data centre in Geneva at the limit of electrical capacity at 3.5MW • New centre chosen in Budapest, Hungary • Additional 2.7MW of usable power • Hands off facility • Deploying from 2013 with 200Gbit/s OpenStack Swiss User Group Tim Bell, CERN network to CERN 28
  • 29. Time to change strategy • Rationale – Need to manage twice the servers as today – No increase in staff numbers – Tools becoming increasingly brittle and will not scale as-is • Approach – CERN is no longer a special case for compute – Adopt an open source tool chain model – Our engineers rapidly iterate • Evaluate solutions in the problem domain • Identify functional gaps and challenge them • Select first choice but be prepared to change in future – Contribute new function back to the community OpenStack Swiss User Group Tim Bell, CERN 29
  • 30. Building Blocks mcollective, yum Bamboo Puppet AIMS/PXE Foreman JIRA OpenStack Nova git Koji, Mock Yum repo Active Directory / Pulp LDAP Lemon / Hardware Hadoop database Puppet-DB OpenStack Swiss User Group Tim Bell, CERN 30
  • 31. Prepare the move to the clouds • Improve operational efficiency – Machine ordering, reception and testing – Hardware interventions with long running programs – Multiple operating system demand • Improve resource efficiency – Exploit idle resources, especially waiting for disk and tape I/O – Highly variable load such as interactive or build machines • Enable cloud architectures – Gradual migration to cloud interfaces and workflows • Improve responsiveness – Self-Service with coffee break response time OpenStack Swiss User Group Tim Bell, CERN 31
  • 32. Service Model • Pets are given names like pussinboots.cern.ch • They are unique, lovingly hand raised and cared for • When they get ill, you nurse them back to health • Cattle are given numbers like vm0042.cern.ch • They are almost identical to other cattle • When they get ill, you get another one • Future application architectures should use Cattle but Pets with strong configuration management are viable and still needed OpenStack Swiss User Group Tim Bell, CERN 32
  • 33. Current Status of OpenStack at CERN • Focus on the Cattle to start with • Working on an Essex code base from the EPEL repository – Excellent experience with the Fedora cloud-sig team – Cloud-init for contextualisation, oz for images with RHEL/Fedora • Components – Current focus is on Nova with KVM and Hyper-V – Keystone running with Active Directory and Glance for Linux and Windows images • Pre-production facility with around 200 Hypervisors, with 2000 VMs integrated with CERN infrastructure, Puppet deployed and used for simulation of magnet placement using LHC@Home and batch physics programs OpenStack Swiss User Group Tim Bell, CERN 33
  • 34. OpenStack Swiss User Group Tim Bell, CERN 34
  • 35. Next Steps • Deploy into production at the start of 2013 with Folsom running the Grid software on top of OpenStack IaaS • Support multi-site operations with 2nd data centre in Hungary • Exploit new functionality – Ceilometer for metering – Bare metal for non-virtualised use cases such as high I/O servers – X.509 user certificate authentication – Load balancing as a service • Support the pets with live migration and external block storage such as Gluster Ramping to 15K hypervisors with 100K to 300K VMs by 2015 OpenStack Swiss User Group Tim Bell, CERN 35
  • 36. Conclusions • Production at CERN in next few months on Folsom – Our emphasis will shift to focus on stability – Work together with others on scaling improvements • Community is key to shared success – Foundation gives a structure for collaboration – Our problems are often resolved before we raise them – Packaging teams are producing reliable builds promptly • CERN contributes and benefits – Thanks to everyone for their efforts and enthusiasm – Not just code but documentation, tests, blogs, … OpenStack Swiss User Group Tim Bell, CERN 36
  • 37. OpenStack Swiss User Group Tim Bell, CERN 37
  • 38. References CERN http://public.web.cern.ch/public/ Scientific Linux http://www.scientificlinux.org/ Worldwide LHC Computing Grid http://lcg.web.cern.ch/lcg/ http://rtm.hep.ph.ic.ac.uk/ Jobs http://cern.ch/jobs Detailed Report on Agile Infrastructure http://cern.ch/go/N8wp Talk on OpenStack at San Diego Summit http://www.openstack.org/summit/san- diego-2012/openstack-summit- sessions/presentation/accelerating- science-with-openstack OpenStack Swiss User Group Tim Bell, CERN 38
  • 39. Backup Slides OpenStack Swiss User Group Tim Bell, CERN 39
  • 40. Community collaboration on an international scale OpenStack Swiss User Group Tim Bell, CERN 40
  • 41. Our Challenges - Data storage • >20 years retention • 6GB/s average • 25GB/s peaks • 30PB/year to record OpenStack Swiss User Group Tim Bell, CERN 41
  • 42. Data Centre by Numbers – Hardware installation & retirement • ~7,000 hardware movements/year; ~1,800 disk failures/year Racks 828 Disks 64,109 Tape Drives 160 Servers 11,728 Raw disk capacity (TiB) 63,289 Tape Cartridges 45,000 Processors 15,694 Memory modules 56,014 Tape slots 56,000 Cores 64,238 Memory capacity (TiB) 158 Tape Capacity (TiB) 73,000 HEPSpec06 482,507 RAID controllers 3,749 High Speed Routers 24 Xeon Xeon Xeon Other Fujitsu (640 Mbps → 2.4 Tbps) 3GHz 5150 5160 Xeon 0% 3% Xeon 4% 2% 10% E5335 Ethernet Switches 350 L5520 7% Xeon Hitachi 33% 23% 10 Gbps ports 2,000 E5345 14% HP Switching Capacity 4.8 Tbps Seagate 0% 15% 1 Gbps ports 16,939 Maxtor Western 0% 10 Gbps ports 558 Xeon Xeon Digital E5405 Xeon 59% L5420 6% IT Power Consumption 2,456 KW 8% E5410 16% Total Power Consumption 3,890 KW OpenStack Swiss User Group Tim Bell, CERN 42
  • 43. Public Procurement Purchase Model Step Time (Days) Elapsed (Days) User expresses requirement 0 Market Survey prepared 15 15 Market Survey for possible vendors 30 45 Specifications prepared 15 60 Vendor responses 30 90 Test systems evaluated 30 120 Offers adjudicated 10 130 Finance committee 30 160 Hardware delivered 90 250 Burn in and acceptance 30 days typical 280 380 worst case Total 280+ Days OpenStack Swiss User Group Tim Bell, CERN 43
  • 44. Training and Support • Buy the book rather than guru mentoring • Follow the mailing lists to learn • Newcomers are rapidly productive (and often know more than us) • Community and Enterprise support means we’re not on our own OpenStack Swiss User Group Tim Bell, CERN 44
  • 45. Staff Motivation • Skills valuable outside of CERN when an engineer’s contracts end OpenStack Swiss User Group Tim Bell, CERN 45
  • 46. When communities combine… • OpenStack’s many components and options make configuration complex out of the box • Puppet forge module from PuppetLabs does our configuration • The Foreman adds OpenStack provisioning for user kiosk to a configured machine in 15 minutes OpenStack Swiss User Group Tim Bell, CERN 46
  • 47. Foreman to manage Puppetized VM OpenStack Swiss User Group Tim Bell, CERN 47
  • 48. Supporting the Pets with OpenStack • Network – Interfacing with legacy site DNS and IP management – Ensuring Kerberos identity before VM start • Puppet – Ease use of configuration management tools with our users – Exploit mcollective for orchestration/delegation • External Block Storage – Currently using nova-volume with Gluster backing store • Live migration to maximise availability – KVM live migration using Gluster – KVM and Hyper-V block migration OpenStack Swiss User Group Tim Bell, CERN 48
  • 49. Active Directory Integration • CERN’s Active Directory – Unified identity management across the site – 44,000 users – 29,000 groups – 200 arrivals/departures per month • Full integration with Active Directory via LDAP – Uses the OpenLDAP backend with some particular configuration settings – Aim for minimal changes to Active Directory – 7 patches submitted around hard coded values and additional filtering • Now in use in our pre-production instance – Map project roles (admins, members) to groups – Documentation in the OpenStack wiki OpenStack Swiss User Group Tim Bell, CERN 49
  • 50. Welcome Back Hyper-V! • We currently use Hyper-V/System Centre for our server consolidation activities – But need to scale to 100x current installation size • Choice of hypervisors should be tactical – Performance – Compatibility/Support with integration components – Image migration from legacy environments • CERN is working closely with the Hyper-V OpenStack team – Puppet to configure hypervisors on Windows – Most functions work well but further work on Console, Ceilometer, … OpenStack Swiss User Group Tim Bell, CERN 50
  • 51. What are we missing (or haven’t found yet) ? • Best practice for – Monitoring and KPIs as part of core functionality – Guest disaster recovery – Migration between versions of OpenStack • Roles within multi-user projects – VM owner allowed to manage their own resources (start/stop/delete) – Project admins allowed to manage all resources – Other members should not have high rights over other members VMs • Global quota management for non-elastic private cloud – Manage resource prioritisation and allocation centrally – Capacity management / utilisation for planning OpenStack Swiss User Group Tim Bell, CERN 51
  • 52. Opportunistic Clouds in online experiment farms • The CERN experiments have farms of 1000s of Linux servers close to the detectors to filter the 1PByte/s down to 6GByte/s to be recorded to tape • When the accelerator is not running, these machines are currently idle – Accelerator has regular maintenance slots of several days – Long Shutdown due from March 2013-November 2014 • One of the experiments are deploying OpenStack on their farm – Simulation (low I/O, high CPU) – Analysis (high I/O, high CPU, high network) OpenStack Swiss User Group Tim Bell, CERN 52
  • 53. Federated European Clouds • Two significant European projects around Federated Clouds – European Grid Initiative Federated Cloud as a federation of grid sites providing IaaS – HELiX Nebula European Union funded project to create a scientific cloud based on commercial providers EGI Federated Cloud Sites CESGA CESNET INFN SARA Cyfronet FZ Jülich SZTAKI IPHC GRIF GRNET KTH Oxford GWDG IGI TCD IN2P3 STFC OpenStack Swiss User Group Tim Bell, CERN 53
  • 54. Federated Cloud Commonalities • Basic building blocks – Each site gives an IaaS endpoint with an API and common security policy • OCCI? CDMI ? Libcloud ? Jclouds ? – Image stores available across the sites – Federated identity management based on X.509 certificates – Consolidation of accounting information to validate pledges and usage • Multiple cloud technologies – OpenStack – OpenNebula – Proprietary OpenStack Swiss User Group Tim Bell, CERN 54
  • 55. OpenStack Swiss User Group Tim Bell, CERN 55
  • 56. CERN’s tools • The world’s most powerful accelerator: LHC – A 27 km long tunnel filled with high-tech instruments – Equipped with thousands of superconducting magnets – Accelerates particles to energies never before obtained – Produces particle collisions creating microscopic “big bangs” • Very large sophisticated detectors – Four experiments each the size of a cathedral – Hundred million measurement channels each – Data acquisition systems treating Petabytes per second • Top level computing to distribute and analyse the data – A Computing Grid linking ~200 computer centres around the globe – Sufficient computing power and storage to handle 25 Petabytes per year, making them available to thousands of physicists for analysis OpenStack Swiss User Group Tim Bell, CERN 56
  • 57. Our Infrastructure • Hardware is generally based on commodity, white-box servers – Open tendering process based on SpecInt/CHF, CHF/Watt and GB/CHF – Compute nodes typically dual processor, 2GB per core – Bulk storage on 24x2TB disk storage-in-a-box with a RAID card • Vast majority of servers run Scientific Linux, developed by Fermilab and CERN, based on Redhat Enterprise – Focus is on stability in view of the number of centres on the WLCG OpenStack Swiss User Group Tim Bell, CERN 57
  • 58. New architecture data flows OpenStack Swiss User Group Tim Bell, CERN 58
  • 59. 500 1500 2000 2500 3000 3500 1000 0 Mar-10 Apr-10 May-10 Jun-10 Jul-10 Aug-10 Sep-10 OpenStack Swiss User Group Oct-10 Nov-10 Dec-10 Jan-11 Feb-11 Mar-11 Apr-11 May-11 Jun-11 Jul-11 Tim Bell, CERN Aug-11 Sep-11 Oct-11 Nov-11 Dec-11 Jan-12 Feb-12 Mar-12 Apr-12 May-12 Virtualisation on SCVMM/Hyper-V Jun-12 Jul-12 Aug-12 Sep-12 59 Linux Oct-12 Windows
  • 60. Scaling up with Puppet and OpenStack • Use LHC@Home based on BOINC for simulating magnetics guiding particles around the LHC • Naturally, there is a puppet module puppet-boinc • 1000 VMs spun up to stress test the hypervisors with Puppet, Foreman and OpenStack OpenStack Swiss User Group Tim Bell, CERN 60

Notes de l'éditeur

  1. Established by an international treaty at the end of 2nd world war as a place where scientists could work together for fundamental researchNuclear is part of the name but our world is particle physics
  2. Our current understanding of the universe is incomplete. A theory, called the Standard Model, proposes particles and forces, many of which have been experimentally observed. However, there are open questions- Why do some particles have mass and others not ? The Higgs Boson is a theory but we need experimental evidence.Our theory of forces does not explain how Gravity worksCosmologists can only find 4% of the matter in the universe, we have lost the other 96%We should have 50% matter, 50% anti-matter… why is there an asymmetry (although it is a good thing that there is since the two anhialiate each other) ?When we go back through time 13 billion years towards the big bang, we move back through planets, stars, atoms, protons/electrons towards a soup like quark gluon plasma. What were the properties of this?
  3. The LHC is CERN’s largest accelerator. A 17 mile ring 100 meters underground where two beams of particles are sent in opposite directions and collided at the 4 experiments, Atlas, CMS, LHCb and ALICE. Lake Geneva and the airport are visible in the top to give a scale.
  4. The ring consists of two beam pipes, with a vacuum pressure 10 times lower than on the moon which contain the beams of protons accelerated to just below the speed of light. These go round 11,000 times per second being bent by the superconducting magnets cooled to 2K by liquid helium (-450F), colder than outer space. The beams themselves have a total energy similar to a high speed train so care needs to be taken to make sure they turn the corners correctly and don’t bump into the walls of the pipe.
  5. - At 4 points around the ring, the beams are made to cross at points where detectors, the size of cathedrals and weighing up to 12,500 tonnes surround the pipe. These are like digital camera, but they take 100 mega pixel photos 40 million times a second. This produces up to 1 petabyte/s.
  6. - Collisions can be visualised by the tracks left in the various parts of the detectors. With many collisions, the statistics allows particle identification such as mass and charge. This is a simple one…
  7. To improve the statistics, we send round beams of multiple bunches, as they cross there are multiple collisions as 100 billion protons per bunch pass through each otherSoftware close by the detector and later offline in the computer centre then has to examine the tracks to understand the particles involved
  8. To get Quark Gluon plasma, the material closest to the big bang, we also collide lead ions which is much more intensive… the temperatures reach 100,000 times that in the sun.
  9. - We cannot record 1PB/s so there are hardware filters to remove uninteresting collisions such as those whose physics we understand already. The data is then sent to the CERN computer centre for recording via 10Gbit optical connections.
  10. The Worldwide LHC Computing grid is used to record and analyse this data. The grid currently runs over 2 million jobs/day, less than 10% of the work is done at CERN. There is an agreed set of protocols for running jobs, data distribution and accounting between all the sites which co-operate in order to support the physicists across the globe.
  11. Upstairs in the computer centre, a high roof was the fashion in the 1980s for mainframes but now is very difficult to get cooled efficiently
  12. Tape robots from IBM and OracleAround 60,000 tape mounts / week so the robots are kept busyData copied every two years to keep up with the latest media densities
  13. Asked member states for offers200Gbit/s links connecting the centresExpect to double computing capacity compared to today by 2015
  14. Double the capacity, same manpowerNeed to rethink how to solve the problem… look at how others approach itWe had our own tools in 2002 and as they become more sophisticated, it was not possible to take advantage of other developments elsewhere without a major break.Doing this while doing their ‘day’ jobs so it re-enforces the approach of taking what we can from the community
  15. Model based on Google Toolchain, Puppet is key for many operations. We’ve only had to write one new significant custom CERN software component which is in the certificate authority. Other parts such as Lemon for monitoring are from our previous implementation as we did not want to change all at once and they scale.
  16. Standardise hardware … buy in bulk and pile it up then work out what to use it forMemory, motherboards, cables or disks interventionsUsers waiting for I/O means wasted cycles. Build machines at night unused during the day. Interactive machines mainly during the dayMove to cloud APIs … need to support them but also maintain our existing applicationsDetails later on reception and testing
  17. Puppet applies well to the cattle model but we’re also using it to handle the pet cases that can’t yet move over due to software limitations. So, they get cloud provisioning but flexible configuration management.
  18. Biggest international scientific collaboration in the world, over 10,000 scientistsfrom 100 countriesAnnual Budget around 1.1 billion USDFunding for CERN, the laboratory, itselfcomesfrom the 20 member states, in ratio to the grossdomesticproduct… other countries contribute to experimentsincludingsubstantial US contribution towards the LHC experiments
  19. Our data storage system has to record and preserve 30PB/year with an expected lifetime of 20 years. Keeping the old data is required to get the maximum statistics for discoveries. At times, physicists will want to skim this data looking for new physics. Data rates are around 6GB/s average, with peaks of 25GB/s.
  20. So, to the Tier-0 computer centre at CERN… we are unusual in that we are public with our environment as there is no competitive advantage for us. We have thousands of visitors a year coming for tours and education and the computer center is a popular visit.The data centre has around 2.9MW of usable power looking after 12,000 servers.. In comparison, the accelerator uses 120MW, like a small town.With 64,000 disks, we have around 1,800 failing each year… this is much higher than the manufacturers’ MTBFs which is consistent with results from Google.Servers are mainly Intel processors, some AMD with dual core Xeon being the most common configuration.
  21. We’ve been very pleased with our choices. Along with the obvious benefits of the functionality, there are soft benefits from the community model.
  22. Many staff at CERN are short term contracts… good benefits for those staff to leave with skills in need.
  23. Communities integrating … when a new option is being used at CERN in OpenStack, we contribute the changes back to the puppet forge such as certificate handling. Even looking at Hyper-V/Windows openstack configuration…
  24. CERN is more than just the LHCCNGS neutrinos to Gran SassoCLOUD demonstrating impacts of cosmic rays on weather patternsAnti-hydrogen atoms contained for minutes in a magnetic vesselHowever, for those of you who have read Dan Brown’s Angels and Demons or seen the film, there are no maniacal monks with pounds of anti-matter running around the campus
  25. We purchase on an annuak cycle, replacing around ¼ of the servers. This purchasing is based on performance metrics such as cost per SpecInt or cost/GBGenerally, we are seeing dual core computer servers with Intel or AMD processors and bulk storage servers with 24 or 36 2TB disksThe operating system is Redhatlinux based distributon called Scientific Linux. We share the development and maintenance with Fermilab in Chicago. The choice of a Redhat based distribution comes from the need for stability across the grid, where keeping the 200 centres running compatible Linux distributions.
  26. LHC@Home is not an instruction on how to build your own accelerator but a magnet simulation tool to test multiple passes around the ring. We wanted to use it as a stress test tool and in ½ day, it was running on 1000 VMs.