SlideShare une entreprise Scribd logo
1  sur  29
Télécharger pour lire hors ligne
Academic Grid infrastructures

        Michael Gindonis
          Olli Tourunen

         CSC – Tieteen tietotekniikan keskus Oy
           CSC – IT Center for Science Ltd.
Part 1:
From Science to e-Science
Towards Computational
Science                                                                                                Computational
                                                                                                      Theoretical
•    Evolution of science [1]
                                                                                                          Empirical
       – From being primarily Empirical to grow an
       – Theoretical component and today also include a
       – Computational component


•    PITAC report 2005
       – Defines and emphasizes the advancement of Computational
         Science
                           “Advances in computing and connectivity make it possible
                           to develop computational models and capture and analyze
                           unprecedented amounts of experimental and observational
                           data to address problems previously deemed intractable or
                                           p        p        y
                           beyond imagination.”

[1] J. Gray, G. Bell and A. Szalay, Petascale Computational Systems:Balanced CyperInfrastructure in a Data-
Centric World, Report to NSF October 2005
Evolution of Computational
Science
S i
• Computational needs continuously
  growing
• R
  Research communities and projects h
         h       iti     d    j t have
  become global
• The need to share data and resources
Evolution of Computational
  Science

• Unified view of
  theory, experiments
  and numerical
  simulation             e-Science or
• Advances in
                          e-Research
                          e Research
  computing and
  networking
    t   ki              e-Infrastructure
                        e Infrastructure
Building a Distributed Research
Infrastructure
I f t t
• Sharing resources allows load balancing
• Better use of funding
• Eases collaboration
Globus issues
Part 2:
Current production infrastructures
DEISA
DEISA
• A grid consisting of several European supercomputers,
    g             g                p      p     p
  including CSC's Louhi.
• A European grid project that shares computing
  resources for demanding scientific applications
• Yearly applications for computing time (DECI call)
• EU FP6: DEISA May 1st 2004 – April 30th 2008
                    1st,             30th,
• EU FP7: DEISA2 May 1st, 2008 – April 30th, 2011
• Most DEISA sites are connected via 10 Gb/s lines
• DEISA Global File System - eliminates need for file
  staging
DEISA Network




Provided by GEANT2 and the National Research and Education Networks
EGEE
EGEE
•   EGEE processes up to 300,000 j
           p           p        ,   jobs p day
                                         per y
•   more than 80,000 CPU cores
•   several tens petabytes of storage
•   available 24 hours a day, seven days a week

                                                                                       No. Cores
              80000
              70000
              60000
              50000
              40000
              30000
              20000
              10000
                  0
                      huhti.04




                                                                 huhti.05




                                                                                                            huhti.06




                                                                                                                                                       huhti.07




                                                                                                                                                                                                  huhti.08
                                 heinä.04
                                             oka.04
                                                      tammi.05


                                                                            heinä.05
                                                                                        oka.05
                                                                                                 tammi.06


                                                                                                                       heinä.06
                                                                                                                                   oka.06
                                                                                                                                            tammi.07


                                                                                                                                                                  heinä.07
                                                                                                                                                                              oka.07
                                                                                                                                                                                       tammi.08
                                            lo




                                                                                       lo




                                                                                                                                  lo




                                                                                                                                                                             lo
Grids in Europe
  www.eu-egi.eu




                  www.eu-egi.eu
Grids in Finland?
• CSC is the key p y
               y player
• Participation in large European projects
  – DEISA
  – EGEE
• Influencing the next generation of grid
  infrastructures
  – PRACE
  – EGI
• Coordinates national level grid infrastructure
                             g
Some grid use cases in
Finland
• CERN Large Hadron Collider
  – ALICE and CMS experiments
  – Computational and storage facilities accessed
    through grid
  – Finnish resources are hosted at CSC for the
    Helsinki Institute of Physics
Some grid use cases in
Finland, contd.
• DEISA DECI
  – LIPOS - Study of Low Density Lipoproteins
    to Prevent Heart Attacks
     • http://www.deisa.eu/science/deci/projects2007-2008/Lipos

• DEISA Vi t l C
        Virtual Community
                      it
  – Planck satellite first light study
     • http://www.esa.int/SPECIALS/Planck/SEM5CMFWNZF_0.html
Some grid use cases in
Finland, contd.
• PairsDB updates
  – Gaining throughput without impacting local
    resources
  – http://pairsdb.csc.fi/
Part 3: Outlook
European Commission

      “…for Grids we would like to see
              the move towards
       long-term sustainable initiatives
            less dependent upon
                   p          p
          EU-funded project cycles”

   Viviane Reding, Commissioner, European Commission, at the
                    EGEE’06 Conference, September 25, 2006


                      www.eu-egi.eu                       20
Evolution
National




                                               European
                                            e-Infrastructure




European
           Productive Use
Testbeds                                          Utility
                            www.eu-egi.eu                   21
Grids in Europe
  www.eu-egi.eu




                  www.eu-egi.eu
Grids in Europe
     www.eu-egi.eu



Each National Grid Initiative
… should be a recognized national body with a single point-
of-contact
… should mobilize national funding and resources
… should ensure the operation of a national e-Infrastructure
                      p
… should support user communities
… should contribute and adhere to intl. standards and
policies



                          www.eu-egi.eu
EGI
• Ensure pan-European grid coordination
          pan European
  and integrity
• Ai
  Aims f standardization where possible
       for t d di ti      h        ibl
• National Grid Initiatives (NGIs) will operate
  National Grid Infrastructures
• EGI will link existing and new NGIs
• Operation starts January 2010
• http://web.eu-egi.eu/
Partnership for Advanced
          p
  Computing in Europe
PRACE
•   Prepares for the creation of a persistent pan-European HPC service
•   Requires a periodic renewal of the systems and a continuous upgrade of
    the infrastructure
•   Aims to provide European researchers with access to petaflop scale
    computers and form the top level of the European HPC ecosystem
                                                         ecosystem.
•   The service will comprise three to five petaflop class supercomputing
    centres strengthened by regional and national HPC centres working in
    collaboration
•   Current phase is undertaking all the necessary technical preparations,
    including the evaluation of components, systems and facilities, porting key
    scientific applications, and the developing training infrastructure
•   Should be in a position to deploy and exploit the first petaflop/s systems in
    2009/2010.
•   CSC is in charge Dissemination, Outreach and Training
•   Funded by the European Commission’s 7th Framework Programme
                           Commission s               Programme.
CSC and the Cloud
• Currently working with ”A data intensive
                          A
  customer”
  – Close collaboration to find suitable technologies from
    Clouds and Grid to meet their needs.
• Enhancing the existing software p
            g            g        products to
  better support distributed computing
  – Chipster: user friendly DNA microarray analysis
        p                 y              y     y
    software developed by CSC offers an intuitive
    graphical user interface to a comprehensive collection
    of up-to-date analysis methods
       up to date
CSC and the Cloud
• Building Internal Expertise
• Following developments
• Keen on involving customers as partners
  in projects
• Interested in Customer needs
Questions,
Questions comments



        Thank you!

Contenu connexe

En vedette

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 

En vedette (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Academic Grid infrastructures

  • 1. Academic Grid infrastructures Michael Gindonis Olli Tourunen CSC – Tieteen tietotekniikan keskus Oy CSC – IT Center for Science Ltd.
  • 2. Part 1: From Science to e-Science
  • 3. Towards Computational Science Computational Theoretical • Evolution of science [1] Empirical – From being primarily Empirical to grow an – Theoretical component and today also include a – Computational component • PITAC report 2005 – Defines and emphasizes the advancement of Computational Science “Advances in computing and connectivity make it possible to develop computational models and capture and analyze unprecedented amounts of experimental and observational data to address problems previously deemed intractable or p p y beyond imagination.” [1] J. Gray, G. Bell and A. Szalay, Petascale Computational Systems:Balanced CyperInfrastructure in a Data- Centric World, Report to NSF October 2005
  • 4. Evolution of Computational Science S i • Computational needs continuously growing • R Research communities and projects h h iti d j t have become global • The need to share data and resources
  • 5. Evolution of Computational Science • Unified view of theory, experiments and numerical simulation e-Science or • Advances in e-Research e Research computing and networking t ki e-Infrastructure e Infrastructure
  • 6. Building a Distributed Research Infrastructure I f t t • Sharing resources allows load balancing • Better use of funding • Eases collaboration
  • 8. Part 2: Current production infrastructures
  • 10. DEISA • A grid consisting of several European supercomputers, g g p p p including CSC's Louhi. • A European grid project that shares computing resources for demanding scientific applications • Yearly applications for computing time (DECI call) • EU FP6: DEISA May 1st 2004 – April 30th 2008 1st, 30th, • EU FP7: DEISA2 May 1st, 2008 – April 30th, 2011 • Most DEISA sites are connected via 10 Gb/s lines • DEISA Global File System - eliminates need for file staging
  • 11. DEISA Network Provided by GEANT2 and the National Research and Education Networks
  • 12. EGEE
  • 13. EGEE • EGEE processes up to 300,000 j p p , jobs p day per y • more than 80,000 CPU cores • several tens petabytes of storage • available 24 hours a day, seven days a week No. Cores 80000 70000 60000 50000 40000 30000 20000 10000 0 huhti.04 huhti.05 huhti.06 huhti.07 huhti.08 heinä.04 oka.04 tammi.05 heinä.05 oka.05 tammi.06 heinä.06 oka.06 tammi.07 heinä.07 oka.07 tammi.08 lo lo lo lo
  • 14. Grids in Europe www.eu-egi.eu www.eu-egi.eu
  • 15. Grids in Finland? • CSC is the key p y y player • Participation in large European projects – DEISA – EGEE • Influencing the next generation of grid infrastructures – PRACE – EGI • Coordinates national level grid infrastructure g
  • 16. Some grid use cases in Finland • CERN Large Hadron Collider – ALICE and CMS experiments – Computational and storage facilities accessed through grid – Finnish resources are hosted at CSC for the Helsinki Institute of Physics
  • 17. Some grid use cases in Finland, contd. • DEISA DECI – LIPOS - Study of Low Density Lipoproteins to Prevent Heart Attacks • http://www.deisa.eu/science/deci/projects2007-2008/Lipos • DEISA Vi t l C Virtual Community it – Planck satellite first light study • http://www.esa.int/SPECIALS/Planck/SEM5CMFWNZF_0.html
  • 18. Some grid use cases in Finland, contd. • PairsDB updates – Gaining throughput without impacting local resources – http://pairsdb.csc.fi/
  • 20. European Commission “…for Grids we would like to see the move towards long-term sustainable initiatives less dependent upon p p EU-funded project cycles” Viviane Reding, Commissioner, European Commission, at the EGEE’06 Conference, September 25, 2006 www.eu-egi.eu 20
  • 21. Evolution National European e-Infrastructure European Productive Use Testbeds Utility www.eu-egi.eu 21
  • 22. Grids in Europe www.eu-egi.eu www.eu-egi.eu
  • 23. Grids in Europe www.eu-egi.eu Each National Grid Initiative … should be a recognized national body with a single point- of-contact … should mobilize national funding and resources … should ensure the operation of a national e-Infrastructure p … should support user communities … should contribute and adhere to intl. standards and policies www.eu-egi.eu
  • 24. EGI • Ensure pan-European grid coordination pan European and integrity • Ai Aims f standardization where possible for t d di ti h ibl • National Grid Initiatives (NGIs) will operate National Grid Infrastructures • EGI will link existing and new NGIs • Operation starts January 2010 • http://web.eu-egi.eu/
  • 25. Partnership for Advanced p Computing in Europe
  • 26. PRACE • Prepares for the creation of a persistent pan-European HPC service • Requires a periodic renewal of the systems and a continuous upgrade of the infrastructure • Aims to provide European researchers with access to petaflop scale computers and form the top level of the European HPC ecosystem ecosystem. • The service will comprise three to five petaflop class supercomputing centres strengthened by regional and national HPC centres working in collaboration • Current phase is undertaking all the necessary technical preparations, including the evaluation of components, systems and facilities, porting key scientific applications, and the developing training infrastructure • Should be in a position to deploy and exploit the first petaflop/s systems in 2009/2010. • CSC is in charge Dissemination, Outreach and Training • Funded by the European Commission’s 7th Framework Programme Commission s Programme.
  • 27. CSC and the Cloud • Currently working with ”A data intensive A customer” – Close collaboration to find suitable technologies from Clouds and Grid to meet their needs. • Enhancing the existing software p g g products to better support distributed computing – Chipster: user friendly DNA microarray analysis p y y y software developed by CSC offers an intuitive graphical user interface to a comprehensive collection of up-to-date analysis methods up to date
  • 28. CSC and the Cloud • Building Internal Expertise • Following developments • Keen on involving customers as partners in projects • Interested in Customer needs