SlideShare une entreprise Scribd logo
1  sur  14
Télécharger pour lire hors ligne
Grid	
  Computing	
  Overview
Federating	
  Compute	
  and	
  Storage	
  Resources	
  to	
  
  Accelerate	
  Research	
  and	
  Aid	
  Collaboration




              Ian	
  Stokes-­‐Rees,	
  PhD
             Harvard,	
  Cambridge,	
  USA

      http://ac.seas.harvard.edu
       ijstokes@seas.harvard.edu
Slides	
  and	
  Contact
         ijstokes@seas.harvard.edu

         http://linkedin.com/in/ijstokes
         http://slidesha.re/ijstokes-hbs2012_pt1
         http://slidesha.re/ijstokes-hbs2012_pt2


        http://ac.seas.harvard.edu
        http://www.opensciencegrid.org
        http://www.xsede.org


Grid Overview - Ian Stokes-Rees         ijstokes@seas.harvard.edu
Today
                    Grid	
  Computing	
  Origins
                        High	
  Energy	
  Physics
                    Life	
  Science	
  Computing	
  Survey
                    US	
  Cyberinfrastructure
                        XSEDE
                        Open	
  Science	
  Grid
                    Science	
  Portals
                    Data	
  Access
                    User	
  Credentials
                    Security


Grid Overview - Ian Stokes-Rees                       ijstokes@seas.harvard.edu
Things	
  ISummary About
                        ’m	
  Excited	
  




Grid Overview - Ian Stokes-Rees   ijstokes@seas.harvard.edu
About	
  Me




Grid Overview - Ian Stokes-Rees             ijstokes@seas.harvard.edu
High	
  Energy	
  Physics




Grid Overview - Ian Stokes-Rees       ijstokes@seas.harvard.edu
Grid Overview - Ian Stokes-Rees   ijstokes@seas.harvard.edu
Grid Overview - Ian Stokes-Rees   ijstokes@seas.harvard.edu
Grid Overview - Ian Stokes-Rees   ijstokes@seas.harvard.edu
40	
  MHz	
  bunch	
  crossing	
  rate
      10	
  million	
  data	
  channels
      1	
  KHz	
  level	
  1	
  event	
  recording	
  rate
      1-­10	
  MB	
  per	
  event
      14	
  hours	
  per	
  day,	
  7+	
  months	
  /	
  year
      4	
  detectors
      6	
  PB	
  of	
  data	
  /	
  year
      globally	
  distribute	
  data	
  for	
  analysis	
  (x2)



Grid Overview - Ian Stokes-Rees                                   ijstokes@seas.harvard.edu
Data	
  and	
  Compute	
  Intensive	
  
          Life	
  Sciences
Study	
  of	
  Protein	
  Structure	
  
                     and	
  Function




                                                                    400m
                            1mm




                                                                           10nm
                                  • Shared	
  scientiLic	
  data	
  collection	
  facility
                                  • Data	
  intensive	
  (10-­‐100	
  GB/day)
Grid Overview - Ian Stokes-Rees                                       ijstokes@seas.harvard.edu
Cryo	
  Electron	
  Microscopy




      • Previously,	
  1-­10,000	
  images,	
  managed	
  by	
  hand
      • Now,	
  robotic	
  systems	
  collect	
  millions	
  of	
  hi-­res	
  images
      • estimate	
  250,000	
  CPU-­hours	
  to	
  reconstruct	
  model
Grid Overview - Ian Stokes-Rees                              ijstokes@seas.harvard.edu
Molecular	
  Dynamics	
  Simulations
                                      1	
  fs	
  time	
  step
                                      1ns	
  snapshot
                                      1	
  us	
  simulation
                                      1e6	
  steps
                                      1000	
  frames
                                      10	
  MB	
  /	
  frame
                                      10	
  GB	
  /	
  sim
                                      20	
  CPU-­years
                                      3	
  months	
  (wall-­
                                      clock)

Grid Overview - Ian Stokes-Rees   ijstokes@seas.harvard.edu

Contenu connexe

Similaire à 2012 02 pre_hbs_grid_overview_ianstokesrees_pt1

Similaire à 2012 02 pre_hbs_grid_overview_ianstokesrees_pt1 (20)

Big Data: tools and techniques for working with large data sets
Big Data: tools and techniques for working with large data setsBig Data: tools and techniques for working with large data sets
Big Data: tools and techniques for working with large data sets
 
Introduction to Next Generation Sequencing
Introduction to Next Generation SequencingIntroduction to Next Generation Sequencing
Introduction to Next Generation Sequencing
 
The Pacific Research Platform
 Two Years In
The Pacific Research Platform
 Two Years InThe Pacific Research Platform
 Two Years In
The Pacific Research Platform
 Two Years In
 
A National Big Data Cyberinfrastructure Supporting Computational Biomedical R...
A National Big Data Cyberinfrastructure Supporting Computational Biomedical R...A National Big Data Cyberinfrastructure Supporting Computational Biomedical R...
A National Big Data Cyberinfrastructure Supporting Computational Biomedical R...
 
Science Engagement: A Non-Technical Approach to the Technical Divide
Science Engagement: A Non-Technical Approach to the Technical DivideScience Engagement: A Non-Technical Approach to the Technical Divide
Science Engagement: A Non-Technical Approach to the Technical Divide
 
Health Sciences Driving UCSD Research Cyberinfrastructure
Health Sciences Driving UCSD Research CyberinfrastructureHealth Sciences Driving UCSD Research Cyberinfrastructure
Health Sciences Driving UCSD Research Cyberinfrastructure
 
Data-Intensive Research
Data-Intensive ResearchData-Intensive Research
Data-Intensive Research
 
The eCrystals Federation
The eCrystals FederationThe eCrystals Federation
The eCrystals Federation
 
Data Capacitor II at Indiana University
Data Capacitor II at Indiana UniversityData Capacitor II at Indiana University
Data Capacitor II at Indiana University
 
UC-Wide Cyberinfrastructure for Data-Intensive Research
UC-Wide Cyberinfrastructure for Data-Intensive ResearchUC-Wide Cyberinfrastructure for Data-Intensive Research
UC-Wide Cyberinfrastructure for Data-Intensive Research
 
Pacific Research Platform Application Drivers
Pacific Research Platform Application DriversPacific Research Platform Application Drivers
Pacific Research Platform Application Drivers
 
PhDprofiles
PhDprofilesPhDprofiles
PhDprofiles
 
Set My Data Free: High-Performance CI for Data-Intensive Research
Set My Data Free: High-Performance CI for Data-Intensive ResearchSet My Data Free: High-Performance CI for Data-Intensive Research
Set My Data Free: High-Performance CI for Data-Intensive Research
 
Toward Real-Time Analysis of Large Data Volumes for Diffraction Studies by Ma...
Toward Real-Time Analysis of Large Data Volumes for Diffraction Studies by Ma...Toward Real-Time Analysis of Large Data Volumes for Diffraction Studies by Ma...
Toward Real-Time Analysis of Large Data Volumes for Diffraction Studies by Ma...
 
December 9, 2015 NISO Webinar: Two-Part Webinar: Emerging Resource Types - Pa...
December 9, 2015 NISO Webinar: Two-Part Webinar: Emerging Resource Types - Pa...December 9, 2015 NISO Webinar: Two-Part Webinar: Emerging Resource Types - Pa...
December 9, 2015 NISO Webinar: Two-Part Webinar: Emerging Resource Types - Pa...
 
Building a Community Cyberinfrastructure to Support Marine Microbial Ecology ...
Building a Community Cyberinfrastructure to Support Marine Microbial Ecology ...Building a Community Cyberinfrastructure to Support Marine Microbial Ecology ...
Building a Community Cyberinfrastructure to Support Marine Microbial Ecology ...
 
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
 
IEEE_BigData2014-Lee.pdf
IEEE_BigData2014-Lee.pdfIEEE_BigData2014-Lee.pdf
IEEE_BigData2014-Lee.pdf
 
Computation and Knowledge
Computation and KnowledgeComputation and Knowledge
Computation and Knowledge
 
Building an Information Infrastructure to Support Genetic Sciences
Building an Information Infrastructure to Support Genetic SciencesBuilding an Information Infrastructure to Support Genetic Sciences
Building an Information Infrastructure to Support Genetic Sciences
 

Plus de Boston Consulting Group

Wide Search Molecular Replacement and the NEBioGrid portal interface
Wide Search Molecular Replacement and the NEBioGrid portal interfaceWide Search Molecular Replacement and the NEBioGrid portal interface
Wide Search Molecular Replacement and the NEBioGrid portal interface
Boston Consulting Group
 
2010 06 pre_show_computing_lifesciences_stokesrees
2010 06 pre_show_computing_lifesciences_stokesrees2010 06 pre_show_computing_lifesciences_stokesrees
2010 06 pre_show_computing_lifesciences_stokesrees
Boston Consulting Group
 

Plus de Boston Consulting Group (7)

Cloud-native Enterprise Data Science Teams
Cloud-native Enterprise Data Science TeamsCloud-native Enterprise Data Science Teams
Cloud-native Enterprise Data Science Teams
 
Cloud-native Enterprise Data Science Teams
Cloud-native Enterprise Data Science TeamsCloud-native Enterprise Data Science Teams
Cloud-native Enterprise Data Science Teams
 
Beyond the Science Gateway
Beyond the Science GatewayBeyond the Science Gateway
Beyond the Science Gateway
 
Anaconda Data Science Collaboration
Anaconda Data Science CollaborationAnaconda Data Science Collaboration
Anaconda Data Science Collaboration
 
Wide Search Molecular Replacement and the NEBioGrid portal interface
Wide Search Molecular Replacement and the NEBioGrid portal interfaceWide Search Molecular Replacement and the NEBioGrid portal interface
Wide Search Molecular Replacement and the NEBioGrid portal interface
 
2010 06 pre_show_computing_lifesciences_stokesrees
2010 06 pre_show_computing_lifesciences_stokesrees2010 06 pre_show_computing_lifesciences_stokesrees
2010 06 pre_show_computing_lifesciences_stokesrees
 
To Infiniband and Beyond
To Infiniband and BeyondTo Infiniband and Beyond
To Infiniband and Beyond
 

Dernier

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 

Dernier (20)

Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
Philosophy of china and it's charactistics
Philosophy of china and it's charactisticsPhilosophy of china and it's charactistics
Philosophy of china and it's charactistics
 
OSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsOSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & Systems
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
latest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answerslatest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answers
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 

2012 02 pre_hbs_grid_overview_ianstokesrees_pt1

  • 1. Grid  Computing  Overview Federating  Compute  and  Storage  Resources  to   Accelerate  Research  and  Aid  Collaboration Ian  Stokes-­‐Rees,  PhD Harvard,  Cambridge,  USA http://ac.seas.harvard.edu ijstokes@seas.harvard.edu
  • 2. Slides  and  Contact ijstokes@seas.harvard.edu http://linkedin.com/in/ijstokes http://slidesha.re/ijstokes-hbs2012_pt1 http://slidesha.re/ijstokes-hbs2012_pt2 http://ac.seas.harvard.edu http://www.opensciencegrid.org http://www.xsede.org Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 3. Today Grid  Computing  Origins High  Energy  Physics Life  Science  Computing  Survey US  Cyberinfrastructure XSEDE Open  Science  Grid Science  Portals Data  Access User  Credentials Security Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 4. Things  ISummary About ’m  Excited   Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 5. About  Me Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 6. High  Energy  Physics Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 7. Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 8. Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 9. Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 10. 40  MHz  bunch  crossing  rate 10  million  data  channels 1  KHz  level  1  event  recording  rate 1-­10  MB  per  event 14  hours  per  day,  7+  months  /  year 4  detectors 6  PB  of  data  /  year globally  distribute  data  for  analysis  (x2) Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 11. Data  and  Compute  Intensive   Life  Sciences
  • 12. Study  of  Protein  Structure   and  Function 400m 1mm 10nm • Shared  scientiLic  data  collection  facility • Data  intensive  (10-­‐100  GB/day) Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 13. Cryo  Electron  Microscopy • Previously,  1-­10,000  images,  managed  by  hand • Now,  robotic  systems  collect  millions  of  hi-­res  images • estimate  250,000  CPU-­hours  to  reconstruct  model Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu
  • 14. Molecular  Dynamics  Simulations 1  fs  time  step 1ns  snapshot 1  us  simulation 1e6  steps 1000  frames 10  MB  /  frame 10  GB  /  sim 20  CPU-­years 3  months  (wall-­ clock) Grid Overview - Ian Stokes-Rees ijstokes@seas.harvard.edu