SlideShare a Scribd company logo
1 of 19
Download to read offline
HPC Experiment for Beginners
Status July 18 2013
The UberCloud HPC Experiment
An open, voluntary, collaborative community
Objective:
Making HPC as a Service available, for everybody, on demand
How?
For SMEs and their engineering applications
we provide the opportunity to explore
the end-to-end process of using remote computing resources,
as a service, on demand, at your finger tip,
and learning how to resolve the roadblocks.
What is the HPC Experiment?
 Started in mid-2012 as a voluntary effort
 Demonstrate the potential of HPC in the Cloud
 Uncover and overcome the obstacles
 Now with almost 500 participants Round 3 has concluded
 Approaching 95 teams as of today
 Please submit your project ideas when you register at
http://www.hpcexperiment.com
3
WhyThis Experiment?
 Foster use of HPC in Digital Manufacturing
 Focus on: remote resources in HPC Centers & in HPC Clouds
 Support initiatives from Intel, NCMS, and many others to
uncover and support the ‘missing middle’ (SMEs)
 Observation: business clouds are becoming widely accepted,
but acceptance of simulation clouds in industry is still in early
adopter stage (CAE, Bio, Finance,Oil & Gas, …)
 Some Barriers: Complexity, IP, data transfer, software
licenses, performance, specific system requirements, data
security, interoperability, cost, etc.
4
How the Experiment works…
 End-User joins the experiment
 ISV joins
 We select a Team Expert
 We suggest a Resource Provider
 Team is ready to go
 … 25 steps on Basecamp virtual team office
 Finally, writing the Case Study
Our recipe
 Find the best matches and form the team
 Step by step process
 Collaborative tools
 Engaged team participants
 Experienced mentors
 Exhibit – list of additional services to pick from
 Community – get help when needed
Step by Step process
Basecamp project management platform for each team
Example: UberCloud Round 4
 August – November 2013
 Expecting 600 organizations, ready for 25 more teams
 Extending applications: HPC, CAE, Life Sciences, Big Data
 Guidance: 22-steps end-to-end process
 Basecamp ‘team rooms’ for collaboration
 Growing the UberCloud Exhibit services directory
 3-level support: front line (within a team), 2nd level (UberCloud
Mentors), 3rd level (software & hardware providers)
 The UberCloud Community Platform, an internal HPC Services
website with crowd-sourcing and social networking elements
How to participate
 End-user: submit your project idea through info gathering
form, select a special service from the Exhibit
 Provider (software, resource, expertise): invite one of your
customers, users, clients to register at the HPC Experiment
and jointly form a team
 Provider: also, consider joining the Exhibit to expose your
service to the UberCloud community
 HPC Expert: just provide your profile describing your
expertise so we can match you to a team which needs this
expertise
Example: HPC Experiment-Team 26
Simulating Stent Deployment using SIMULIA’s
Abaqus/Standard and RemoteViz Software from NICE to
run Abaqus/CAE on SGI Cyclone™
Assessment of a fictitious balloon expandable stent design from the
standpoint of device response to loading onto a delivery system,
deployment, physiological pulsatile loading and both axial and radial
compression.
Team 26- Members
 End User: Anonymous. Global Designer and Manufacturer of Sterile
Medical Products
 CAE Software Provider: Matt Dunbar, Chief Architect, SIMULIA
 RemoteViz Software: NICE Desktop CloudVisualization (DCV)
 HPC/CAE Expert: Scott Shaw, Senior Applications Engineer, SGI.
 Resource Provider: SGI Cyclone. Tony DeVarco, Senior Manager for
Strategic Partners and Cloud Computing at SGI. Eugene Kremenetsky,
Systems EngineeringTechnical Lead at SGI
 Team Mentor: Gregory Shirin from the HPC Experiment team
Transfer Only Pixels to Visualize
What questions were being asked?
User
Move Data; Submit; Run Job
1. Is running Abaqus production jobs in a HPC cloud feasible?
2. How hard is it to set up “cloud bursting” capability when local
resources are not available?
3. How well does remote visualization tools work?
Open up a viz
session
So what was to be tested by the End User in SGI Cyclone?
Transfer Data
When Finished
WhatWas Offered
 For the experiment it was agreed the Simulia and SGI
would provide the end user with Abaqus licenses for up
to 128 cores in order to see if running a job on more
cores could reduce the time to finish the job.
 Access to NICE DCV remote graphics software to view
the results with Abaqus/CAE in Northern California
before downloading them to the End User office on the
US East Coast.
RemoteViz Interface
Challenges, Barriers, Lessons Learned
 Getting customer’s IT to open up firewall ports
 Data transfer via the network was found to be slow. Final results
might be better transferred through an external USB hard drive via
FedEx.
 Data security and privacy – assurance of the best possible data
stewardship is critical from the standpoint of protecting the
customer’s intellectual property.
 For an Abaqus user using SGI Cyclone is a viable solution for both
compute and visualization.
 The remote visualization aspect of the solution was impressive
Top benefits for the End User
1. Gained increased understanding of using a cloud-based solution
for doing Abaqus based FEA simulations.
2. Shifting computational work to the cloud during periods of full
utilization of in-house compute resources is a viable approach to
ensuring analysis throughput.
3. Participation in the experiment allowed direct assessment of speed
and integrity of remote viz of computational models (both pre-
and post-processing) for a variety of model and output database
sizes.
4. SGI/Nice DCV provides robust solution permitting fast and
accurate remote manipulation of the computational models used
in the study.
Compendium of case studies
25
of our case studies
are available for download:
http://tci.taborcommunications.com/UberCloud_HPC_Experiment
Thank you for your interest
For more questions and answers please see our
Q & A Session at:
http://www.hpcexperiment.com/q-and-a
And, if you are ready for registering:
http://www.hpcexperiment.com/
ThankYou
http://www.hpcexperiment.com
http://www.caeexperiment.com
http://www.compbioexperiment.com
http://www.bigdataexperiment.com

More Related Content

What's hot

HPC Storage and IO Trends and Workflows
HPC Storage and IO Trends and WorkflowsHPC Storage and IO Trends and Workflows
HPC Storage and IO Trends and Workflowsinside-BigData.com
 
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology Red_Hat_Storage
 
USENIX NSDI 2016 (Session: Resource Sharing)
USENIX NSDI 2016 (Session: Resource Sharing)USENIX NSDI 2016 (Session: Resource Sharing)
USENIX NSDI 2016 (Session: Resource Sharing)Ryousei Takano
 
CEPH DAY BERLIN - DISK HEALTH PREDICTION AND RESOURCE ALLOCATION FOR CEPH BY ...
CEPH DAY BERLIN - DISK HEALTH PREDICTION AND RESOURCE ALLOCATION FOR CEPH BY ...CEPH DAY BERLIN - DISK HEALTH PREDICTION AND RESOURCE ALLOCATION FOR CEPH BY ...
CEPH DAY BERLIN - DISK HEALTH PREDICTION AND RESOURCE ALLOCATION FOR CEPH BY ...Ceph Community
 
Iris: Inter-cloud Resource Integration System for Elastic Cloud Data Center
Iris: Inter-cloud Resource Integration System for Elastic Cloud Data CenterIris: Inter-cloud Resource Integration System for Elastic Cloud Data Center
Iris: Inter-cloud Resource Integration System for Elastic Cloud Data CenterRyousei Takano
 
Red Hat Storage Day New York - New Reference Architectures
Red Hat Storage Day New York - New Reference ArchitecturesRed Hat Storage Day New York - New Reference Architectures
Red Hat Storage Day New York - New Reference ArchitecturesRed_Hat_Storage
 
IBM Data Centric Systems & OpenPOWER
IBM Data Centric Systems & OpenPOWERIBM Data Centric Systems & OpenPOWER
IBM Data Centric Systems & OpenPOWERinside-BigData.com
 
Ceph Day Melabourne - Community Update
Ceph Day Melabourne - Community UpdateCeph Day Melabourne - Community Update
Ceph Day Melabourne - Community UpdateCeph Community
 
Ceph Deployment at Target: Customer Spotlight
Ceph Deployment at Target: Customer SpotlightCeph Deployment at Target: Customer Spotlight
Ceph Deployment at Target: Customer SpotlightColleen Corrice
 
Ncar globally accessible user environment
Ncar globally accessible user environmentNcar globally accessible user environment
Ncar globally accessible user environmentinside-BigData.com
 
Mellanox Announces HDR 200 Gb/s InfiniBand Solutions
Mellanox Announces HDR 200 Gb/s InfiniBand SolutionsMellanox Announces HDR 200 Gb/s InfiniBand Solutions
Mellanox Announces HDR 200 Gb/s InfiniBand Solutionsinside-BigData.com
 
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu Yong
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu YongUnlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu Yong
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu YongCeph Community
 
A PCIe Congestion-Aware Performance Model for Densely Populated Accelerator S...
A PCIe Congestion-Aware Performance Model for Densely Populated Accelerator S...A PCIe Congestion-Aware Performance Model for Densely Populated Accelerator S...
A PCIe Congestion-Aware Performance Model for Densely Populated Accelerator S...inside-BigData.com
 
PGConf.ASIA 2019 Bali - Building PostgreSQL as a Service with Kubernetes - Ta...
PGConf.ASIA 2019 Bali - Building PostgreSQL as a Service with Kubernetes - Ta...PGConf.ASIA 2019 Bali - Building PostgreSQL as a Service with Kubernetes - Ta...
PGConf.ASIA 2019 Bali - Building PostgreSQL as a Service with Kubernetes - Ta...Equnix Business Solutions
 
Which Hypervisor is Best?
Which Hypervisor is Best?Which Hypervisor is Best?
Which Hypervisor is Best?Kyle Bader
 
Ceph Day Beijing: Big Data Analytics on Ceph Object Store
Ceph Day Beijing: Big Data Analytics on Ceph Object Store Ceph Day Beijing: Big Data Analytics on Ceph Object Store
Ceph Day Beijing: Big Data Analytics on Ceph Object Store Ceph Community
 
Red Hat Storage - Introduction to GlusterFS
Red Hat Storage - Introduction to GlusterFSRed Hat Storage - Introduction to GlusterFS
Red Hat Storage - Introduction to GlusterFSGlusterFS
 
Walk Through a Software Defined Everything PoC
Walk Through a Software Defined Everything PoCWalk Through a Software Defined Everything PoC
Walk Through a Software Defined Everything PoCCeph Community
 
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...Odinot Stanislas
 

What's hot (20)

HPC Storage and IO Trends and Workflows
HPC Storage and IO Trends and WorkflowsHPC Storage and IO Trends and Workflows
HPC Storage and IO Trends and Workflows
 
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
 
USENIX NSDI 2016 (Session: Resource Sharing)
USENIX NSDI 2016 (Session: Resource Sharing)USENIX NSDI 2016 (Session: Resource Sharing)
USENIX NSDI 2016 (Session: Resource Sharing)
 
CEPH DAY BERLIN - DISK HEALTH PREDICTION AND RESOURCE ALLOCATION FOR CEPH BY ...
CEPH DAY BERLIN - DISK HEALTH PREDICTION AND RESOURCE ALLOCATION FOR CEPH BY ...CEPH DAY BERLIN - DISK HEALTH PREDICTION AND RESOURCE ALLOCATION FOR CEPH BY ...
CEPH DAY BERLIN - DISK HEALTH PREDICTION AND RESOURCE ALLOCATION FOR CEPH BY ...
 
Iris: Inter-cloud Resource Integration System for Elastic Cloud Data Center
Iris: Inter-cloud Resource Integration System for Elastic Cloud Data CenterIris: Inter-cloud Resource Integration System for Elastic Cloud Data Center
Iris: Inter-cloud Resource Integration System for Elastic Cloud Data Center
 
Red Hat Storage Day New York - New Reference Architectures
Red Hat Storage Day New York - New Reference ArchitecturesRed Hat Storage Day New York - New Reference Architectures
Red Hat Storage Day New York - New Reference Architectures
 
IBM Data Centric Systems & OpenPOWER
IBM Data Centric Systems & OpenPOWERIBM Data Centric Systems & OpenPOWER
IBM Data Centric Systems & OpenPOWER
 
Ceph Day Melabourne - Community Update
Ceph Day Melabourne - Community UpdateCeph Day Melabourne - Community Update
Ceph Day Melabourne - Community Update
 
Ceph Deployment at Target: Customer Spotlight
Ceph Deployment at Target: Customer SpotlightCeph Deployment at Target: Customer Spotlight
Ceph Deployment at Target: Customer Spotlight
 
Ncar globally accessible user environment
Ncar globally accessible user environmentNcar globally accessible user environment
Ncar globally accessible user environment
 
Mellanox Announces HDR 200 Gb/s InfiniBand Solutions
Mellanox Announces HDR 200 Gb/s InfiniBand SolutionsMellanox Announces HDR 200 Gb/s InfiniBand Solutions
Mellanox Announces HDR 200 Gb/s InfiniBand Solutions
 
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu Yong
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu YongUnlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu Yong
Unlock Bigdata Analytic Efficiency with Ceph Data Lake - Zhang Jian, Fu Yong
 
A PCIe Congestion-Aware Performance Model for Densely Populated Accelerator S...
A PCIe Congestion-Aware Performance Model for Densely Populated Accelerator S...A PCIe Congestion-Aware Performance Model for Densely Populated Accelerator S...
A PCIe Congestion-Aware Performance Model for Densely Populated Accelerator S...
 
PGConf.ASIA 2019 Bali - Building PostgreSQL as a Service with Kubernetes - Ta...
PGConf.ASIA 2019 Bali - Building PostgreSQL as a Service with Kubernetes - Ta...PGConf.ASIA 2019 Bali - Building PostgreSQL as a Service with Kubernetes - Ta...
PGConf.ASIA 2019 Bali - Building PostgreSQL as a Service with Kubernetes - Ta...
 
Which Hypervisor is Best?
Which Hypervisor is Best?Which Hypervisor is Best?
Which Hypervisor is Best?
 
Ceph Day Beijing: Big Data Analytics on Ceph Object Store
Ceph Day Beijing: Big Data Analytics on Ceph Object Store Ceph Day Beijing: Big Data Analytics on Ceph Object Store
Ceph Day Beijing: Big Data Analytics on Ceph Object Store
 
Exploiting GPUs in Spark
Exploiting GPUs in SparkExploiting GPUs in Spark
Exploiting GPUs in Spark
 
Red Hat Storage - Introduction to GlusterFS
Red Hat Storage - Introduction to GlusterFSRed Hat Storage - Introduction to GlusterFS
Red Hat Storage - Introduction to GlusterFS
 
Walk Through a Software Defined Everything PoC
Walk Through a Software Defined Everything PoCWalk Through a Software Defined Everything PoC
Walk Through a Software Defined Everything PoC
 
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...
 

Similar to HPC Experiment for Beginners Guide

International Conference on Utility and Cloud Computing December 9 – 12, Dres...
International Conference on Utility and Cloud Computing December 9 – 12, Dres...International Conference on Utility and Cloud Computing December 9 – 12, Dres...
International Conference on Utility and Cloud Computing December 9 – 12, Dres...Thomas Francis
 
UberCloud at ucc dresden
UberCloud at ucc dresdenUberCloud at ucc dresden
UberCloud at ucc dresdenThe UberCloud
 
Uber cloud at ucc dresden dec 2013
Uber cloud at ucc dresden dec 2013Uber cloud at ucc dresden dec 2013
Uber cloud at ucc dresden dec 2013Wolfgang Gentzsch
 
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...Wolfgang Gentzsch
 
UberCloud - From Project to Product
UberCloud - From Project to ProductUberCloud - From Project to Product
UberCloud - From Project to ProductThe UberCloud
 
NCMS UberCloud Experiment Webinar .
NCMS UberCloud Experiment Webinar .NCMS UberCloud Experiment Webinar .
NCMS UberCloud Experiment Webinar .hpcexperiment
 
Wicsa2011 cloud tutorial
Wicsa2011 cloud tutorialWicsa2011 cloud tutorial
Wicsa2011 cloud tutorialAnna Liu
 
Special Purpose IBM Center of excellence lab
Special Purpose IBM Center of excellence lab Special Purpose IBM Center of excellence lab
Special Purpose IBM Center of excellence lab Ganesan Narayanasamy
 
Implementing Saas as Cloud controllers using Mobile Agent based technology wi...
Implementing Saas as Cloud controllers using Mobile Agent based technology wi...Implementing Saas as Cloud controllers using Mobile Agent based technology wi...
Implementing Saas as Cloud controllers using Mobile Agent based technology wi...Sunil Rajput
 
HNSciCloud: Project Results and lessons learned
HNSciCloud: Project Results and lessons learnedHNSciCloud: Project Results and lessons learned
HNSciCloud: Project Results and lessons learnedEOSC-hub project
 
Introduction to Cloud Computing
Introduction to Cloud ComputingIntroduction to Cloud Computing
Introduction to Cloud ComputingAnimesh Chaturvedi
 
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform EnvironmentsDeployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform EnvironmentsIBM UrbanCode Products
 
[Capella Day Toulouse] Driving intelligent transportation systems with Capella
[Capella Day Toulouse] Driving intelligent transportation systems with Capella[Capella Day Toulouse] Driving intelligent transportation systems with Capella
[Capella Day Toulouse] Driving intelligent transportation systems with CapellaObeo
 
Opportunities and Challenges for Running Scientific Workflows on the Cloud
Opportunities and Challenges for Running Scientific Workflows on the Cloud Opportunities and Challenges for Running Scientific Workflows on the Cloud
Opportunities and Challenges for Running Scientific Workflows on the Cloud lyingcom
 
The importance of building up open technology’s model citizen: a user story
The importance of building up open technology’s model citizen: a user storyThe importance of building up open technology’s model citizen: a user story
The importance of building up open technology’s model citizen: a user storyAngel Diaz
 
Introduction Of Cloud Computing
Introduction Of Cloud ComputingIntroduction Of Cloud Computing
Introduction Of Cloud ComputingMonica Rivera
 
Building Opportunity with an Open Cloud Architecture
Building Opportunity with an Open Cloud ArchitectureBuilding Opportunity with an Open Cloud Architecture
Building Opportunity with an Open Cloud ArchitecturePlatform CF
 
Engineering Simulation Meets the Cloud
Engineering Simulation Meets the CloudEngineering Simulation Meets the Cloud
Engineering Simulation Meets the Cloudhpcexperiment
 
Cloud E-Learning - Docebo at OEB 2011
Cloud E-Learning - Docebo at OEB 2011Cloud E-Learning - Docebo at OEB 2011
Cloud E-Learning - Docebo at OEB 2011DoceboElearning
 
Engineering Simulation Meets the Cloud
Engineering Simulation Meets the CloudEngineering Simulation Meets the Cloud
Engineering Simulation Meets the CloudBurak Yenier
 

Similar to HPC Experiment for Beginners Guide (20)

International Conference on Utility and Cloud Computing December 9 – 12, Dres...
International Conference on Utility and Cloud Computing December 9 – 12, Dres...International Conference on Utility and Cloud Computing December 9 – 12, Dres...
International Conference on Utility and Cloud Computing December 9 – 12, Dres...
 
UberCloud at ucc dresden
UberCloud at ucc dresdenUberCloud at ucc dresden
UberCloud at ucc dresden
 
Uber cloud at ucc dresden dec 2013
Uber cloud at ucc dresden dec 2013Uber cloud at ucc dresden dec 2013
Uber cloud at ucc dresden dec 2013
 
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
 
UberCloud - From Project to Product
UberCloud - From Project to ProductUberCloud - From Project to Product
UberCloud - From Project to Product
 
NCMS UberCloud Experiment Webinar .
NCMS UberCloud Experiment Webinar .NCMS UberCloud Experiment Webinar .
NCMS UberCloud Experiment Webinar .
 
Wicsa2011 cloud tutorial
Wicsa2011 cloud tutorialWicsa2011 cloud tutorial
Wicsa2011 cloud tutorial
 
Special Purpose IBM Center of excellence lab
Special Purpose IBM Center of excellence lab Special Purpose IBM Center of excellence lab
Special Purpose IBM Center of excellence lab
 
Implementing Saas as Cloud controllers using Mobile Agent based technology wi...
Implementing Saas as Cloud controllers using Mobile Agent based technology wi...Implementing Saas as Cloud controllers using Mobile Agent based technology wi...
Implementing Saas as Cloud controllers using Mobile Agent based technology wi...
 
HNSciCloud: Project Results and lessons learned
HNSciCloud: Project Results and lessons learnedHNSciCloud: Project Results and lessons learned
HNSciCloud: Project Results and lessons learned
 
Introduction to Cloud Computing
Introduction to Cloud ComputingIntroduction to Cloud Computing
Introduction to Cloud Computing
 
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform EnvironmentsDeployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
 
[Capella Day Toulouse] Driving intelligent transportation systems with Capella
[Capella Day Toulouse] Driving intelligent transportation systems with Capella[Capella Day Toulouse] Driving intelligent transportation systems with Capella
[Capella Day Toulouse] Driving intelligent transportation systems with Capella
 
Opportunities and Challenges for Running Scientific Workflows on the Cloud
Opportunities and Challenges for Running Scientific Workflows on the Cloud Opportunities and Challenges for Running Scientific Workflows on the Cloud
Opportunities and Challenges for Running Scientific Workflows on the Cloud
 
The importance of building up open technology’s model citizen: a user story
The importance of building up open technology’s model citizen: a user storyThe importance of building up open technology’s model citizen: a user story
The importance of building up open technology’s model citizen: a user story
 
Introduction Of Cloud Computing
Introduction Of Cloud ComputingIntroduction Of Cloud Computing
Introduction Of Cloud Computing
 
Building Opportunity with an Open Cloud Architecture
Building Opportunity with an Open Cloud ArchitectureBuilding Opportunity with an Open Cloud Architecture
Building Opportunity with an Open Cloud Architecture
 
Engineering Simulation Meets the Cloud
Engineering Simulation Meets the CloudEngineering Simulation Meets the Cloud
Engineering Simulation Meets the Cloud
 
Cloud E-Learning - Docebo at OEB 2011
Cloud E-Learning - Docebo at OEB 2011Cloud E-Learning - Docebo at OEB 2011
Cloud E-Learning - Docebo at OEB 2011
 
Engineering Simulation Meets the Cloud
Engineering Simulation Meets the CloudEngineering Simulation Meets the Cloud
Engineering Simulation Meets the Cloud
 

Recently uploaded

Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 

Recently uploaded (20)

Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 

HPC Experiment for Beginners Guide

  • 1. HPC Experiment for Beginners Status July 18 2013
  • 2. The UberCloud HPC Experiment An open, voluntary, collaborative community Objective: Making HPC as a Service available, for everybody, on demand How? For SMEs and their engineering applications we provide the opportunity to explore the end-to-end process of using remote computing resources, as a service, on demand, at your finger tip, and learning how to resolve the roadblocks.
  • 3. What is the HPC Experiment?  Started in mid-2012 as a voluntary effort  Demonstrate the potential of HPC in the Cloud  Uncover and overcome the obstacles  Now with almost 500 participants Round 3 has concluded  Approaching 95 teams as of today  Please submit your project ideas when you register at http://www.hpcexperiment.com 3
  • 4. WhyThis Experiment?  Foster use of HPC in Digital Manufacturing  Focus on: remote resources in HPC Centers & in HPC Clouds  Support initiatives from Intel, NCMS, and many others to uncover and support the ‘missing middle’ (SMEs)  Observation: business clouds are becoming widely accepted, but acceptance of simulation clouds in industry is still in early adopter stage (CAE, Bio, Finance,Oil & Gas, …)  Some Barriers: Complexity, IP, data transfer, software licenses, performance, specific system requirements, data security, interoperability, cost, etc. 4
  • 5. How the Experiment works…  End-User joins the experiment  ISV joins  We select a Team Expert  We suggest a Resource Provider  Team is ready to go  … 25 steps on Basecamp virtual team office  Finally, writing the Case Study
  • 6. Our recipe  Find the best matches and form the team  Step by step process  Collaborative tools  Engaged team participants  Experienced mentors  Exhibit – list of additional services to pick from  Community – get help when needed
  • 7. Step by Step process Basecamp project management platform for each team
  • 8. Example: UberCloud Round 4  August – November 2013  Expecting 600 organizations, ready for 25 more teams  Extending applications: HPC, CAE, Life Sciences, Big Data  Guidance: 22-steps end-to-end process  Basecamp ‘team rooms’ for collaboration  Growing the UberCloud Exhibit services directory  3-level support: front line (within a team), 2nd level (UberCloud Mentors), 3rd level (software & hardware providers)  The UberCloud Community Platform, an internal HPC Services website with crowd-sourcing and social networking elements
  • 9. How to participate  End-user: submit your project idea through info gathering form, select a special service from the Exhibit  Provider (software, resource, expertise): invite one of your customers, users, clients to register at the HPC Experiment and jointly form a team  Provider: also, consider joining the Exhibit to expose your service to the UberCloud community  HPC Expert: just provide your profile describing your expertise so we can match you to a team which needs this expertise
  • 10. Example: HPC Experiment-Team 26 Simulating Stent Deployment using SIMULIA’s Abaqus/Standard and RemoteViz Software from NICE to run Abaqus/CAE on SGI Cyclone™ Assessment of a fictitious balloon expandable stent design from the standpoint of device response to loading onto a delivery system, deployment, physiological pulsatile loading and both axial and radial compression.
  • 11. Team 26- Members  End User: Anonymous. Global Designer and Manufacturer of Sterile Medical Products  CAE Software Provider: Matt Dunbar, Chief Architect, SIMULIA  RemoteViz Software: NICE Desktop CloudVisualization (DCV)  HPC/CAE Expert: Scott Shaw, Senior Applications Engineer, SGI.  Resource Provider: SGI Cyclone. Tony DeVarco, Senior Manager for Strategic Partners and Cloud Computing at SGI. Eugene Kremenetsky, Systems EngineeringTechnical Lead at SGI  Team Mentor: Gregory Shirin from the HPC Experiment team
  • 12. Transfer Only Pixels to Visualize What questions were being asked? User Move Data; Submit; Run Job 1. Is running Abaqus production jobs in a HPC cloud feasible? 2. How hard is it to set up “cloud bursting” capability when local resources are not available? 3. How well does remote visualization tools work? Open up a viz session So what was to be tested by the End User in SGI Cyclone? Transfer Data When Finished
  • 13. WhatWas Offered  For the experiment it was agreed the Simulia and SGI would provide the end user with Abaqus licenses for up to 128 cores in order to see if running a job on more cores could reduce the time to finish the job.  Access to NICE DCV remote graphics software to view the results with Abaqus/CAE in Northern California before downloading them to the End User office on the US East Coast.
  • 15. Challenges, Barriers, Lessons Learned  Getting customer’s IT to open up firewall ports  Data transfer via the network was found to be slow. Final results might be better transferred through an external USB hard drive via FedEx.  Data security and privacy – assurance of the best possible data stewardship is critical from the standpoint of protecting the customer’s intellectual property.  For an Abaqus user using SGI Cyclone is a viable solution for both compute and visualization.  The remote visualization aspect of the solution was impressive
  • 16. Top benefits for the End User 1. Gained increased understanding of using a cloud-based solution for doing Abaqus based FEA simulations. 2. Shifting computational work to the cloud during periods of full utilization of in-house compute resources is a viable approach to ensuring analysis throughput. 3. Participation in the experiment allowed direct assessment of speed and integrity of remote viz of computational models (both pre- and post-processing) for a variety of model and output database sizes. 4. SGI/Nice DCV provides robust solution permitting fast and accurate remote manipulation of the computational models used in the study.
  • 17. Compendium of case studies 25 of our case studies are available for download: http://tci.taborcommunications.com/UberCloud_HPC_Experiment
  • 18. Thank you for your interest For more questions and answers please see our Q & A Session at: http://www.hpcexperiment.com/q-and-a And, if you are ready for registering: http://www.hpcexperiment.com/