1. HPC Development on OpenSolaris
for Cloud Environments
Bogdan Vasiliu
Cloud and HPC Infrastructure Management, Sun Microsystems

2. Sun HPC
Software
Workshop
Sun HPC Software, Developer Edition for OpenSolaris
Why it is important for you
What it is
How it works
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 2

3. Sun HPC
Software
Workshop
Sun HPC Software, Developer Edition for OpenSolaris
Why it is important for you
What it is
How it works
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 3

4. Sun HPC
Software
Workshop
You ...
... are an HPC developer
... have a deadline for an HPC application
... don't have time and resources to set up an HPC
environment
... want to start your application on tens/hundreds of nodes
... plan to deliver the final application/results in weeks not
months or years
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 4

5. Sun HPC
Software
Workshop
Sun HPC Software, Developer Edition for OpenSolaris
Why it is important for you
What it is
How it works
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 5

6. Sun HPC
Software
Workshop
Welcome to the Sun HPC Software, Developer
Edition for OpenSolaris
Virtual Software Appliance
 OpenSolaris based
 Integrated HPC development environment
 Distributed resource management
 Cloud connectivity
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 6

7. Sun HPC
Software
Workshop
Developer Architecture
Developer Components
Virtual Machine Image Amazon Machine Images
(VirtualBox or VMware) (AMIs)
Example Programs HPC Example Programs Development Tools
Sun HPC ClusterTools
Development Tools Sun HPC ClusterTools Sun Studio
DRM SGE/SDM
DRM Sun Grid Engine/Service Domain Manager (SGE/SDM) Operating System
OpenSolaris
Operating System
AMIs under the control of
OpenSolaris Global Zone Local Zone 1 Local Zone 2 Drivers, etc.
OpenVPN, Tun/Tap drivers Amazon EC2 AMI tools
Drivers, etc. Amazon EC2 AMI tools OpenVPN, Tun/Tap drivers
SGE&SDM
Sun Component 3rd Party Open Source or Commercial
Amazon Cloud
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 7

8. Sun HPC
Software
Workshop
Sun HPC Software, Developer Edition for OpenSolaris
Why it is important for you
What it is
How it works
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 8

9. Sun HPC
Software
Workshop
Developer Interface
Amazon EC2 Connectivity via
SDM
DRM (Sun Grid Engine)
Development Tools (Sun Studio&HPC Cluster
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 9

10. Sun HPC
Software
Workshop
Predefined Example
Sun Studio SGE plugin Programs Predefined SGE
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 10

11. Sun HPC
Software
Workshop
Cloud Connectivity via SDM Cloud Adapter
Cloud Connection Initialization
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 11

12. Sun HPC
Software
Workshop
Cloud Connectivity: Initial Setup
No. of cloud based
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 12

13. Sun HPC
Software
Workshop
Cloud Connectivity: Cloud and local zones based hosts
Local Zones based
hosts
Cloud based
hosts
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 13

14. Sun HPC
Software
Workshop
Cloud Connectivity: Amazon EC2 AMIs
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 14

15. Sun HPC
Software
Workshop
Cloud Connectivity: Submit SGE jobs to cloud
Cloud based Parallel
Environment
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 15

16. Sun HPC
Software
Workshop
Cloud Connectivity: SGE Jobs Running in the Cloud
Cloud based Parallel
Job
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 16

17. Sun HPC
Software
Workshop
Cloud Connectivity: SGE Job Results
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 17

18. Sun HPC
Software
Workshop
Take aways
No need for tedious configuration
Turnkey HPC environment ready to go
Focus on creativity, not system management
Easy to use
Ready for cloud
Use it now
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 18

19. Sun HPC
Software
Workshop
How to get started
Product page:
 http://www.sun.com/software/products/hpcsoftware/hpcdev/solaris/index.jsp
Free Download:
 https://www.sun.com/HPCOSDE-1.0
Documentation wiki:
 https://wikis.sun.com/display/hpc/Sun+HPC+Software,
+Solaris+Developer+Edition+1.0
Community page:
 http://www.opensolaris.org/os/project/hpc-stack/
Support by community/Sun HPC SW Engineering:
 hpcdistro-support@opensolaris.org
HPC Developer Community discussion:
 hpcdev-discuss@opensolaris.org
Order free DVDs:
 https://dct.sun.com/dct/forms/reg_us_2406_149_0.jsp
Screencasts:
 http://channelsun.sun.com/video/systems/hpc/1659839071/sun+hpc+develope
r+software+for+opensolaris+screencasts+pt.+1/33387704001
Sun HPC Software Workshop 2009 | Regensburg, Germany | hpcworkshop.com 19

20. HPC Development on OpenSolaris for
Cloud Environments
Bogdan Vasiliu
bogdan.vasiliu@sun.com