Access to hardware for AI/ML for the everyday developer wanting to explore this field can be challenging to obtain and maintain for even the most rudimentary applications and testing. Needing to go beyond a single development machine running locally only increases this. OpenLab is curated infrastructure accessible to open source projects and individuals working within and on open source projects designed to help address this use case. Access to GPU, FPGA, IoT, and more, allows HPC, AI/ML, Deep Learning, or other testing and applications. In this presentation, we will walk through getting an account with OpenLab, obtaining resources, and getting a neural network up and running with an app that will bring back great childhood memories.
3. Agenda
What is OpenLab
How to Access Resources
Using OpenLab is Easy
Simple Neural Network
Getting Involved
4. What is OpenLab
How to Access Resources
Using OpenLab is Easy
Simple Neural Network
Getting Involved
5. What is OpenLab
• Open Source solution stack verification platform
created by the community for the community
• “…a set of tools and a community of individuals
and partners working to uncover “LAMP” stacks
for the Cloud and AI era.”
• Launched November 2017 during Sydney Summit
6. What is OpenLab
• OpenStack
• Terraform
• CloudFoundry
• K8s
OpenLab 1.0 - Multi/Hybrid Cloud
• CloudNative - Istio, KubeFlow, Knative, K8s, Spark
• AI - Tensorflow, Kubeflow, Docker, CHIP
• Cloud Service Aggregation - OpenServiceBroker, Operator Framework
OpenLab 2.0 - CloudNative, AI, Cloud Service Aggregation
7.
8.
9. What is OpenLab
• OpenStack
• Terraform
• CloudFoundry
• K8s
OpenLab 1.0 - Multi/Hybrid Cloud
• CloudNative - Istio, KubeFlow, Knative, K8s, Spark
• AI - Tensorflow, Kubeflow, Docker, CHIP
• Cloud Service Aggregation - OpenServiceBroker, Operator Framework
OpenLab 2.0 - CloudNative, AI, Cloud Service Aggregation
10. What is OpenLab
• Solve the problem of baseline integration for open source
• Foster and facilitate cross community collaboration
• Speed up the time to value of open source projects
• Available to anyone, anytime, anywhere
Benefits of OpenLab
• "Stack" of projects identified for use case
• Community hardware, software, people, test cases submitted/identified
• Testing happens, reports are generated, OpenLab publishes
• Feedback from OpenLab is utilized by various stakeholders to further a stacks key metrics
including but not limited to usability, performance, and reliability.
General Workflow
11. What is OpenLab
How to Access Resources
Using OpenLab is Easy
Simple Neural Network
Getting Involved
12. How to
Access
Resources
Visit https://bit.ly/openlab-request
Request is reviewed and eventually approved/denied
• Additional questions if request is unclear
• Validate request details
• Ensure resources are available
OpenLab Dev/Ops team makes resources available
Resources handed over to requestor
Testing by requestor
Resources returned to pool after testing
Agreed publishing of results
13. What is OpenLab
How to Access Resources
Using OpenLab is Easy
Simple Neural Network
Getting Involved
14. Using
OpenLab is
Easy
CI/CD
• OpenLab hosted - Zuul
• Non-OpenLab hosted
• limited availability
Virtual
• Virtual Machines
• Containers
• SDN
IRL
• Single tenant
• Root Access (IPMI+)
• Network, Wireless, IoT
15. Using
OpenLab is
Easy
Zuul
• Ansible...nuff said
• Very reliable and performant
• OSF Confirmed Project
• Significant user base
Cloud Providers
• Virtual Machines and Containers
• Low or no touch provisioning
• Feature rich
Testbeds
• Stable pool of resources
• Global footprint
• Flexible configurability
• Dependable partnerships
16. Using
OpenLab is
Easy
Open an Issue
• https://bit.ly/openlab-request
• Wait for approval and resource hand over
App Catalog
• ChameleonCloud
• Heat or OSB via OpenStack or CloudFoundry Deployment
JACKS
• CloudLab
• GENI
CLI accessible
• Create your own tools
• Use existing libraries
• Augment and upstream
17. Using
OpenLab is
Easy –
CI|CD
Create request (we consider CI a testing
request)
Define job(s) in a
zuul.yaml|zuul.d|.zuul.yaml|.zuul.d location
Install the app (Github)
Let’s setup a project right now!
18. Using
OpenLab is
Easy -
Catalog
Create a request
We create you a subaccount with our partner
Login to your account
Visit the catalog https://www.chameleoncloud.org/appliances/
Click the appliance you’d like to deploy
Click the Launch @... Button
Ok, let’s do it
19. Using
OpenLab is
Easy -
JACKS
Create a request (yes, this is always the first step)
We create you a subaccount with our partner
Login to your account
Create a profile - https://www.cloudlab.us/manage_profile.php
Click on Create Topology
Layout and configure your resources in the editor
Save and instantiate
Ok, let’s do it
20.
21. What is OpenLab
How to Access Resources
Using OpenLab is Easy
Simple Neural Network
Getting Involved
25. Neural Networks
• Many, many…did I say
many types of NN
• https://bit.ly/chart-
of-neural-networks
• Input, Hidden, Output
• Connections, Weight, and
Bias – Sounds pretty
human to me?
26.
27.
28. What is OpenLab
How to Access Resources
Using OpenLab is Easy
Simple Neural Network
Getting Involved
29. Getting Involved
• Become an OpenLab Organization Member
• https://bit.ly/openlab-membership
• Implement Testing
• Write test cases within project repo
• Utilize OpenLab job definitions
• Request help implementing testing
• Integrate OpenLab
• Gerrit or Git based projects
• Build drivers for other VCSs
• Get test results and iterate on code
• Contact
• https://bit.ly/openlab-get-started
• https://openlab.groups.io
• Twitter: @askopenlab
• IRC: #askopenlab
30. QA and References
• Become an OpenLab Organization Member
• https://bit.ly/openlab-membership
• Understanding Neural Networks
• https://bit.ly/neural-networks-and-
backpropagation
• Type of Neural Networks
• https://bit.ly/chart-of-neural-networks
• Training a Neural Network to Play Snake
• https://www.youtube.com/watch?v=zIk
BYwdkuTk
• OpenLab - https://openlabtesting.org
• Documentation
• https://docs.openlabtesting.org
• Contact
• https://bit.ly/openlab-get-started
• https://openlab.groups.io
• Twitter: @askopenlab
• IRC: #askopenlab