[Open infra] how to calculate the cloud system operating rate
1. How to Calculate
the Cloud System Operating Rate
1
Nalee Jang, Consultant of Red Hat Korea
2. 2
About me
IT Expert on the Cloud!
I am a Consultant working with OpenStack and Cloud Platform of Red Hat Korea.
● My Name is NaleeJang.
● I am a Cloud Platform Consultant of Red Hat Korea.
● I was awarded HP Helion MVP(Most Valuable Professional, 2015.06.05) 7 years ago.
● I published 2 books. One of the book is "The Art of OpenStack", and other book is
"Easy Shell Script".
● I also have a patent for system and method for providing cloud market service for
sale contents base on software as a service 7 years ago (2015.09.25).
● I sometimes post my technical experience on my blog(http://naleejang.tistory.com)
● Also I usually use Facebook(http://www.facebook.com/naleejang)
● I was second leader of OpenStack Korea User Group. but I am just a member now.
(http://www.facebook.com/groups/openstack.kr/) (http://www.openstack.or.kr/)
OpenInfra Days Asia 2021
** The Art of OpenStack second edition / 20-May-2017 / Gilbut
*** Easy Shell Script / 1-February-2021 / Hanbit media
3. 3
Motivation of this Session
Agenda
Cloud Virtualization Ratio
Cloud Operating Ratio
OpenInfra Days Asia 2021
4. 4
How to Calculate the Cloud System Operating Rate
➢ What is the Cloud?
➢ Cloud Services
➢ Red Hat Cloud Platforms
➢ Purpose of this Session
Motivation of this Session
OpenInfra Days Asia 2021
5. 5
Motivation of this Session
How to Calculate the Cloud System Operating Rate
What is the Cloud?
Cloud Service
server
storage
network
vm
container
notebook
desktop
smart tv
smart phone
smart pad
Cloud service contains Infra services (IaaS),
platform services (PaaS) and software services
(SaaS). Infra service provides infrastructure such
as server, storage, and network through the
Internet. Platform service provides a
development environment such as a web servers
and databases. Software service provides
applications such as web or apps.
Cloud service can be accessed and used anytime,
anywhere as long as there is a smart device
capable of internet such as a smartphone, smart
pad, desktop, or notebook.
OpenInfra Days Asia 2021
6. 6
Motivation of this Session
How to Calculate the Cloud System Operating Rate
Cloud Services
Cloud technologies Cloud Services
Many companies are providing cloud services using cloud technologies like OpenStack and Kubernetes.
OpenInfra Days Asia 2021
7. 7
Motivation of this Session
How to Calculate the Cloud System Operating Rate
Red Hat Cloud Platforms
Many companies in Asia adopted Red Hat Cloud Platforms like OpenStack and OpenShift for building their cloud services.
OpenInfra Days Asia 2021
8. 8
Motivation of this Session
How to Calculate the Cloud System Operating Rate
Purpose of this Session
Let’s assume cloud system adoption in your company.
How do you calculate sizing when you adopt cloud system?
Do you know about cloud system building steps?
OpenInfra Days Asia 2021
9. 9
How to Calculate the Cloud System Operating Rate
➢ OpenStack and Kubernetes
➢ Virtualization of Cloud Service
➢ Necessary Items
➢ Finding an Efficient
Virtualization Ratio
Cloud Virtualization Ratio
OpenInfra Days Asia 2021
10. 10
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
OpenStack and Kubernetes
VS
OpenStack Kubernetes
OpenInfra Days Asia 2021
12. 12
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
OpenStack and Kubernetes
VS
OpenInfra Days Asia 2021
VM Container
VM VM Container
Container
13. 13
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
OpenStack and Kubernetes
VS
OpenInfra Days Asia 2021
VM Container
VM VM Container
Container
OpenStack - Compute Service for providing Virtual Machine
Normally, OpenStack does not use all cloud resources.
It use some resources of host node by characteristic of created
vm. So for use virtual resources efficiently, resources like cpu set
hyperthread and use higher virtualization ratio.
Kubernetes - Container Service
Kubernetes is open source made by Google for managing
containers.
Container is lighter then vms and has good portability because
application is utilizing kernel of host node. Container can be used
on both bare metal or virtual machine if there is linux OS. So,
Container no consider virtualization. It use resources provides at
host.
14. 14
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
Virtualization of Cloud Service
How can I use
resources efficiently
in OpenStack?
OpenInfra Days Asia 2021
15. 15
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
Necessary Items of Virtualization Ratio
Flavors
Flavor is a spec like cpu, memory, disk
for creating virtual machine.
HW Specs
It means here H/W is openstack
compute node. We need compute
node h/w spec.
Necessary items for finding
virtualization ratio are vm
flavors and compute node
h/w spec.
OpenInfra Days Asia 2021
16. 16
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
An Example of Virtualization Ratio
01 Compute1 Node H/W Spec
Available
Rate
CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
100 % 16 32 64 96 128 512
70 % 11 22 45 67 89 358
02 Compute2 Node H/W Spec
Available
Rate
CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
100 % 40 80 160 240 320 576
70 % 28 56 112 168 224 403
Let's assume hardware
with the following spec.
Compute1
- CPU 16 cores
- Memory 512 GB
Compute2
- CPU 40 cores
- Memory 576 GB
OpenInfra Days Asia 2021
** Most data center keep 70% resource of system.
17. 17
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
An Example for Virtualization Ratio
01 Standard Instance Type
Name CPU Memory
t2.nano 1 0.5
t2.micro 1 1
t2.small 1 2
t2.medium 2 4
t2.large 2 8
t2.xlarge 4 16
t2.2xlarge 8 32
02 Large Memory Instance Type
Name CPU Memory
m1.medium 1 8
m1.large 2 16
m1.xlarge 4 32
m1.2xlarge 8 64
m1.4xlarge 16 128
Flavor is vm spec.
OpenInfra Days Asia 2021
18. 18
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
Finding an Efficient Virtualization Ratio
01 Standard Flavor matrix for finding optimized virtualization ratio
Name CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
t2.nano 11 22 45 67 90 717
t2.micro 11 22 45 67 90 358
t2.small 11 22 45 67 90 179
t2.medium 6 11 22 34 45 90
t2.large 6 11 22 34 45 64
t2.xlarge 3 6 11 17 22 22
t2.2xlarge 1 3 6 8 11 11
Let's calculate the
standard flavor with
compute1
Compute1
- CPU 16 cores
- Memory 512 GB
t2.xlarge 4 16
Flavor
creatable vm count
= available cpu / flavor cpu
= available memory / flavor memory
(16 * 0.7) / 4 = 3
OpenInfra Days Asia 2021
((16*2*4) * 0.7) / 4 = 22
19. 19
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
Finding an Efficient Virtualization Ratio
02 Large Memory Flavor matrix for finding optimized virtualization ratio
Name CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
m1.medium 11.2 22.4 44.8 67.2 89.6 44.8
m1.large 5.6 11.2 22.4 33.6 44.8 22.4
m1.xlarge 2.8 5.6 11.2 16.8 22.4 11.2
m1.2xlarge 1.4 2.8 5.6 8.4 11.2 5.6
m1.4xlarge 0.7 1.4 2.8 4.2 5.6 2.8
m1.2xlarge 8 64
creatable vm count
= available cpu / flavor cpu
= available memory / flavor memory
Flavor
((16*2*2) * 0.7) / 8 = 5.6
OpenInfra Days Asia 2021
(512 * 0.7) / 64 = 5.6
Let's calculate the large
memory flavor with
compute1
Compute1
- CPU 16 cores
- Memory 512 GB
20. 20
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
Finding an Efficient Virtualization Ratio
01 Standard Flavor matrix for finding optimized virtualization ratio
Name CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
t2.nano 28 56 112 67 90 806
t2.micro 28 56 112 67 90 403
t2.small 28 56 112 67 90 202
t2.medium 14 28 56 34 45 101
t2.large 14 28 56 34 45 50
t2.xlarge 7 14 28 17 22 25
t2.2xlarge 3.5 7 14 8 11 13
Let's calculate the
standard flavor with
compute2
Compute2
- CPU 40 cores
- Memory 576 GB
OpenInfra Days Asia 2021
((40*2*2) * 0.7) / 2 = 56
t2.large 2 8
Flavor
(576 * 0.7) / 8 = 50
creatable vm count
= available cpu / flavor cpu
= available memory / flavor memory
21. 21
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
Finding an Efficient Virtualization Ratio
02 Large Memory Flavor matrix for finding optimized virtualization ratio
Name CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
m1.medium 28 56 112 168 224 50.4
m1.large 14 28 56 84 112 25.2
m1.xlarge 7 14 28 42 56 12.6
m1.2xlarge 3.5 7 14 21 28 6.3
m1.4xlarge 1.75 3.5 7 10.5 14 3.15
((40*2) * 0.7) / 8 = 7
m1.2xlarge 8 64
Flavor
(576 * 0.7) / 64 = 6.3
Let's calculate the large
memory flavor with
compute2
Compute2
- CPU 40 cores
- Memory 576 GB
creatable vm count
= available cpu / flavor cpu
= available memory / flavor memory
OpenInfra Days Asia 2021
22. 22
Cloud Virtualization Ratio
How to Calculate the Cloud System Operating Rate
How to find cloud system operating ratio
01 Compute1 Node H/W Spec
Available
Rate
CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
100 % 16 32 64 96 128 512
70 % 11 22 45 67 89 358
02 Compute2 Node H/W Spec
Available
Rate
CPU Cores
CPU
Hyperthread
CPU Rate
2:1
CPU Rate
3:1
CPU Rate
4:1
Memory
100 % 40 80 160 240 320 576
70 % 28 56 112 168 224 403
How do I find cloud
system operating
ratio?
OpenInfra Days Asia 2021
23. 23
How to Calculate the Cloud System Operating Rate
➢ Core Function
➢ Live Migration
➢ Core Items
➢ Finding Cloud System
Operating Ratio
Cloud Operating Ratio
OpenInfra Days Asia 2021
24. 24
Cloud Operating Ratio
How to Calculate the Cloud System Operating Rate
Core Function
OpenStack Live Migration
Kubernetes Drain
OpenInfra Days Asia 2021
25. 25
Cloud Operating Ratio
How to Calculate the Cloud System Operating Rate
What is Live Migration?
Live Migration is migrating live state of a virtual machine(power on state) to
specific other hosts. If we use live migration in OpenStack, shared storage must
use cinder backend like NFS, ISCSI, FC(Fiber Channel) or Ceph Storage.
OpenInfra Days Asia 2021
26. 26
Cloud Operating Ratio
How to Calculate the Cloud System Operating Rate
Core Item for Cloud Operating Ratio
01 Operating ratio list of the example compute node
Rate CPU Cores CPU Hyperthread CPU Rate 2:1 Memory
100 % 40 80 160 576
70 % 28 56 112 403
60 % 24 48 96 346
50 % 20 40 80 288
40 % 18 36 72 259
Let's assume hardware
with the following spec.
Compute
- CPU 40 cores
- Memory 576 GB
OpenInfra Days Asia 2021
27. 27
Cloud Operating Ratio
How to Calculate the Cloud System Operating Rate
Core Item for Cloud Operating Ratio
01 Host operating ratio 02 2 Computes migration case 03 3 Computes migration case 04 4 Computes migration case
100% 70% 60% 50% 45% 45% 45% 60% 60% 70% 70%
Let’s assume we want to migrate single node resources to other compute nodes in case we have 2, 3 ,4 compute nodes.
OpenInfra Days Asia 2021
28. 28
Cloud Operating Ratio
How to Calculate the Cloud System Operating Rate
Finding Cloud System Operating Ratio
Compute count Resource Rate Migration Host Count
2 45 % 1
3 62 % 1
4 70 % 1
5 55 % 2
6 62 % 2
7 66 % 2
8 70 % 2
01 An Example about Cloud System Operating Ratio
Let's see the formula for calculating cloud system
operating ratio
Cloud Resource Rate =
100 - ((Migration Host Count / Total Compute Count * 100) + 5)
This table shows cloud system operating ratio calculated using above formula.
For example,
In the 2 compute node case, we need to keep 45% of compute resources.
because if problem happens, we can migrate 1 node resources to other 1 node.
OpenInfra Days Asia 2021
29. 29
Conclude
Cloud Virtualization Ratio
● OpenStack and Kubernetes have different technical background.
● We need vm flavors and compute node h/w spec for finding efficient virtualization ratio.
● When CPU uses hyperthread, 2:1, 3:1, 4:1 ratios can be achieved. And if we calculate how many vms of given flavor can be created,
you can find CPU virtualization ratio that uses memory efficiently.
Cloud Operating Ratio
● Live migration is core function for finding cloud operating ratio in OpenStack.
● To operate cloud resources efficiency, we need to consider how many compute nodes we will need in case of emergency.
● The formula for finding cloud operating ratio is below.
○ Cloud Resource Rate = 100 - ((Migration Host Count / Total Compute Count * 100) + 5)
Thank you for attending this event "OpenInfra Days Asia 2021"
OpenInfra Days Asia 2021