Hyper-V.nu meeting 16-04-2013, NIC teaming and Converged Fabric, Marc van Eijk

1. NIC Teaming & Converged Fabric

2. Hyper-V | Private Cloud | Hosted Cloud
www.hyper-v.nu
Marc van Eijk @_marcvaneijk
DUVAK

3. Agenda
Quality of System Center
NIC Teaming Designs
Service VMM 2012 SP1

4. NIC Teaming

5. Windows Server 2008 R2
Dedicated Network
Live Migration
Management
VM VM
Storage
Cluster
Hyper-V Switch
1Gb 1Gb 1Gb 1Gb 1Gb 1Gb 1Gb 1Gb 1Gb 1Gb
MPIO

6. Windows Server 2012
Members Connect Distribute Combine

7. NIC Teaming team members
Team NICs Virtual NICs
vNIC
Management VLAN 100
Live Migration
Cluster VM VM
Hyper-V Switch
tNIC tNIC
VLAN 200 VLAN 100
tNIC tNIC
tNIC
NIC Team Default
VLAN 100
NIC Team Default
mode Mode
Physical Physical
NIC NIC
Requirements
Ethernet
Windows Logo

8. NIC Teaming Connection Modes
Switch Independent Switch Dependent LACP
MAC MAC MAC
LACPDUs
LACP priority
System MAC
address
Port LACP priority
Port number
Operational key

9. NIC Teaming Load distribution modes
Address Hash HyperVPort
D-VMQ
TransportPorts
Source and destination
TCP ports and IP addresses NIC Team
IPAddresses Hyper-V Switch
Source and destination IP
NIC Team
addresses
mgmtOS VM
MacAddresses
Source and destination
MAC addresses

10. Matrix
Native Teaming / Hyper-V Switch
Switch Independent /
Address Hash
• Native mode teaming
with switch diversity Management
• Active / Standby
• Teaming in a VM Live Migration
• Workloads with heavy
outbound / light Cluster VM VM
inbound
Hyper-V Switch
NIC Team NIC Team
MAC MAC

11. Matrix
Native Teaming / Hyper-V Switch
Switch Independent / Switch Independent /
Address Hash HyperVPort
• Native mode teaming • Maximum use of Virtual
with switch diversity Machine Queues Management
• Active / Standby (VMQs)
• Teaming in a VM • More VMs than team Live Migration
• Workloads with heavy members
outbound / light • If VM bandwidth max Cluster VM VM
inbound one NIC is enough
Hyper-V Switch
NIC Team NIC Team
MAC MAC

12. Matrix
Native Teaming / Hyper-V Switch
Switch Independent / Switch Independent /
Address Hash HyperVPort
• Native mode teaming • Maximum use of Virtual
with switch diversity Machine Queues Management
• Active / Standby (VMQs)
• Teaming in a VM • More VMs than team Live Migration
• Workloads with heavy members
outbound / light • If VM bandwidth max Cluster VM VM
inbound one NIC is enough
Switch Dependent / Hyper-V Switch
Address Hash
NIC Team NIC Team
• Native teaming with
maximum performance
and no switch diversity
• One VM needs more
bandwidth than one
team member
MAC MAC

13. Matrix
Native Teaming / Hyper-V Switch
Switch Independent / Switch Independent /
Address Hash HyperVPort
• Native mode teaming • Maximum use of Virtual
with switch diversity Machine Queues Management
• Active / Standby (VMQs)
• Teaming in a VM • More VMs than team Live Migration
• Workloads with heavy members
outbound / light • If VM bandwidth max Cluster VM VM
inbound one NIC is enough
Switch Dependent / Switch Dependent / Hyper-V Switch
Address Hash HyperVPort
NIC Team NIC Team
• Native teaming with • Company policy
maximum performance requires LACP
and no switch diversity • More VMs than team
• One VM needs more members
bandwidth than one • If VM bandwidth max
team member one NIC is enough
MAC MAC

14. Matrix
Native Teaming / Hyper-V Switch
Switch Independent /
HyperVPort
• Maximum use of Virtual
Machine Queues Management
(VMQs)
• More VMs than team Live Migration
members
• If VM bandwidth max Cluster VM VM
one NIC is enough
Switch Dependent / Hyper-V Switch
Address Hash
NIC Team NIC Team
• Native teaming with
maximum performance
and no switch diversity
• One VM needs more
bandwidth than one
team member

15. NIC Teaming in a VM
Guest teaming
Modes
VM
Switch Independent
Address Hash
NIC Team
VF VF Support / Limit
Maximum 2 vNICs
External Switch
MAC
Hyper-V Switch Hyper-V Switch
SRIOV SRIOV
Physical Physical
NIC NIC

16. NIC Teaming Powershell
Get-Command -Module NetLbfo
New-NetLbfoTeam Team1 NIC1,NIC2 -TeamingMode LACP
LoadBalancingAlgorithm HyperVPorts
• SwitchIndependent
• Static
• LACP
• TransportPorts
• IPAddresses
• MacAddresses
• HyperVPort
Add-NetLbfoTeamMember NIC1 Team1 (Add physical NIC to Team1
Add-NetLbfoTeamNIC Team1 83 (Add TeamNIC to Team1 with vlan id 83)

17. NIC Teaming Demo
Management Failover Cluster Management
Live Migration Live Migration
Cluster VM VM Cluster VM VM
Hyper-V Switch Hyper-V Switch
NIC Team NIC Team NIC Team NIC Team NIC Team NIC Team

18. Quality of Service

19. Hyper-V Switch & Quality of Service
• Weight (Default)
• Absolute (bits per second)
Hyper-V Switch • None
New-VMSwitch "VSwitch" -MinimumBandwidthMode Weight $false
-NetAdapterName "Team" -AllowManagementOS 0
Management
-DefaultFlowMinimumBandwidthAbsolute
VLAN VLAN
Live Migration ID 58 ID 63 Set-VMSwitch "VSwitch" -DefaultFlowMinimumBandwidthWeight 50
Add-VMNetworkAdapter -ManagementOS -Name "Management" -SwitchName "VSwitch"
Cluster VM VM
Add-VMNetworkAdapter -ManagementOS -Name "Live Migration" -SwitchName "VSwitch"
Add-VMNetworkAdapter -ManagementOS -Name "Cluster" -SwitchName "VSwitch"
10 30 10 50
Hyper-V Switch
Set-VMNetworkAdapter -ManagementOS -Name "Management" -MinimumBandwidthWeight 10
Set-VMNetworkAdapter -ManagementOS -Name "Live Migration" -MinimumBandwidthWeight 30
Set-VMNetworkAdapter -ManagementOS -Name "Cluster" -MinimumBandwidthWeight 10
NIC Team
Set-VMNetworkAdapterVlan -ManagementOS -VMNetworkAdapterName
"Management" -Access -VlanId 10
Set-VMNetworkAdapterVlan -ManagementOS -VMNetworkAdapterName
"Live Migration" -Access -VlanId 11
Set-VMNetworkAdapterVlan -ManagementOS -VMNetworkAdapterName
"Cluster" -Access -VlanId 12

20. Hyper-V Switch & Quality of Service
Hyper-V Switch QoS guidelines
Default Flow and VMs Total Weight = 100
Management
VLAN VLAN
Live Migration ID 58 ID 63 Set-VMSwitch "VSwitch" -DefaultFlowMinimumBandwidthWeight 50
Cluster VM VM
10 30 10 50
Hyper-V Switch
Set-VMNetworkAdapter -ManagementOS -Name "Management" -MinimumBandwidthWeight 10
Set-VMNetworkAdapter -ManagementOS -Name "Live Migration" -MinimumBandwidthWeight 30
Set-VMNetworkAdapter -ManagementOS -Name "Cluster" -MinimumBandwidthWeight 10
NIC Team
Critical workloads Gap weights

21. Quality of Service
Absolute Weight
Default Flow [50] 5
90 / 40 * 10 = 22,5
Available Bandwidth
Management [10] 90
Cluster [10] 5
Default Flow [BPS]
Available Weight
Management 40
Cluster
90 / 40 * 30 = 67,5
Live Migration Live Migration [30]

22. Quality of Service
Absolute Weight
Default Flow [BPS]
Management
Cluster
Default Flow [50]
Management [10]
Cluster [10]
Live Migration Live Migration [30]

23. Quality of Service Demo
Management 90 Failover Cluster Management
Live Migration VM VM Live Migration
Cluster VM VM Cluster VM VM
10
Hyper-V Switch Hyper-V Switch Hyper-V Switch
LACP LACP
HyperVPort Address Hash
NIC Team NIC Team NIC Team NIC Team

24. Designs

25. Upgrade with existing hardware
Windows Server 2008 R2 Windows Server 2012
Cluster
VM VM Management VM VM
Hyper-V Live
Management Cluster Hyper-V Switch Live Migration
Switch Migration
NIC Team NIC Team NIC Team NIC Team NIC Team NIC Team

26. Converged
Single Team VMs isolated
Management
Management
Cluster
Live Migration
Live Migration
Cluster VM VM VM VM VM
Hyper-V Switch Hyper-V Switch Hyper-V Switch
NIC Team NIC Team NIC Team
DCB
Datacenter Bridging

27. ISCSI
MPIO MPIO Dedicated Switches
Management
VM MPIO
Live Migration
Cluster VM VM Management
ISCSI Live Migration ISCSI
MPIO
MPIO
ISCSI Cluster ISCSI
Hyper-V Switch Hyper-V Switch Hyper-V Switch
NIC Team NIC Team NIC Team

28. SMB 3.0
NIC Teaming & SMB 3.0
Management
Live Migration
Cluster VM VM
Hyper-V Switch
NIC Team NIC Team NIC Team
SMB 3.0 RDMA
Multichannel Hardware
RSS

29. System Center VMM 2012 SP1
Existing hosts Bare Metal Deployment
Management
Live Migration
Management
Live Migration
Cluster
Cluster VM VM VM VM VM
Hyper-V Switch Hyper-V Switch Hyper-V Switch
NIC Team NIC Team NIC Team
Logical Switch Logical Switch Logical Switch

30. Many, many thanks to: