January 2009 New England VMUG at Gillette presentation

1. AMD Opteron™: Driving Optimal
Virtualization with VMware ESX

2. Virtualization Solutions
Consolidate Resources – increase server Virtual Virtual
Machine Machine
utilization while reducing energy consumption
Enhance Business Continuity – enable
Server Virtualization
application isolation and fail-over capabilities
Partitions a computer into
virtual machines that can
Legacy Software Support – legacy software each run their own OS and
can run on newer, power efficient hardware applications
Consolidate Resources – streamline the
deployment and management of clients Client
Client Client
Session
Session Session
Enhance Security – applications and data are
centralized for tighter control Presentation Virtualization
Enables applications or
Reduce Client Infrastructure Cost – cost desktop to be hosted on
server and streamed
efficient client hardware/management alternative
to clients

3. Evolving x86 Processor for Virtualization
AMD is driving architectural and instruction set enhancements to
reduce overhead and complexity of virtualization
64-bit Dual-Core Quad-Core Six-Core*
Memory
Addressing
Hardware Hardware World Switch
Extensions Extensions and RVI*
Integrated
(AMD-V) (RVI) Performance
Memory
Tuning
Controller Large Page
Tagged TLB Tables
I/O
Extended Virtualization*
Migration
*Planned features for future AMD Opteron™ processor-based systems
3

4. Achieving Scalable Virtualization
Efficient Virtualization needs more than just a good core
architecture - it needs a great system design
• Low Latency / High Bandwidth
Memory interconnect
−
I/O interconnect
−
Core Interconnect
−
• Efficient Cache Architecture
• Optimized Multi-Core and
Execution Units
• Software Optimization
These factors enable efficiency and scalability

5. Virtualization is CPU and Memory Intensive
AMD’s Direct Connect Architecture delivers dedicated
memory access and better scalability
• Helps improve application
The image cannot be display ed. Your computer may not The image cannot be display ed. Your computer may not
hav e enough memory to open the image, or the image hav e enough memory to open the image, or the image
may hav e been corrupted. Restart y our computer, and may hav e been corrupted. Restart y our computer, and
then open the file again. If the red x still appears, y ou then open the file again. If the red x still appears, y ou
may hav e to delete the image and then insert it again. may hav e to delete the image and then insert it again.
The image cannot be display ed. Your computer may not
The image cannot be display ed. Your computer may not The image cannot be display ed. Your computer may not
The image cannot be display ed. Your computer may not
hav e enough memory to open the image, or the image
hav e enough memory to open the image, or the image hav e enough memory to open the image, or the image
may hav e been corrupted. Restart y our computer, and hav e enough memory to open the image, or the image
may hav e been corrupted. Restart y our computer, and may hav e been corrupted. Restart y our computer, and
performance within a
then open the file again. If the red x still appears, y ou may hav e been corrupted. Restart y our computer, and
then open the file again. If the red x still appears, y ou then open the file again. If the red x still appears, y ou
may hav e to delete the image and then insert it again. then open the file again. If the red x still appears, y ou
may hav e to delete the image and then insert it again. may hav e to delete the image and then insert it again.
may hav e to delete the image and then insert it again.
The image cannot be display ed. Your computer may not
The image cannot be display ed. Your computer may not
hav e enough memory to open the image, or the image
hav e enough memory to open the image, or the image
may hav e been corrupted. Restart y our computer, and
may hav e been corrupted. Restart y our computer, and
then open the file again. If the red x still appears, y ou
then open the file again. If the red x still appears, y ou
may hav e to delete the image and then insert it again. The image cannot be The image cannot be
The image cannot be The image cannot be The image cannot be The image cannot be
The image cannot be The image cannot be
may hav e to delete the image and then insert it again.
display ed. Your display ed. Your
display ed. Your display ed. Your display ed. Your display ed. Your
display ed. Your display ed. Your
computer may not computer may not
computer may not computer may not computer may not computer may not
computer may not computer may not
hav e enough hav e enough
hav e enough hav e enough hav e enough hav e enough
hav e enough hav e enough
memory to open the memory to open the
memory to open the memory to open the memory to open the memory to open the
memory to open the memory to open the
image, or the image image, or the image
image, or the image image, or the image image, or the image image, or the image
image, or the image image, or the image
may hav e been may hav e been
may hav e been may hav e been may hav e been may hav e been
may hav e been may hav e been
corrupted. Restart corrupted. Restart
corrupted. Restart corrupted. Restart corrupted. Restart corrupted. Restart
corrupted. Restart corrupted. Restart
y our computer, and y our computer, and
virtual machine
y our computer, and y our computer, and y our computer, and y our computer, and
y our computer, and y our computer, and
then open the file then open the file
then open the file then open the file then open the file then open the file
then open the file then open the file
again. If the red x again. If the red x
again. If the red x again. If the red x again. If the red x again. If the red x
again. If the red x again. If the red x
still appears, y ou m… still appears, y ou m…
still appears, y ou m… still appears, y ou m… still appears, y ou m… still appears, y ou m…
still appears, y ou m… still appears, y ou m…
2MB L3 Cache
2MB L3 Cache
SRQ
SRQ
• Enables a Tagged TLB
Crossbar Switch
Crossbar Switch
HT
HT DDR2
DDR2
means more efficient
RDDR2 RDDR2
The image cannot be display ed. Your computer may not The image cannot be display ed. Your computer may not
hav e enough memory to open the image, or the image hav e enough memory to open the image, or the image
may hav e been corrupted. Restart y our computer, and may hav e been corrupted. Restart y our computer, and
switching between virtual
then open the file again. If the red x still appears, y ou then open the file again. If the red x still appears, y ou
may hav e to delete the image and then insert it again. may hav e to delete the image and then insert it again.
The image cannot be display ed. Your computer may not
The image cannot be display ed. Your computer may not The image cannot be display ed. Your be display ed. Your computer may not
The image cannot computer may not
hav e enough memory to open the image, or the image
hav e enough memory to open the image, or the image hav e enough memory e enough memory to open the image, or the image
hav to open the image, or the image
may hav e been corrupted. Restart y our computer, and
may hav e been corrupted. Restart y our computer, and may hav e been corrupted. Restart y our computer, and our computer, and
may hav e been corrupted. Restart y
then open the file again. If the red x still appears, y ou
then open the file again. If the red x still appears, y ou then open the file again.open the file still appears, y ou x still appears, y ou
then If the red x again. If the red
may hav e to delete the image and then insert it again.
may hav e to delete the image and then insert it again. may hav e to deletemay image to delete the image and then insert it again.
the hav e and then insert it again.
The image cannot be display ed. Your computer may not
hav e enough memory to open the image, or the image The image cannot be display ed. Your computer may not
may hav e been corrupted. Restart y our computer, and hav e enough memory to open the image, or the image
may hav e been corrupted. Restart y our computer, and
then open the file again. If the red x still appears, y ou
then open the file again. If the red x still appears, y ou
may hav e to delete the image and then insert it again. The image cannot be The image cannot be
The image cannot be The image cannot be The image cannot be The image cannot be
The image cannot be The image cannot be may hav e to delete the image and then insert it again.
display ed. Your display ed. Your
display ed. Your display ed. Your display ed. Your display ed. Your
display ed. Your display ed. Your
computer may not computer may not
computer may not computer may not computer may not computer may not
machines
computer may not computer may not
hav e enough hav e enough
hav e enough hav e enough hav e enough hav e enough
hav e enough hav e enough
memory to open the memory to open the
memory to open the memory to open the memory to open the memory to open the
memory to open the memory to open the
image, or the image image, or the image
image, or the image image, or the image image, or the image image, or the image
image, or the image image, or the image
may hav e been may hav e been
may hav e been may hav e been may hav e been may hav e been
may hav e been may hav e been
corrupted. Restart corrupted. Restart
corrupted. Restart corrupted. Restart corrupted. Restart corrupted. Restart
corrupted. Restart corrupted. Restart
y our computer, and y our computer, and
y our computer, and y our computer, and y our computer, and y our computer, and
y our computer, and y our computer, and
then open the file then open the file
then open the file then open the file then open the file then open the file
then open the file then open the file
again. If the red x again. If the red x
again. If the red x again. If the red x again. If the red x again. If the red x
again. If the red x again. If the red x
still appears, y ou m… still appears, y ou m…
still appears, y ou m… still appears, y ou m… still appears, y ou m… still appears, y ou m…
still appears, y ou m… still appears, y ou m…
2MB L3 Cache
2MB L3 Cache 8 GB/S
• Hardware-based memory
SRQ
SRQ
Crossbar Switch
Crossbar Switch
management and security
HT
HT DDR2
DDR2
can improve overall
The image cannot be
display ed. Your computer The image cannot be
may not hav e enough display ed. Your computer
memory to open the may not hav e enough
image, or the image ma memory to open the
image, or the image m
virtualization performance
PCIe ®
and efficiency
PCIe®
& IO
Hub
Hub

6. Delivering Optimal Virtualization
Quad-Core AMD Opteron™ processor delivers unique
functionality that can help reduce complexity and
improve performance of virtualized environments
The image cannot be display ed. Your computer may not hav e enough memory to open the image, or the image may hav e been corrupted. Restart y our computer, and then open the file again. If the red x still appears, y ou may hav e to delete the image and then insert it again.
AMD-V™ technology with Rapid
Virtualization Indexing (RVI)
• Enhanced application performance
using hardware-based virtual
memory management
Tagged TLB
• Delivers fast and efficient switching
between virtual machines
Extended Migration
• Ability to migrate live virtual
machines across the generations of
AMD Opteron™ processors
6

7. Optimal Virtualization with
Quad-Core AMD Opteron Processors
Business Value
AMD Features
Scalability that seamlessly handles
heavy workloads and improves
Direct Connect Architecture
resource utilization
Increased performance through
AMD-V™ with Rapid superior memory management to
Virtualization Indexing (RVI) drive demanding virtualized workloads
Improved efficiency for multi-
AMD Balanced Smart Cache threaded virtualization environments
Investment Protection by enabling
live migration of VMs across entire
Extended Migration
family of AMD Opteron processors
Enhanced I/O by direct device
AMD-V I/O Virtualization assignments and improved security
(planned) through hardware isolation of VMs

8. Understanding AMD-V™
Rapid Virtualization Indexing
• Provides significant
With Virtualization
VM1 VM2
performance advantages for
Virtual Memory 2
Virtual Memory 1
specific workloads
− Memory Intensive Workloads
− Workloads with large I/O characteristics
• Sample Workloads that benefit
Physical Memory
from RVI
− Most 64-bit Virtual Machines
Rapid − Database
Shadow Page
Virtualization − Terminal Services/Citrix
Tables
Indexing − Web Server
− Compile Jobs
The image cannot be display ed. Your computer may not hav e enough memory to open the image, or the image may hav e been corrupted. Restart y our computer, and then open the file again. If the red x still appears, y ou may hav e to delete the image and then The image cannot be display ed. Your computer may not hav e enough memory to open the image, or the image may hav e been corrupted. Restart y our computer, and then open the file again. If the red x still appears, y ou may hav e to delete the image and then
insert it again. insert it again.
Software Hardware
• Performance improvement will
(in Hypervisor) (in CPU silicon) vary by virtualization solution
and workload
The image cannot be display ed. Your computer may not hav e enough memory to open the image, or the image may hav e been corrupted. Restart y our computer, and then open the file again. If the red x still appears, y ou may hav e to delete the image and then The image cannot be display ed. Your computer may not hav e enough memory to open the image, or the image may hav e been corrupted. Restart y our computer, and then open the file again. If the red x still appears, y ou may hav e to delete the image and then
insert it again. insert it again.
Virtual Memory Hardware
• VMware ESX 3.5u1 fully
(Guest TLB & TLB)
(DRAM)
supports RVI

10. Putting Virtualization to Work
AMD IT has implemented VMWare
ESX as a virtualization solution
AMD Austin Virtualization Environment
50 Swing
VMs
Capacity
to add 85 300
VMs
active
VMs
79%
power savings
9 Servers plus 2 in Austin Data
Swing Servers Center

11. Migrating Virtual Machines
Migration is the ability to Virtual
Machine
move a virtual machine
Virtual
(VM) from one physical Virtual Machine
Machine
host to another Virtual
Machine
VM migration is used for
server upgrades, load
Virtual
Machine
balancing, high-
Virtual
Virtual
Machine
availability solutions,
Machine
and disaster recovery
solutions
Cold Migration VM is suspended then moved
Live Migration VM is moved while running
1
1

12. AMD Extended Migration Technogy
AMD Extended Migration* is a hardware extension that
enables virtualization software vendors to provide Live
Migration capabilities between ALL available AMD
processors generations
AMD Extended Migration enables:
• Flexibility to create one or more Virtualization Pools across
all your AMD Opteron™ processor based servers
• Provides comprehensive support for live migration between
single, dual and quad-core processor based platforms
AMD Opteron™ Processor Family Full VMotion
support
• 200 & 800 Series between all
• 1200, 2200, 8200 Series AMD Opteron
Processors
• 1300, 2300 & 8300 Series
*Supported with ESX 3.5 update 2

13. AMD Opteron Processor Support for VMware
Enhanced Vmotion Compatibility
2005 2007
2006
2003 2008 2009 2010
“Magny-Cours”
Rev E
Rev E
“Sao Paulo”
Dual-core
1st Generation Platform Maranello
Socket 940
“Istanbul”
“Shanghai”
“Barcelona”
Rev F
2nd Generation Platform Socket F (1207)
Full Vmotion support between all
available AMD Opteron Processors
(back to 2003)
Intel FlexMigratoin begins
with Merom (Woodcrest) in 2007

14. VMotion CPU Compatibility Matrix in ESX 3.5U2
Intel® Xeon® CPUs allowed
AMD Opteron™ CPUs
in an EVC cluster
allowed in an EVC Cluster
First Generation AMD Opteron™ based CPUs
Merom based CPUs
Quad-Core AMD Opteron™ Model 285, 290 (Troy, Italy),
Intel® Xeon® Processor 7000 series
885, 890 (Athens, Egypt)
E7210, E7220, E7310, E7320, E7330, E7340, L7345,
X7350 (Tigerton)
Second Generation AMD Opteron™ based CPUs
Intel® Xeon® Processor 5000 series
Quad-Core AMD Opteron™ Model 1210 HE, 1212 HE,
5110, 5120, 5128, 5130, 5138, 5140, 5148, 5150, 5160
1214 HE, 1216 HE, 1218 HE, 1212, 1214, 1216, 1218,
(Woodcrest)
1220, 1222, 1220 SE, 1222 SE, 1224 SE (Santa Ana)
E5310, L5310, E5320, L5320, E5335, L5335, E5345,
Quad-Core AMD Opteron™ Model 1352 2210 HE, 2212
x5355, x5365 (Clovertown)
HE, 2214 HE, 2216 HE, 2218 HE, 2210, 2212, 2214,
Intel® Xeon® Processor 3000 series
2216, 2218, 2220, 2222, 2220 SE, 2222 SE 2224 SE,
3040, 3050, 3060, 3065, 3070, 3075, 3085 (Conroe)
Quad-Core AMD Opteron™ Model 1352 8212 HE, 8214
x3210, x3220, x3230 (Kentsfield)
HE, 8216 HE, 8218 HE, 8212, 8214, 8216, 8218, 8220,
8222, 8220 SE, 8222 SE, 8224 SE (Santa Rosa)
Penryn based CPUs
Intel® Xeon® Processor 7000 series
Third Generation AMD Opteron™ based CPUs.
x7470, E7459, E7440, E7430, E7420, L7455, L7445
Quad-Core AMD Opteron™ Model 1352, 1354,
(Dunnington)
1356(Budapest)
Intel® Xeon® Processor 5000 series
Quad-Core AMD Opteron™ Model 2344 HE, 2346 HE,
E5205, L5238, X5260, X5272 (Wolfdale)
2347 HE, 2350, 2352, 2354, 2356, 2358 SE, 2360 SE
E5405, E5410, L5410, E5420, L5420, E5430, E5440,
Quad-Core AMD Opteron™ Model 8346 HE, 8347 HE,
E5450, X5405, X5460, E5462, E5472, X5472, X5482
8350, 8354, 8356, 8358 SE, 8360 SE (Barcelona)
(Harpertown)
Intel® Xeon® Processor 3000 series
E3110 (Wolfdale)
X3320, X3350, X3360 (Yorkfield)
http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1003212

15. AMD I/O Virtualization Supports VMware
VMDirectPath
AMD’s IOMMU technology is supported by VMware’s VMDirectPath for
Direct Device Assignment (pass-thru)
Delivers a high performance, scalable model for Dynamic Direct
Device Assignment for I/O Virtualization to the industry
IOMMU support planned for AMD Fiorano platform with AMD SR5690
and SR5670 chipsets
Provides Address Translation and Memory Protection
– Restricts I/O devices to access only memory allowed
– Increase I/O efficiency through direct assignment of I/O device to
VM
– Reduces hypervisor intervention by sharing address space between
VM and I/O device
Provides Interrupt remapping to efficiently route and block
interrupts
– Supports new PCI-SIG I/O Virtualization (IOV) specifications

16. Benefits Of An IOMMU
Direct Device Assignment Example
Improved performance and scalability
Enables direct device access by user mode applications
Guest OS Guest OS Guest OS Guest OS
Virtual Device Virtual Device
Device Driver Device Driver
Driver Driver
Overhead
reduced in
Virtual
Virtual Device Emulator
path
Machine
between
Monitor
Guest and
Device Driver Device Driver
Device
IOMMU
Virtual Machine
Monitor
Device Device Device Device
Controller Controller Controller Controller

17. Benefits Of An IOMMU
Enhanced security capabilities
– Adds precise device access control of address space
– Ensures isolation between devices, protects system memory from errant
device writes
System Memory
System Memory Protection Protection
Domain 1 Domain 2
I/O Buffer
I/O Buffer
I/O Buffer I/O Buffer
IOMMU
X
Malicious or
Errant Write is
Write blocked
Device Device Device Device
Controller Controller Controller Controller
17

18. VMware ESX Support for AMD-V™ Features
Release PowerNow! AMD-V AMD-V RVI Live
Status (Barcelona) Migration
Product Support (Rev F)
VMware Workstation (wkstn & client) Released Through Host OS No (Yes Rev G) Yes (Phenom) No
Vmware ESX Server 3.0.x Released No No No Restrictions
VMWare ESX Server 3.5u2 Planned No Yes Yes Yes
VMWare ESXi (embedded version) Released No Yes Yes Yes
VMware ESX next generation (K/L) Planned K/L+ Yes Yes Yes
CONFIDENTIA
L”

19. The flexibility to do more with your
server infrastructure
Optimized to Unified
Cost-effective
help you get management of
virtualization
the most from physical and
server and virtual
client resources machines
Solid business
foundation for all
Cost-effective
your applications
Virtualization
Designed to Increases
ease transitions hardware
while securing utilization and
and protecting helps cut
investments power costs

20. Trademark Attribution
AMD, the AMD Arrow logo and combinations thereof are trademarks of Advanced Micro Devices,
Inc. in the United States and/or other jurisdictions. Other names used in this presentation are for
identification purposes only and may be trademarks of their respective owners.
©2008 Advanced Micro Devices, Inc. All rights reserved.