Includes other development updates, aka NUMA, FreeBSD, Xen and Libvirt. Xen 4.3 was the first release with our new "release coordinator" role during the whole development cycle. This talk will review some ways in which the process worked well for 4.3, and some ways it could have been better, and then go on to talk about the 4.4 release.

1. Intro
OSS Development
Xen 4.3
Xen Development update
George Dunlap
Edinburg – 21-23 October, 2013
Xen 4.4
Updates

2. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Overview
Principles of OSS Development
Edinburg – 21-23 October, 2013
Xen Development update
2 / 24

3. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Overview
Principles of OSS Development
Xen development process
Edinburg – 21-23 October, 2013
Xen Development update
2 / 24

4. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Overview
Principles of OSS Development
Xen development process
Review of 4.3 development process
Edinburg – 21-23 October, 2013
Xen Development update
2 / 24

5. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Overview
Principles of OSS Development
Xen development process
Review of 4.3 development process
4.4 development: Plans and predictions
Edinburg – 21-23 October, 2013
Xen Development update
2 / 24

6. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Overview
Principles of OSS Development
Xen development process
Review of 4.3 development process
4.4 development: Plans and predictions
Project updates
Edinburg – 21-23 October, 2013
Xen Development update
2 / 24

7. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Overview
Principles of OSS Development
Xen development process
Review of 4.3 development process
4.4 development: Plans and predictions
Project updates
EFI
Edinburg – 21-23 October, 2013
Xen Development update
2 / 24

8. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Overview
Principles of OSS Development
Xen development process
Review of 4.3 development process
4.4 development: Plans and predictions
Project updates
EFI
Network drivers
Edinburg – 21-23 October, 2013
Xen Development update
2 / 24

9. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Overview
Principles of OSS Development
Xen development process
Review of 4.3 development process
4.4 development: Plans and predictions
Project updates
EFI
Network drivers
FreeBSD
Edinburg – 21-23 October, 2013
Xen Development update
2 / 24

10. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Overview
Principles of OSS Development
Xen development process
Review of 4.3 development process
4.4 development: Plans and predictions
Project updates
EFI
Network drivers
FreeBSD
libvirt integration
Edinburg – 21-23 October, 2013
Xen Development update
2 / 24

11. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Overview
Principles of OSS Development
Xen development process
Review of 4.3 development process
4.4 development: Plans and predictions
Project updates
EFI
Network drivers
FreeBSD
libvirt integration
NUMA
Edinburg – 21-23 October, 2013
Xen Development update
2 / 24

12. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Principles
Open-source: A force multiplier
Edinburg – 21-23 October, 2013
Xen Development update
3 / 24

13. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Principles
Open-source: A force multiplier
Limiting factor: Trust
Edinburg – 21-23 October, 2013
Xen Development update
3 / 24

14. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Principles
Open-source: A force multiplier
Limiting factor: Trust
Goal: Meritocracy
Edinburg – 21-23 October, 2013
Xen Development update
3 / 24

15. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Practice: Code development
All patches posted to list
Edinburg – 21-23 October, 2013
Xen Development update
4 / 24

16. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Practice: Code development
All patches posted to list
Discussion and consensus
Edinburg – 21-23 October, 2013
Xen Development update
4 / 24

17. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Practice: Code development
All patches posted to list
Discussion and consensus
Committers are “referees”
Edinburg – 21-23 October, 2013
Xen Development update
4 / 24

18. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Practice: Code development
All patches posted to list
Discussion and consensus
Committers are “referees”
Determine that consensus has happened
Edinburg – 21-23 October, 2013
Xen Development update
4 / 24

19. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Practice: Code development
All patches posted to list
Discussion and consensus
Committers are “referees”
Determine that consensus has happened
Break ties when consensus is not achieved
Edinburg – 21-23 October, 2013
Xen Development update
4 / 24

20. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Practice: Code development
All patches posted to list
Discussion and consensus
Committers are “referees”
Determine that consensus has happened
Break ties when consensus is not achieved
Similar process for bigger decisions
Edinburg – 21-23 October, 2013
Xen Development update
4 / 24

21. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
What we want:
Visibility into the work that’s going on
Edinburg – 21-23 October, 2013
Xen Development update
5 / 24

22. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
What we want:
Visibility into the work that’s going on
Clear picture of the state everything is in
Edinburg – 21-23 October, 2013
Xen Development update
5 / 24

23. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
What we want:
Visibility into the work that’s going on
Clear picture of the state everything is in
A roadmap of important features
Edinburg – 21-23 October, 2013
Xen Development update
5 / 24

24. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
What we want:
Visibility into the work that’s going on
Clear picture of the state everything is in
A roadmap of important features
A good release
Edinburg – 21-23 October, 2013
Xen Development update
5 / 24

25. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
What we want:
Visibility into the work that’s going on
Clear picture of the state everything is in
A roadmap of important features
A good release
A bug-free release
Edinburg – 21-23 October, 2013
Xen Development update
5 / 24

26. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
What we want:
Visibility into the work that’s going on
Clear picture of the state everything is in
A roadmap of important features
A good release
A bug-free release
An awesome release
Edinburg – 21-23 October, 2013
Xen Development update
5 / 24

27. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
What we want:
Visibility into the work that’s going on
Clear picture of the state everything is in
A roadmap of important features
A good release
A bug-free release
An awesome release
An on-time release
Edinburg – 21-23 October, 2013
Xen Development update
5 / 24

28. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
Keep a list of outstanding features and bugs
Edinburg – 21-23 October, 2013
Xen Development update
6 / 24

29. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
Keep a list of outstanding features and bugs
Things actively being worked on
Edinburg – 21-23 October, 2013
Xen Development update
6 / 24

30. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
Keep a list of outstanding features and bugs
Things actively being worked on
Things we think would be good to work on
Edinburg – 21-23 October, 2013
Xen Development update
6 / 24

31. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
Keep a list of outstanding features and bugs
Things actively being worked on
Things we think would be good to work on
Send the list every few weeks with updates
Edinburg – 21-23 October, 2013
Xen Development update
6 / 24

32. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
Keep a list of outstanding features and bugs
Things actively being worked on
Things we think would be good to work on
Send the list every few weeks with updates
Mirror on wiki:
Edinburg – 21-23 October, 2013
Xen Development update
6 / 24

33. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Releases
Keep a list of outstanding features and bugs
Things actively being worked on
Things we think would be good to work on
Send the list every few weeks with updates
Mirror on wiki:
wiki.xen.org/wiki/Xen Roadmap/4.4
Edinburg – 21-23 October, 2013
Xen Development update
6 / 24

34. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Release phases
Open development
Edinburg – 21-23 October, 2013
Xen Development update
7 / 24

35. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Release phases
Open development
Feature freeze: No new features (3 weeks)
Edinburg – 21-23 October, 2013
Xen Development update
7 / 24

36. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Release phases
Open development
Feature freeze: No new features (3 weeks)
Code “freezing point”: Begin rejecting features (3 weeks)
Edinburg – 21-23 October, 2013
Xen Development update
7 / 24

37. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Release phases
Open development
Feature freeze: No new features (3 weeks)
Code “freezing point”: Begin rejecting features (3 weeks)
RCs: Bug fixes only (6 weeks)
Edinburg – 21-23 October, 2013
Xen Development update
7 / 24

38. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Interlude
Edinburg – 21-23 October, 2013
Xen Development update
8 / 24

39. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.3 Planning Retrospective
Goal: 9 month release cycle
Edinburg – 21-23 October, 2013
Xen Development update
9 / 24

40. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.3 Planning Retrospective
Goal: 9 month release cycle
Scheduled release: June 2013
Edinburg – 21-23 October, 2013
Xen Development update
9 / 24

41. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.3 Planning Retrospective
Goal: 9 month release cycle
Scheduled release: June 2013
Actual release: July 2013
Edinburg – 21-23 October, 2013
Xen Development update
9 / 24

42. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.3 Planning Retrospective
Goal: 9 month release cycle
Scheduled release: June 2013
Actual release: July 2013
No “howlers”
Edinburg – 21-23 October, 2013
Xen Development update
9 / 24

43. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.3 Planning Retrospective
NUMA-aware scheduler (NUMA affinity)
ARM server port
openvswitch integration
16 TiB
backend scripts
qemu stubdoms
event channel limit
NUMA memory migration
virtual NUMA topology
PVH mode
pv audio
blktap3
vm import/export
Edinburg – 21-23 October, 2013
Aug ’12
Xen Development update
10 / 24

44. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.3 Planning Retrospective
NUMA-aware scheduler (NUMA affinity)
ARM server port
openvswitch integration
16 TiB
backend scripts
qemu stubdoms
event channel limit
NUMA memory migration
virtual NUMA topology
PVH mode
pv audio
blktap3
vm import/export
Edinburg – 21-23 October, 2013
Aug ’12
Jan ’13
Xen Development update
10 / 24

45. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.3 Planning Retrospective
NUMA-aware scheduler (NUMA affinity)
ARM server port
openvswitch integration
16 TiB
backend scripts
qemu stubdoms
event channel limit
NUMA memory migration
virtual NUMA topology
PVH mode
pv audio
blktap3
vm import/export
xl USB hot-plug for HVM
libvirt libxl driver
XSM can replace IS PRIV
vTPM updates
osstest
qxl spice
Edinburg – 21-23 October, 2013
Aug ’12
Jan ’13
Xen Development update
10 / 24

46. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.3 Planning Retrospective
NUMA-aware scheduler (NUMA affinity)
ARM server port
openvswitch integration
16 TiB
backend scripts
qemu stubdoms
event channel limit
NUMA memory migration
virtual NUMA topology
PVH mode
pv audio
blktap3
vm import/export
xl USB hot-plug for HVM
libvirt libxl driver
XSM can replace IS PRIV
vTPM updates
osstest
qxl spice
Edinburg – 21-23 October, 2013
Aug ’12
Jan ’13
Xen Development update
Jul ’13
10 / 24

47. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.3 Planning Retrospective
Don’t try to predict.
Edinburg – 21-23 October, 2013
Xen Development update
11 / 24

48. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.4 Planning
Goal: 6 month release cycle
Edinburg – 21-23 October, 2013
Xen Development update
12 / 24

49. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.4 Planning
Goal: 6 month release cycle
Feature freeze: 18 October (past)
Edinburg – 21-23 October, 2013
Xen Development update
12 / 24

50. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.4 Planning
Goal: 6 month release cycle
Feature freeze: 18 October (past)
Code freeze: Extended to catch a few straglers
Edinburg – 21-23 October, 2013
Xen Development update
12 / 24

51. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.4 Planning
Things that look likely:
Multi-vector MSI (done)
Edinburg – 21-23 October, 2013
Xen Development update
13 / 24

52. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.4 Planning
Things that look likely:
Multi-vector MSI (done)
Improved spice support for libxl (done)
Edinburg – 21-23 October, 2013
Xen Development update
13 / 24

53. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.4 Planning
Things that look likely:
Multi-vector MSI (done)
Improved spice support for libxl (done)
PVH for domUs
Edinburg – 21-23 October, 2013
Xen Development update
13 / 24

54. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.4 Planning
Things that look likely:
Multi-vector MSI (done)
Improved spice support for libxl (done)
PVH for domUs
Non-udev scripts for driver domains
(NetBSD driver domains)
Edinburg – 21-23 October, 2013
Xen Development update
13 / 24

55. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.4 Planning
Things that look likely:
Multi-vector MSI (done)
Improved spice support for libxl (done)
PVH for domUs
Non-udev scripts for driver domains
(NetBSD driver domains)
A ton of fixes from Coverity reports
Edinburg – 21-23 October, 2013
Xen Development update
13 / 24

56. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.4 Planning
Things that look likely:
Multi-vector MSI (done)
Improved spice support for libxl (done)
PVH for domUs
Non-udev scripts for driver domains
(NetBSD driver domains)
A ton of fixes from Coverity reports
NUMA per-vcpu affinity
Edinburg – 21-23 October, 2013
Xen Development update
13 / 24

57. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Xen 4.4 Planning
Things that look likely:
Multi-vector MSI (done)
Improved spice support for libxl (done)
PVH for domUs
Non-udev scripts for driver domains
(NetBSD driver domains)
A ton of fixes from Coverity reports
NUMA per-vcpu affinity
USB hotplug for libxl
Edinburg – 21-23 October, 2013
Xen Development update
13 / 24

58. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI intro
Replacement for BIOS
Edinburg – 21-23 October, 2013
Xen Development update
14 / 24

59. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI intro
Replacement for BIOS
Includes “bootloader”-like functionality
Edinburg – 21-23 October, 2013
Xen Development update
14 / 24

60. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI intro
Replacement for BIOS
Includes “bootloader”-like functionality
Boot-time services (similar to BIOS calls)
Edinburg – 21-23 October, 2013
Xen Development update
14 / 24

61. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI intro
Replacement for BIOS
Includes “bootloader”-like functionality
Boot-time services (similar to BIOS calls)
Secure-boot services
Edinburg – 21-23 October, 2013
Xen Development update
14 / 24

62. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Xen
(from Daniel Kiper @ Oracle)
EFI support was introduced in Xen 4.2
Edinburg – 21-23 October, 2013
Xen Development update
15 / 24

63. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Xen
(from Daniel Kiper @ Oracle)
EFI support was introduced in Xen 4.2
Only EFI loader is fully supported now
Edinburg – 21-23 October, 2013
Xen Development update
15 / 24

64. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Xen
(from Daniel Kiper @ Oracle)
EFI support was introduced in Xen 4.2
Only EFI loader is fully supported now
GRUB/GRUB2 and Xen does not work on EFI platform
Edinburg – 21-23 October, 2013
Xen Development update
15 / 24

65. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Xen
(from Daniel Kiper @ Oracle)
EFI support was introduced in Xen 4.2
Only EFI loader is fully supported now
GRUB/GRUB2 and Xen does not work on EFI platform
But GRUB2 with fakebios and chainloader can be used to load
xen.efi on EFI platform (this option was not tested deeply)
Edinburg – 21-23 October, 2013
Xen Development update
15 / 24

66. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Xen
(from Daniel Kiper @ Oracle)
EFI support was introduced in Xen 4.2
Only EFI loader is fully supported now
GRUB/GRUB2 and Xen does not work on EFI platform
But GRUB2 with fakebios and chainloader can be used to load
xen.efi on EFI platform (this option was not tested deeply)
Daniel Kiper from Oracle works on full GRUB2 support
Edinburg – 21-23 October, 2013
Xen Development update
15 / 24

67. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Xen
(from Daniel Kiper @ Oracle)
EFI support was introduced in Xen 4.2
Only EFI loader is fully supported now
GRUB/GRUB2 and Xen does not work on EFI platform
But GRUB2 with fakebios and chainloader can be used to load
xen.efi on EFI platform (this option was not tested deeply)
Daniel Kiper from Oracle works on full GRUB2 support
Support for Secure Boot with GRUB2 will not be available at
first
Edinburg – 21-23 October, 2013
Xen Development update
15 / 24

68. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Xen
(from Daniel Kiper @ Oracle)
EFI support was introduced in Xen 4.2
Only EFI loader is fully supported now
GRUB/GRUB2 and Xen does not work on EFI platform
But GRUB2 with fakebios and chainloader can be used to load
xen.efi on EFI platform (this option was not tested deeply)
Daniel Kiper from Oracle works on full GRUB2 support
Support for Secure Boot with GRUB2 will not be available at
first
GRUB2 requires some changes to support Secure Boot
Edinburg – 21-23 October, 2013
Xen Development update
15 / 24

69. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Dom0 kernels
(from Daniel Kiper @ Oracle)
Full Dom0 support is in SUSE Linux Kernel
Edinburg – 21-23 October, 2013
Xen Development update
16 / 24

70. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Dom0 kernels
(from Daniel Kiper @ Oracle)
Full Dom0 support is in SUSE Linux Kernel
Upstream Linux Kernel does not have EFI support in Dom0
yet
Edinburg – 21-23 October, 2013
Xen Development update
16 / 24

71. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Dom0 kernels
(from Daniel Kiper @ Oracle)
Full Dom0 support is in SUSE Linux Kernel
Upstream Linux Kernel does not have EFI support in Dom0
yet
Liang Tang from Oracle started working on it but later
dropped it
Edinburg – 21-23 October, 2013
Xen Development update
16 / 24

72. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Dom0 kernels
(from Daniel Kiper @ Oracle)
Full Dom0 support is in SUSE Linux Kernel
Upstream Linux Kernel does not have EFI support in Dom0
yet
Liang Tang from Oracle started working on it but later
dropped it
There are some updates appearing from time to time on
Xen-devel but there is no WIP per se yet
Edinburg – 21-23 October, 2013
Xen Development update
16 / 24

73. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Guest support
(from Daniel Kiper @ Oracle)
Open Virtual Machine Firmware (OVMF) was added to Xen
source but it does not compile
Edinburg – 21-23 October, 2013
Xen Development update
17 / 24

74. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
EFI: Guest support
(from Daniel Kiper @ Oracle)
Open Virtual Machine Firmware (OVMF) was added to Xen
source but it does not compile
Framebuffer issue
Edinburg – 21-23 October, 2013
Xen Development update
17 / 24

75. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Network updates
(from Wei Liu @ Citrix)
Two new features during last cycle:
Edinburg – 21-23 October, 2013
Xen Development update
18 / 24

76. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Network updates
(from Wei Liu @ Citrix)
Two new features during last cycle:
1:1 model netback
Edinburg – 21-23 October, 2013
Xen Development update
18 / 24

77. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Network updates
(from Wei Liu @ Citrix)
Two new features during last cycle:
1:1 model netback
split event channels
Edinburg – 21-23 October, 2013
Xen Development update
18 / 24

78. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Network updates
(from Wei Liu @ Citrix)
Two new features during last cycle:
1:1 model netback
split event channels
Feature being worked on:
Edinburg – 21-23 October, 2013
Xen Development update
18 / 24

79. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Network updates
(from Wei Liu @ Citrix)
Two new features during last cycle:
1:1 model netback
split event channels
Feature being worked on:
IPv6 packet offload
Edinburg – 21-23 October, 2013
Xen Development update
18 / 24

80. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Network updates
(from Wei Liu @ Citrix)
Two new features during last cycle:
1:1 model netback
split event channels
Feature being worked on:
IPv6 packet offload
Planned new features:
Edinburg – 21-23 October, 2013
Xen Development update
18 / 24

81. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Network updates
(from Wei Liu @ Citrix)
Two new features during last cycle:
1:1 model netback
split event channels
Feature being worked on:
IPv6 packet offload
Planned new features:
multiqueue support
Edinburg – 21-23 October, 2013
Xen Development update
18 / 24

82. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Network updates
(from Wei Liu @ Citrix)
Two new features during last cycle:
1:1 model netback
split event channels
Feature being worked on:
IPv6 packet offload
Planned new features:
multiqueue support
multipage ring support
Edinburg – 21-23 October, 2013
Xen Development update
18 / 24

83. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
Xen FreeBSD updates present in 10.0 (to be released by the end of
November):
Rework of event channel implementation so it is shared
between PV and PVHVM guests.
Edinburg – 21-23 October, 2013
Xen Development update
19 / 24

84. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
Xen FreeBSD updates present in 10.0 (to be released by the end of
November):
Rework of event channel implementation so it is shared
between PV and PVHVM guests.
Implementation of the vector callback for HVM (allows
per-cpu event channel interrupts).
Edinburg – 21-23 October, 2013
Xen Development update
19 / 24

85. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
Xen FreeBSD updates present in 10.0 (to be released by the end of
November):
Rework of event channel implementation so it is shared
between PV and PVHVM guests.
Implementation of the vector callback for HVM (allows
per-cpu event channel interrupts).
PV event timer and time counter implementation for PVHVM.
Edinburg – 21-23 October, 2013
Xen Development update
19 / 24

86. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
Xen FreeBSD updates present in 10.0 (to be released by the end of
November):
Rework of event channel implementation so it is shared
between PV and PVHVM guests.
Implementation of the vector callback for HVM (allows
per-cpu event channel interrupts).
PV event timer and time counter implementation for PVHVM.
PV IPIs for PVHVM.
Edinburg – 21-23 October, 2013
Xen Development update
19 / 24

87. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
Xen FreeBSD updates present in 10.0 (to be released by the end of
November):
Rework of event channel implementation so it is shared
between PV and PVHVM guests.
Implementation of the vector callback for HVM (allows
per-cpu event channel interrupts).
PV event timer and time counter implementation for PVHVM.
PV IPIs for PVHVM.
Live Migration support for PVHVM guests.
Edinburg – 21-23 October, 2013
Xen Development update
19 / 24

88. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
Xen FreeBSD updates present in 10.0 (to be released by the end of
November):
Rework of event channel implementation so it is shared
between PV and PVHVM guests.
Implementation of the vector callback for HVM (allows
per-cpu event channel interrupts).
PV event timer and time counter implementation for PVHVM.
PV IPIs for PVHVM.
Live Migration support for PVHVM guests.
Support for FLUSH/BARRIER in blkfront.
Edinburg – 21-23 October, 2013
Xen Development update
19 / 24

89. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
Xen FreeBSD updates present in 10.0 (to be released by the end of
November):
Rework of event channel implementation so it is shared
between PV and PVHVM guests.
Implementation of the vector callback for HVM (allows
per-cpu event channel interrupts).
PV event timer and time counter implementation for PVHVM.
PV IPIs for PVHVM.
Live Migration support for PVHVM guests.
Support for FLUSH/BARRIER in blkfront.
Full Xen support merged into GENERIC kernel (no need to
compile a Xen specific kernel for PVHVM).
Edinburg – 21-23 October, 2013
Xen Development update
19 / 24

90. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
Xen FreeBSD updates present in 10.0 (to be released by the end of
November):
Rework of event channel implementation so it is shared
between PV and PVHVM guests.
Implementation of the vector callback for HVM (allows
per-cpu event channel interrupts).
PV event timer and time counter implementation for PVHVM.
PV IPIs for PVHVM.
Live Migration support for PVHVM guests.
Support for FLUSH/BARRIER in blkfront.
Full Xen support merged into GENERIC kernel (no need to
compile a Xen specific kernel for PVHVM).
Bug fixes for OSS Xen, XenServer and Amazon EC2.
Edinburg – 21-23 October, 2013
Xen Development update
19 / 24

91. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
Xen FreeBSD updates present in 10.0 (to be released by the end of
November):
Rework of event channel implementation so it is shared
between PV and PVHVM guests.
Implementation of the vector callback for HVM (allows
per-cpu event channel interrupts).
PV event timer and time counter implementation for PVHVM.
PV IPIs for PVHVM.
Live Migration support for PVHVM guests.
Support for FLUSH/BARRIER in blkfront.
Full Xen support merged into GENERIC kernel (no need to
compile a Xen specific kernel for PVHVM).
Bug fixes for OSS Xen, XenServer and Amazon EC2.
This work has been done in conjunction between Spectra Logic
and Citrix.
Edinburg – 21-23 October, 2013
Xen Development update
19 / 24

92. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
What’s coming next:
PVH guest support.
Edinburg – 21-23 October, 2013
Xen Development update
20 / 24

93. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
FreeBSD Xen status
(from Roger Pau Monne @ Citrix)
What’s coming next:
PVH guest support.
PVH Dom0 support.
Edinburg – 21-23 October, 2013
Xen Development update
20 / 24

94. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Block improvements
(from Roger Pau Monne @ Citrix)
Persistent grants.
Edinburg – 21-23 October, 2013
Xen Development update
21 / 24

95. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Block improvements
(from Roger Pau Monne @ Citrix)
Persistent grants.
Indirect descriptors.
Edinburg – 21-23 October, 2013
Xen Development update
21 / 24

96. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Libvirt
(from Dario Faggioli @ Citrix)
Basic VM workflow
Edinburg – 21-23 October, 2013
Xen Development update
22 / 24

97. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Libvirt
(from Dario Faggioli @ Citrix)
Basic VM workflow
Create, start, shutdown, reboot, destroy, pause, resume, save,
restore, ... : working
Edinburg – 21-23 October, 2013
Xen Development update
22 / 24

98. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Libvirt
(from Dario Faggioli @ Citrix)
Basic VM workflow
Create, start, shutdown, reboot, destroy, pause, resume, save,
restore, ... : working
Migration, PCI passthrough: coming soon
Edinburg – 21-23 October, 2013
Xen Development update
22 / 24

99. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Libvirt
(from Dario Faggioli @ Citrix)
Basic VM workflow
Create, start, shutdown, reboot, destroy, pause, resume, save,
restore, ... : working
Migration, PCI passthrough: coming soon
More advanced VM manipulation
Edinburg – 21-23 October, 2013
Xen Development update
22 / 24

100. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Libvirt
(from Dario Faggioli @ Citrix)
Basic VM workflow
Create, start, shutdown, reboot, destroy, pause, resume, save,
restore, ... : working
Migration, PCI passthrough: coming soon
More advanced VM manipulation
Scheduling, updating memory/vcpus, block attach, media
change: working
Edinburg – 21-23 October, 2013
Xen Development update
22 / 24

101. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Libvirt
(from Dario Faggioli @ Citrix)
Basic VM workflow
Create, start, shutdown, reboot, destroy, pause, resume, save,
restore, ... : working
Migration, PCI passthrough: coming soon
More advanced VM manipulation
Scheduling, updating memory/vcpus, block attach, media
change: working
Vcpu pinning, NUMA node-affinity, network attach, native (xl)
config file handling: missing
Edinburg – 21-23 October, 2013
Xen Development update
22 / 24

102. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Libvirt
(from Dario Faggioli @ Citrix)
Basic VM workflow
Create, start, shutdown, reboot, destroy, pause, resume, save,
restore, ... : working
Migration, PCI passthrough: coming soon
More advanced VM manipulation
Scheduling, updating memory/vcpus, block attach, media
change: working
Vcpu pinning, NUMA node-affinity, network attach, native (xl)
config file handling: missing
Specific Libvirt stuff (for host and guests)
Edinburg – 21-23 October, 2013
Xen Development update
22 / 24

103. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Libvirt
(from Dario Faggioli @ Citrix)
Basic VM workflow
Create, start, shutdown, reboot, destroy, pause, resume, save,
restore, ... : working
Migration, PCI passthrough: coming soon
More advanced VM manipulation
Scheduling, updating memory/vcpus, block attach, media
change: working
Vcpu pinning, NUMA node-affinity, network attach, native (xl)
config file handling: missing
Specific Libvirt stuff (for host and guests)
Host and guest configuration and statistics reporting: missing
Edinburg – 21-23 October, 2013
Xen Development update
22 / 24

104. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
Libvirt
(from Dario Faggioli @ Citrix)
Basic VM workflow
Create, start, shutdown, reboot, destroy, pause, resume, save,
restore, ... : working
Migration, PCI passthrough: coming soon
More advanced VM manipulation
Scheduling, updating memory/vcpus, block attach, media
change: working
Vcpu pinning, NUMA node-affinity, network attach, native (xl)
config file handling: missing
Specific Libvirt stuff (for host and guests)
Host and guest configuration and statistics reporting: missing
Block/network performance tuning and control: missing
Edinburg – 21-23 October, 2013
Xen Development update
22 / 24

105. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
NUMA
(from Dario Faggioli @ Citrix)
NUMA aware automatic placement
When a VM is created, allocate its memory from the
minimum number and best possible node(s)
Included in Xen 4.2
Edinburg – 21-23 October, 2013
Xen Development update
23 / 24

106. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
NUMA
(from Dario Faggioli @ Citrix)
NUMA aware automatic placement
When a VM is created, allocate its memory from the
minimum number and best possible node(s)
Included in Xen 4.2
NUMA aware scheduling for Credit1
VMs can run everywhere, but prefer to run on the nodes
where their memory is
Included in Xen 4.3
Edinburg – 21-23 October, 2013
Xen Development update
23 / 24

107. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
NUMA
(from Dario Faggioli @ Citrix)
NUMA aware automatic placement
When a VM is created, allocate its memory from the
minimum number and best possible node(s)
Included in Xen 4.2
NUMA aware scheduling for Credit1
VMs can run everywhere, but prefer to run on the nodes
where their memory is
Included in Xen 4.3
Per-VCPU NUMA aware scheduling
Each VCPU in a VM can have a different NUMA
node-affinity: different VCPUs (may) prefer to run on
different nodes Targeting Xen 4.4 (status: probable)
Edinburg – 21-23 October, 2013
Xen Development update
23 / 24

108. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
NUMA, con’t
(from Dario Faggioli @ Citrix)
Virtual NUMA topology for PV guests
VMs can be NUMA machines and have a virtual topology
(number or nodes, amount of memory, distances, etc.)
Targeting Xen 4.4 (status: probable)
Edinburg – 21-23 October, 2013
Xen Development update
24 / 24

109. Intro
OSS Development
Xen 4.3
Xen 4.4
Updates
NUMA, con’t
(from Dario Faggioli @ Citrix)
Virtual NUMA topology for PV guests
VMs can be NUMA machines and have a virtual topology
(number or nodes, amount of memory, distances, etc.)
Targeting Xen 4.4 (status: probable)
Memory migration
Moving the memory of a VM from a NUMA node to another
on-line
Targeting Xen 4.4 (status: tentative)
Edinburg – 21-23 October, 2013
Xen Development update
24 / 24