Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1BmZHRJ. Derek Collison discusses technologies and approaches for obtaining a fluid infrastructure that has the level of plasticity needed to heal itself and provide higher level SLAs for apps and services. Filmed at qconlondon.com. An industry veteran and pioneer in large-scale distributed systems and enterprise computing, Derek Collison has held executive positions at TIBCO Software, Google, and VMware. At TIBCO, he designed and implemented a wide range of messaging products, including Rendezvous and EMS.

1. What’s Beyond Virtualization?
Derek Collison - @derekcollison
Apcera Inc.
QCon London - March 7, 2014

2. Watch the video with slide
synchronization on InfoQ.com!
http://www.infoq.com/presentations
/enterprise-virtualization-it
InfoQ.com: News & Community Site
• 750,000 unique visitors/month
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• News 15-20 / week
• Articles 3-4 / week
• Presentations (videos) 12-15 / week
• Interviews 2-3 / week
• Books 1 / month

3. Presented at QCon London
www.qconlondon.com
Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide

4. What does the future of
Enterprise IT look like?

5. What does it look like
today?

6. It Depends!

7. Could be very old school - Just physical machines!
Could be virtualized: CPU/MEM, Storage and Network
Could be IaaS or IaaS++
Could be IaaS + PaaS
Could be off-premise and in the Cloud

8. Why do we care?

9. What do these things
really buy us?

10. They remove
undifferentiated heavy lifting!

11. They speed up
the slow and mundane

12. Transparent value-add!

13. What about PaaS?

14. What about PaaS?
Tries to speed up deployment
Very opinionated, still is..
Is only a piece of the larger puzzle
Carrying costs in the delivery pipeline
Pipeline is a biz requirement thru value delivered
BUT PaaS as a standalone technology is not enough..

15. So..

16. What do we want?

17. What do we want..
Self Service
Faster iterative development and deployments
Fault Tolerance, High Availability
Higher and guaranteed SLAs
Composeable Systems - legos

18. Software Defined Everything!

19. But..

20. What do we really want?

21. What do we really want?
Meta-data driven description of my system
Extreme Agility
Transparent Compliance
Fluid and Abstracted Infrastructure and Services
Multiple delivery models in a single system

22. What do we want really?
Meta-data driven description of my system
Extreme Agility
Transparent Compliance
Fluid and Abstracted Infrastructure and Services
Multiple delivery models in a single system

23. Meta-Data Driven
My app A needs to talk to B and C
I need 4 instances of A, 2 of B and 3 of C
It needs X memory and Y CPU
It needs NNN storage
It requires I/O SLAs for talking to B and C
It needs to be available via a URL for trusted identities
It needs to run on-premise and co-located near B

24. Is this
Autonomic Computing?

25. How would we do this?

26. How would we even start?

27. Getting Started - App A
What does App A need?
Where will App A be run?
How will App A find B and C?
How do others find my App A?
What happens on a failures?

28. Getting Started - App A
What does App A need? - Packaging and Dependencies
Where will App A be run? - Provision and Schedule
How will App A find B and C? - Addressing/Discovery
How do others find my App A? - External Mapping
What happens on a failures? - Health Monitoring

29. Packaging and Dependency
What does the job need to run?
What runtimes, OS, libraries?
What tools can I use for consistency, compliance, audit?
SCCS and Chef / Puppet
AMIs or VMDKs
Docker Images

30. Packaging and Dependency
Challenges
Do these change when I change from Dev to
Production?
What runtimes, OS, libraries then?
Who defines what these are?
Are the existing tools and best practices still
sufficient?

31. Provision and Schedule
How fast can I provision?
Can my workload run anywhere and be compliant?
How do network perimeter security models effect placement?
What is my unit or work? VM, App, Image?
Can the system automatically handle compliance and policy?
Can compliance and deployment be handled independently?
What new tools exist? Mesos, Fleet?

32. Addressing and Discovery
Is DNS sufficient?
Do we need to change our applications?
When things get moved, how does the system react?
Is load balancing handled or is this a manual process?
What happens when we scale up or down?
How do others find us?

33. Monitoring and Management
What happens when something fails?
Is this a manual process?
Who determines failure? Can we trust the system?
What if they are sick, not dead? Latency vs Chaos
Do we know if the change even helped?
Pluggable Health

34. SO..
How do we get here?

35. Is it a Bolt-On Solution?

36. Or is it Bolt-In?

37. Bolt-On got us into this
mess in the first place!

38. What we need is a
Platform OS!

39. Programmable, pluggable
and composeable..

40. From the inside out..

41. The OS for the datacenter

42. The OS for the datacenter
Multiple Datacenters

43. Secure, Trusted, and Hybrid

44. Multi-Datacenter OS
Treat all resources as a common pool
Handle all networking access, addressing and discovery in
realtime, and at scale
Be aware of ontologies and their communication semantics
Be security and policy aware
Be purposely built to accept and promote rapid change
Provide policy compliant resource isolation, connectivity and SLAs

45. Multi-Datacenter OS
Virtualization
SDN - Software-Defined Networking
Management and Resource Pooling
Intelligent and Compliant Job Scheduling
Intelligent canarying, A/B rollouts

46. Multi-Datacenter OS
Virtualization
SDN - Software-Defined Networking
Management and Resource Pooling
Intelligent and Compliant Job Scheduling
Intelligent canarying, A/B rollouts

47. Virtualization?
What about speed and weight?
Google chargeback diversion
What about containers, e.g. Docker?
Is there a container equivalent for .NET?
Micro-task Virtualization?

48. Multi-Datacenter OS
Virtualization
SDN - Software-Defined Networking
Management and Resource Pooling
Intelligent and Compliant Job Scheduling
Intelligent canarying, A/B rollouts

49. SDN?
Solve network perimeter security?
Does it involve application level changes?
What about layer 7 semantics?
How many INSERTS per second from all of App A?
Can I disallow DROP and DELETE calls between 1a-3a?
Can the network be made compliant and transparent?
It just works, e.g. mobile

50. Multi-Datacenter OS
Virtualization
SDN - Software-Defined Networking
Management and Resource Pooling
Intelligent and Compliant Job Scheduling
Intelligent canarying, A/B rollouts

51. intelligent and Compliant
Job Scheduling
Pick the best place to run for a given job and policy
How does a system rebalance, utilize new resources?
Centralized or Distributed Algorithms?
How does policy effect decision making? E.g Geo

52. Multi-Datacenter OS
Virtualization
SDN - Software-Defined Networking
Management and Resource Pooling
Intelligent and Compliant Job Scheduling
Intelligent canarying, A/B rollouts

53. Intelligent Canarying
Want to roll out a new version of App A
Do we know what App A - v2 success looks like?
How do we do roll in and roll back (if needed)?
How do we avoid our fingers on the keyboard?
What is needed for this process to be automated?

54. Intelligent Canarying
What data is needed to say if it is ok?
resource utilizations - CPU, Mem, Storage
communication patterns - cascading effects
temporal awareness
All data feeds into anomaly detection services
Utilizes unsupervised deep machine learning

55. Summary

56. Summary
Intelligent, holistic platform technologies - Pluggable and Composeable
Transparent value add to jobs/workloads - No code changes!
Packaging and Dependency Management - Policy aware
Job Scheduling and Provisioning - Also policy aware
Addressing, Discovery, Networking - Policy again, theme developing
Monitoring and Management
Lifecycle Management and Intelligent Canarying

57. Some Resources
Docker - https://www.docker.io/
Mesos - http://mesos.apache.org/
CoreOS - https://coreos.com/
Fleet, Etcd - https://coreos.com/using-coreos/etcd/
Continuum - http://apcera.com/continuum/

58. Thank You

59. Watch the video with slide synchronization on
InfoQ.com!
http://www.infoq.com/presentations/enterprise
-virtualization-it