1. Portrait of the developeur as

2. @chanezon
French
Polyglot
Server Side
San Francisco
Developer Relations

3. P@ & Military Software

4. Patrick Chanezon
Director, Enterprise Evangelism
chanezon@microsoft.com
@chanezon

5. Very freely inspired from
... and a few years as an Enterprise
consultant in France before moving to
California

20. 2010
- George became CIO

30. What happened while
George was playing
Golf

31. Dreams Of my childhood
3

32. Accelerando / Singularity, in a Galaxy far far away
▪ Even if we automate ourselves out of a job every 10 years
▪ ...I don’t think the singularity is near!
4

33. Moore's Law is for Hardware Only
▪ Does not apply to software
▪ Productivity gains not keeping up with hardware and bandwidth
▪ Writing software is hard, painful, and still very much a craft
5

34. Moore's Law’s free lunch is over
▪ Herb Sutter, Welcome to the Jungle
http://herbsutter.com/welcome-to-the-jungle/
6

35. Architecture Changes: 60’s Mainframe

36. Architecture Changes: 80’s Client-Server

37. Architecture Changes: 90’s Web

38. Architecture Changes: 2010’s Cloud, HTML5, Mobile

39. Cloud
39
Cloud According to my daughter Eliette

40. Cloud started at Consumer websites solving their needs
• Google, Amazon, Yahoo, Facebook, Twitter
• Large Data Sets
• Storage Capacity growing faster than Moore’s Law
• Fast Networks
• Vertical -> Horizontal scalability
• Open Source Software
• Virtualization
• Cloud is a productization of these infrastructures
• Public Clouds Services: Amazon, Microsoft, Google
• Open Source Software: Hadoop, Open Stack, Eucalyptus, Cloud Foundry,
OpenShift
!
!

41. Predictions
“The future is already here —
it's just not very evenly
distributed”
William Gibson
12

42. Google
• Horizontal scalability 2004: Map/Reduce (Hadoop)
• NoSQL 2006: Bigtable (Mongo, Cassandra, HBase, Riak)
• Real Time analytics 2010: Dremel, BigQuery (Impala)
• Horizontally Scalable SQL 2012: Spanner, F1 / Amazon Redshift

43. Google
14

44. Microsoft - Cloud OS
15

45. Microsoft - Multi Cloud
18

46. Open
Languages
CMS
Devices
Databases
Operating!
Systems

47. Microsoft - We do Java!
16

48. Microsoft - Fabric
19

49. Microsoft - Fabric
20

50. Microsoft - Fabric
Watch Mark Russinnovich Azure architecture talk http://channel9.msdn.com/Events/
TechEd/NorthAmerica/2013/WAD-B402
21

51. Microsoft Big Data Usability
• Agility in Data -> Insight
• Excel PowerBI + Azure HD Insight

52. Amazon
23 Source http://media.amazonwebservices.com/
AWS_Overview.pdf

53. Amazon
▪ 2 pizza teams, focused on services
▪ Eventual consistency (Dynamo paper)
▪ Use OSS but don’t contribute much
▪ Elastic Beanstalk PaaS .NET, Java, Node.js, PHP, Python, Ruby
▪ PaaS partners: Heroku, Cloud Foundry
▪ VPC, but no complete hybrid story. Eucalyptus.
24

54. Netflix
rapid evolution, low mtbiamsh
“mean time between idea and making stuff happen”
functionality and scale now, portability coming
source http://www.slideshare.net/adrianco/netflixoss-meetup
25

55. Netflix
26

56. VMWare / Pivotal CloudFoundry
27
Cloud Provider Interface
• Open Source: Apache 2 Licensed
• multi language/frameworks
• multi services
• multi cloud
Application Service
Interface
Private
Clouds
Public
Cloud
Micros
Cloud
s
Data Services
Other
Services
Msg Services
vFabric
Postgres
vFabric
RabbitMQTM

57. Cloud Foundry Logical View
Developers Users
Routers
CloudControllers App
Services
App
HealthManager
Execution Agents (DEA)
Pool
Messaging
vmc

58. Production Grade Cloud Foundry Clusters
▪ 500 – 5,000 VMs
▪ 40+ unique node types
▪ 75+ unique software packages
▪ 75+ unique environments
▪ 2x/week cf.com updates
▪ 24x7x365 non-stop operation
▪ No-downtime deployments
▪ Reliable, robust, repeatable
29
deployments, updates, capacity
adjustments
▪ Small teams manage many
instances
cloudfoundry.com
production, staging, stress, qa, dev
Google style problem ➔ Google style solution

59. IaaS neutral by design
31
CPI: code complete
functional status: “work in progress”
vSphere: battle tested implementation, thousands of
deployments
vCloud Director: “work in progress”, 2H 2012
Cloud Foundry BOSH
Cloud Provider Interface (CPI)
contribute: github.com/cloudfoundry/bosh
github.com/piston/openstack-bosh-cpi

60. Docker Containers: IaaS -> PaaS continuum
32

61. Container Ecosystem
32

62. Kubernetes

63. Cloud Market
33
IT
Pros Devops Architects Developers
Private Hybrid Public

64. Google: the story of Urs Hölzle’sFlashlight

65. Lessons to build your cloud
34
Research Papers
Hybrid Cloud
2 Pizza teams
Open Source
Portability

66. Agile
• Consumer software is becoming like fashion
• Phone/Social apps
• A/B Testing
• Fast lifecycle
• Enterprise
• Situational Apps

67. Cloud Platforms enable Agile
• Built-in Scalability
• Faster Iterations
• Focus on Design
• Focus on Business Value

68. Trends
31
Industry Craft

69. 24

70. Mainframe
25

71. Client-Server
26

72. 27
Web

73. 28
Cloud - Devops

74. DSLs

75. Infrastructure as Code

76. Behavior Driven Development / Infra

77. Devops
• Cultural movement
• Inspired by agile methods
• People, Processes & Tools
• Continuous delivery
• Infrastructure as code
• Cross silo collaboration
• Small iterations
• Feedback loop, measurement
Image from Patrick Debois
http://www.slideshare.net/jedi4ever/devops-the-war-is-over-if-you-want-it
http://www.slideshare.net/jedi4ever/devopsdays-downundervfinal

78. Low MTBIAMSH
• MTBIAMSH (Mean Time Between Idea And Making
Stuff Happen)

79. Agility == $$

80. 80
Lessons for
Developers

81. Trends
• Software is fashion
•Design thinking
• Polyglot programming, persistence
• best tool for the job
• full stack dev
• Change
•Collab: agile, devops
• Many opportunities open when you embrace change
81

82. Things to forget
• First normal form
•Waterfall model
• Single server deployment
• Single language skill
• Build everything from scratch
• Build custom infrastructure
82

83. Things to learn
• Agile
•Devops
• Micro Services
•Risk: fail often, fail fast and learn
• API Design: create the API first
•UI Design, Javacript, HTML5, CSS3
• A/B Testing
•Open Source, Open Standards
• Architecture, Distributed Computing (CAP theorem, 8 fallacies)
•Cloud Platforms and APIs
• Multiple types of languages
•DSLs
• Pick your battles, choose what you need to build yourself to
add value
• Learn to live in a box (embrace platform limitations) to think
outside the box
83

84. Redemption

96. The (Happy) End

97. References
▪ Microsoft Windows Azure http://
www.windowsazure.com/
▪ Mark Russinnovich Azure architecture talk http://
channel9.msdn.com/Events/TechEd/
NorthAmerica/2013/WAD-B402
▪ Scott Guthrie’s blog http://weblogs.asp.net/
scottgu/
▪Netflix OSS presentations source http://
www.slideshare.net/adrianco/netflixoss-meetup
▪ Google Research papers http://
research.google.com/pubs/papers.html
▪Amazon architecture site http://aws.amazon.com/
architecture/
36

98. Lessons to build your cloud
▪ Google: Research papers
• Horizontally scalable uniform infrastructure for common workloads
• Set of managed Data services: SQL, Document, Graph
• Hardware / Software interaction to innovate
▪ Microsoft: Cloud OS / Hybrid Cloud
• Unit of scale: process -> service, kernel -> fabric, server -> datacenter
• Fabric to automate updates, monitoring
▪ Amazon: DevOps
• Pizza box teams building & operating service
▪ Netflix: Monkeys!
• Test and production lines blur: Monkeys, A/B Testing
▪ VMware/Pivotal: Open Source
• Open Source: vendor independence, sharing the load, recruit
▪ Docker: Portability
▪ IaaS/PaaS continuum, both useful, depends on needs
▪ Multi vendor, multi cloud, mix of proprietary & Open Source
▪ Industry Vertical / Sovereign / Geo clouds providers 37

99. Papers / Talks
▪Simon Wardley, Oscon 09 “Cloud - Why IT Matters”
▪ Tim O’Reilly article on internet os
▪Peter Deutsch’s 8 Fallacies of Distributed Computing
▪Brewer’s CAP Theorem
▪Gregor Hohpe’s Starbucks Does Not Use Two-Phase
Commit
▪Herb Sutter, Welcome to the Jungle
http://herbsutter.com/welcome-to-the-jungle/
▪Stuff I tag http://www.delicious.com/chanezon/
▪More specifically http://www.delicious.com/chanezon/
cloudfoundry
▪My previous Talks http://www.slideshare.net/chanezon
▪My list of favorite books
http://www.chanezon.com/pat/soft_books.html
38

100. Books / Articles
▪ Nick Carr, The Big Switch
▪ Eric Raymond, The Art of Unix Programming
▪ Weinberg, Psychology of Computer Programming
▪ Wes python book
▪ Mark html5 book
▪ Kent Beck XP
▪Hunt, Thomas, The Pragmatic Programmer
▪Ade Oshineye, Apprenticeship Patterns
▪ Matt Cutt's Ignite Talk IO 2011, Trying different
things
▪ Josh Bloch talk about api design
▪ Larry and Sergey, Anatomy of a Search Engine
▪ Rob Pike, The Practice of Programming
39

101. Trends
40
Industry Craft