How to automate IaaS deployments of SAP using Puppet

1. Automating Infrastructure as a Service Deployments
and monitoring – TEC213
Chris Kernaghan
14th August 2012

2. SAP and IaaS
IaaS
• IaaS is a Public or Private environment which is billed on a utility
“what you use” model
• Defining characteristic of Cloud is self-service
• Lots of competing technologies eg.
KVM, LPARs, VMWare, Solaris Containers, EC2, Eucalyptus
• IaaS environments are essentially, for individual
customers, infinitely scalable
SAP/AWS
• SAP have been working in AWS since 2008
• Working on Project Titanium for 3 years
• Large supporter of Virtualisation technologies
• Use in Training, Project and Development systems
• Helping partners to build and develop services supporting Cloud
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
2

3. Supported SAP Cloud Partners
Total of 63
partners who are
certified to support
SAP’s supported
cloud services.
15 of these
partners are
Globally certified
Many run their
own hosting/Cloud
services in
addition
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
3

4. SAP AWS Deployments
SAP usage across
53 user groups
groups
Use of Project
Titanium to control
instances
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
4

5. Capgemini UK SAP AWS Deployments
60
AWS SAP deployments
used by Capgemini UK
for Internal and Project
use.
50
40
Managed by project
technical teams or
practice members.
30
20
Template landscape
Customer Project 3
Customer Project 2
10
Customer Project 1
Demo landscape
Internal Pilot
Dec-09
Jan-10
Feb-10
Mar-10
Apr-10
May-10
Jun-10
Jul-10
Aug-10
Sep-10
Oct-10
Nov-10
Dec-10
Jan-11
Feb-11
Mar-11
Apr-11
May-11
Jun-11
Jul-11
Aug-11
Sep-11
Oct-11
Nov-11
Dec-11
Jan-12
Feb-12
Mar-12
Apr-12
May-12
Jun-12
Jul-12
Aug-12
0
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
5

6. Cloud and Shadow IT
Facilitator
Consultant
Cloud Admin
• Help IT administrate Infrastructure
• Help business develop and deploy
and applications
leading edge applications
• Design processes which meet
• Curate and administrate flexible
business compliance standards
landscape
• Build/Design flexible infrastructures
• Additional to project/chargable
which are adaptable but controlled
work, so primarily done outside
• Migrate customers from outdated
hours
platforms to next generation
• Team members need to be highly
platforms
adaptable, flexible, autonomous, bou
ght into the SoPs
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
6

7. Automation – Why do it
• Systems administration is full of boring, repetitive tasks
• Evolve from thick manual run guides to smaller guides on
automated processes
•Create better results driven compliance processes and
records
• Quicker serial/parallel executions
• The execution of the tasks is more controlled
• There are lots of methods of automation, depending on the
layer you are working within
• OS – System schedulers
• Database – triggers or stored procedures
• Application level – scheduled batch or background jobs
• Captured input session tools
S – Scheduled
C – Consistent
A – Auditable
R – Repeatable
S – Sharable
Ability to execute
consistent process
to serve multiple
compliance
frameworks with
different
documentation
requirements –
eg, ITIL, SOX, FDA
, etc..
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
7

8. DevOps
•DevOps is a methodology and philosophy which is used to
create and maintain flexible infrastructure and teams
• When used properly it can provide
• Consistent information,
• Auditable Processes,
•Automatic Measurement
Cloud depends upon close collaboration due to
rapid and shortened development cycles
• Flexibility and durations are important as the costs
are directly charged and very visible
• Projects tend use smaller teams
• Administrators often still have a day job managing
the Production infrastructure
C – Collaboration
A – Automation
M – Measurement
S – Sharing
We are uncovering better ways of
running systems by doing it and
helping others do it.
Through this work we have come to
value:
• Individuals and interactions over
processes over tools
• Working systems over
comprehensive documentation
• Customer and developer
collaboration over contract
negotiation
• Responding to change over
following a plan
That is, while there is value in the
items on the right, we value the items
on the left more.
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
8

9. Types of Automation
• Build automation
• Configuration management automation
• Change management automation
• Scheduled tasks
• Exception management automation
• Instance management
• Security Management
• Cost management and reporting
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
9

10. Build Automation
Activity
Manual duration
Automation technology
Software Download
Hours/days (dependant
upon connection)
RSS Feeds and automated
download manager
Hardware configuration
(Disks, NICs)
Mins/Hours
Scripted tasks, Puppet/Chef
O/S configuration (DNS,
Users, patches)
Hours
Scripted tasks, Puppet/Chef
3rd party software install
Hours
Scripted tasks, Puppet/Chef
SAPInst (Initial answers)
Mins/Hours
Answer Files, prebuilt XML
files
Build
Hours
Exception based alerting
scripts
Post build steps
Hours
Scripted tasks executed
over RFC
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
10

11. Demo
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
11

12. Configuration Management
• Configuration implementation automation can be achieved in a number of ways
• Copy from other systems
Runmyjob.com
• System copy
CPS/LVM/UC4
• Client copy
• Scripting using SDKs and RFCs
• Java
• Ruby (Show User creation code)
Configuration item
Automation technology
O/S and DB configuration
Scripts, Puppet/Chef
SAP & Window Users
Scripts, LDAP, CUA
SAP RFCs
Scripts, Direct SQL Scripts
SAP Number Ranges
Scripts, Transports
SAP Transport Landscape
Manual
SAP Logical system name
Script, manual
SAP Background job scheduling
Scripts, 3rd party applications
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
12

13. Change management automation
Change management applies inside and outside of SAP
Purpose is to accurately record changes for a number of reasons
Infrastructure change management
SAP change management
• Information discovery tools
• Belarc
• SolarWinds
• Squirrel
• Configuration Management Databases
•Chef/Puppet
• Configuration discovery tools
• LiveCompare
• Solution Manager
• ABAP tools
• Transport management
•CTS+, Transport Express, RevTrac
Each automated system for applying change management usually also has a work flow
based approval system.
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
13

14. Demo
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
14

15. Exception Monitoring
Exception monitoring is valuable because
• It identifies and alerts against things which are issues
• Can be narrow focus, for example only looking for critical issues
• Compliance is often based on exceptions/deviations, therefore exception
based reporting works well with compliance
Using scheduled checks on specific
components and an alerting framework
• Solution Manager
• SAP Diagnostic agents
• O/S scripting
• O/S, DB, SAP checks
• CMDB checks
•Configuration management
checks
Cloud systems are usually systems
created in addition to normal BAU
systems
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
15

16. Demo
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
16

17. Cloud Instance Management
• Instances are the number 1 cost contributor to the normal AWS EC2 bill
• AMI’s are the biggest work load contributor to the EC 2 workload
• AMI ageing and patching
• Working with Dynamic resources
• Few AWS resources are static – this leads to interesting design/architectural choices
• Use of Elastic IP addresses vs DHCP&DynDNS
•Disk subsystem structuring – SAP vs World
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
17

18. Cloud Instance Management
• Instance control evolution has 3 main stages
• Always up
• Primarily each instance is up 24*7
• Start up and shutdown is manual
• Dumb Schedule
• Instances are brought up and down using EC2 API
• 3rd Party services
• Default down
• Chris Paine’s work with Google Apps provides a website with ability to start
instances
Instance type
Typical Runtime
Cost
Always up
720 hours/month (24hrs*30) $662/month
Dumb Schedule
450 hours/month (15hrs*30) $414/month
Default Down
120 hours/month (4hrs * 30) $110/month
| Sector, Alliance, Offering
Chris Kernaghan
© 2012 Capgemini. All rights reserved.
18

19. Demo
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
19

20. Cloud Security Management
Security Management is very important for 3 reasons
Flexibility is the mortal
enemy of security
Cheaper = Less security
because good security
costs money
Faster = leaves no time
to do security analysis
and implementation
Data Protection is
paramount, internally and
externally
Cost, utility billing means
a direct cost can be
placed on each instance
Putting Production quality
data in the Cloud is
inherently risky
Security can provide
details of who is spending
what money
Cloud resources and
projects have high
degree of flux of Human
resources and reuse of
technical resources
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
20

21. Cloud Management
Cost Management and reporting
• Cost management is vitally important due to perception
• Move the perception to Value and ROI
• Define the KPIs early
• Use Cost calculators to show how much each instance costs
• Use automated reporting
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
21

22. Evaluation
Feedback
Please complete a session
evaluation for this session!
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
22

23. More information
Please contact:
• Chris Kernaghan
Chris.Kernaghan@capgemini.com
| Sector, Alliance, Offering
Insert "Title, Author, Date"
© 2012 Capgemini. All rights reserved.
23

24. www.capgemini.com
The information contained in this presentation is proprietary. ©2012 Capgemini. All rights reserved