Users are becoming increasingly impatient with new apps that don’t work. Often, you get one shot to get it right. But, new applications are being rolled out all the time, and being accessed from all sorts of devices. Operations need to provide developers with real-world production data to help them identify performance issues before applications go into production. This Application Lifecycle Optimization (or DevOps) is key for businesses to reduce the risk of faulty application rollouts. Recently at DevOps Summit in New York, Peter Tsatsaronis of National Australia Bank (NAB) discussed how they used Application Performance Management (APM) from CA Technologies to create an exact replica of load and performance data from production to help developers improve new and enhanced application quality. As a result of that, NAB has lowered their transaction response time by 85%, improved developer code efficiency, and even found issues they didn’t know they had , which were all discovered in performance testing, by implementing CA APM. Aruna Ravichandran, VP, Product Marketing, Application Performance Management and DevOps, CA Technology joined Peter from NAB at this session and shared how CA Technologies is uniquely positioned to help customers in their journey to DevOps transformation . Peter and Aruna used this slide deck to present at the DevOps Summit, New York. Leatn more about CA APM at http://www.ca.com/apm

1. Peter Tsatsaronis
Delivery Manager
NAB
Aruna Ravichandran
VP Product Marketing , APM & DevOps
CA Technologies
National Australia Bank (NAB) : How we used
CA APM during performance testing to improve
transaction performance by 85%

2. NAB Transformation
Technology Centric Tools
Application Performance Management
DevOps
Agenda
Imminent Future is Customer Centric
1
2
3
4
5

3. Our Financial Services Business
17th Largest Bank Globally
12+ Million Customers
42,000Employees
1,800+ Stores/Branches
10 Countries of Operations

4. Laser Focus on the Customer

5. JOURNEY
TECHNOLOGY TRANSFORMATION

6. Stage 2
APM in Dev
Stage 3
DevOps
Bank Evolution
Technology Transformation Journey
Stage 1
Technology Centric
Tools
RESULTS
User Experience Suffers
2009
RESULTS
Great User Experience
2011
RESULTS
User Experience as
Differentiator
2014

7. Stage 1: App Focused – Web Interface Into Bank
Technology
IT Operations
• Home grown or multiple
vendors
• Feature specific , no integration
App Development
• Dev centric
• Function specific (dev, QA, etc.)
Challenges
• Limited visibility in customer
experience
• Reactive “User-Based” alerting
• Hard to identify problematic app
• hotspots
Organization
IT Operations
APP PERFORMANCE
& PROBLEM
RESOLUTION
Service Delivery
Infrastructure
Network
Change
Management
Other Teams…
SeparatedToolsandGroups
Application
Development
APPLICATION
ROLLOUT
& LIFECYCLE
Development
Testing
Technical Service
Management
Solution Design
Other Teams…
DifficultCommunication
• Siloed tools and teams
• No cross-team visibility

8. FASTER
WE CAN DELIVER APPLCIATIONS

9. Stage 2: App Issues – Identify Early, Resolve Fast
Technology
IT Operations
• Home grown or multiple
vendors
• Feature specific , no
integration
App Development
• CA APM implemented in
pre-production (Introscope,
End User Experience)
Benefits
• Fast App Delivery!
• Faster troubleshooting,
deep app visibility
• Simple transaction
performance optimization
Organization
IT Operations
APP PERFORMANCE &
PROBLEM
RESOLUTION
Service Delivery
Infrastructure
Network
Change
Management
Other Teams…
ImprovedCommunication
App Development
APPLICATION
ROLLOUT
& LIFECYCLE
UnifiedDevelopment
• Improved communication between Dev
and ops
• Predictable Dev SLAs
• Still…siloed tools and De/Ops teams
App Development
Testing
Service Management
Solution Design
Other Teams…

10. • CA APM agents deployed on 80+ servers in 5 days
• 2 hrs. to build service-centric CA APM Dashboard
Solution -> Deploy CA APM in Pre-Production
Pre-Production Success - UBank
Login and Origination Transaction Performance
Situation
• Dev team spent 4 weeks
troubleshooting UBank R2A
performance issue
• 80+ servers - collecting log files
across
• Network packet capture
• Manually correlating
performance data
Challenges
• Heavy resource involvement
• Little improvement or direction
to resolution
• No progress on Dev side
• Delays with App rollout

11. Pre-Production Success UBank - CA APM In Action
OSB Dashboard
• Dev team spent 3 weeks
troubleshooting UBank R2A
performance issue
• 80+ servers - collecting log files
across
• Network packet capture
• Manually correlating
performance data
• Drill-down from UBank Dashboard
• Out of the box, no config required
Transaction Tracing
• Within an hour of tracing “Login”, several
problematic components identified
• From 30, narrowed to 2 Oracle transaction
components
• Eliminated the need to investing 10+ backend
systems

12. Time to Value
• Fast and scalable install (80 servers,
5 days)
• Simple configuration, running in
under two hours
• Immediate actionable information,
transaction tracing configured out-
of-the box
Pin Point Focus
• Reduce number of of components
we need to investigate from 30 to 2
• Eliminate the need for investigating
10+ back end systems
Pre-Production Success UBank - Service Measurable Results
Faster app delivery, improved app performance
Project Improvements
Project back on track (from Risk)
2 weeks
Elapsed time is 4 weeks
Actual APM effort only
App Performance
82%
faster
Login transaction performance
2.3sec
compared to before APM
Login time reduced by

13. HARMONY
DEVOPS BRING IS IT ALL TOGETHER IN

14. Stage 3: DevOps – Share the Goodness Across the Boundaries
Technology
IT Operations
• CA APM, Cloud Monitor
deployed in production
App Development
• Addition of CA Service
Virtualization, CA
Application Test to CA APM
in pre-production
Benefits
• Fast App delivery, great
quality, seamless user
experience
• Preemptive problem
resolution
• Cost is minimized and team
efficiency improved
Organization
IT Operations App Development
• Single Tools, Single Team!
• Org structure is optimal for agile development and operations
APP PERFORMANCE
& PROBLEM
RESOLUTION
Service Delivery
Infrastructure
Network
Change
Management
Other Teams…
APPLICATION ROLLOUT
& LIFECYCLE
InfrastructureManagement
UnifiedDevandOpsTools
NoCommunicationBarriers
Development
Testing
Tech Service
Management
Solution Design
Other Teams…
CAAPM,CACloudMonitor
CAAPM,CALISA
DevFunctionalTools
Dev and Ops “talk the same language” to accelerate app delivery

15. CA APM at NAB - From Development to Operations
• CA APM enables Dev and ops to “talk the same
language”, accelerating app delivery and Org
transformation
• Transaction response reduced from 20sec to 3sec
Enable DevOps Transformation
85% Decrease in Transaction Time
• Ability to trace transactions across our current
mainframe & new core baking platforms
Transaction Tracing & Mainframe
• Using same tools in Dev and Production help us
significantly reduce resolution time
Reduce Resolution Time

16. CUSTOMER FOCUS
IMMINENT FUTURE FOR NAB IS…

17. • Modernization dictates new
org adjustments
• DevOps model is deeply
embedded in the culture
• User centric model will drive
business owner participation
• Mobile is cornerstone of
our business, not only
customer (2+ M AMO
today) facing but also
internal
• Creating new & modern
App and Mobile
infrastructure (Oracle)
• Expanding to Mobile APM
and DevOps (native, hybrid,
web)
• Focus on pre-emptive
management
• App behavioral analytics
Imminent Future
UBANK – 100% User Centric, 100% DevOps
Technology Organization
End Users are at the center of DevOps cycle
Time for new banking experience!

19. DEVdesign
develop
test
deliver
measure
report monitorOPS
Pre-DevOps
design
test
monitor
report
assess
develop deliver
measure
DEVOPS
Post-DevOps
DevOps Transformation
Changing People, Processes, and Culture

20. Gartner Market Trends: ARA, DevOPs and Mobile Device Management
Ignite Configuration Management, Laurie F. Wurster, Ronni Colville,
November 27, 2014.
CA DevOps Marketecture
Application
Delivery
Infrastructure
Management
Application
Performance
Management
DevOps
=> [developers]:/collaborate/APM operations =>
<= /accelerate /(new applications).delivery <=
“DevOps represents a change in IT culture as a trade-off for rapid IT service
delivery through the adoption of agile and lean practices in the context of a
systems-oriented approach.” – Gartner* (2014)
*Source : Gartner Market Trends: ARA, DevOPs and Mobile Device Management Ignite Configuration Management, Laurie F. Wurster, Ronni Colville, November 27, 2014.

21. CA DevOps: Application Delivery
Achieving Speed and Quality
Developer
Developer
Developer
DEV
DEV
DEV
TESTING
TESTING
Integration UAT/Staging Performance Production Operations
Continuous Validation
CA Application Test/CA Cloud Test/
CA Test Data Management
Continuous Delivery
CA Release Automation/CA Cloud Manager
Agile Development
CA Service Virtualization

22. CA APM
On-Premise
APPLICATION ROOT CAUSE ANALYSIS
Diagnostics/Root-Cause Analysis/Transaction Tracing/Triage
APPLICATION BEHAVIOR ANALYTICS
IT Operation Analytics Multi-Metric Correlation
END-USER EXPERIENCE
App Performance Over the Network and Servers
SaaS
CLOUD MONITOR
Synthetic Transactions
CA DevOps :Application Performance Management
Inspire Users With Every App Interaction
Partners
3rd Party and
Extensions
Business
Viewpoint
Infrastructure
Aware APM
Mainframe
Aware APM

23. CA DevOps tools: Infrastructure Management
Improve service quality, predictability and efficiency with Unified IM
Foundation for Successful DevOps
Unified Infrastructure Management
Unified Management Portal
(Available via mobile)
Operational Intelligence Solutions
(e.g., Capacity Management, Service Operations Management, etc.)
Systems Storage Network Database Apps Cloud SaaS DCIM Other
Industry-leading and easiest-to-use domain solutions
Adaptable and extendable (over 140 probes in CA Nimsoft Monitor today)
CA Application
Performance Management
CA Cloud
Service Management
Other CA and
Third-Party Tools

24. 1
Strong IT Performance is competitive
advantage
2 DevOps practices improve IT performance
3 Organizational culture matters
4
Job satisfaction is #1 predictor of Org
performance
Relationships
Organizational Performance->IT Performance -> DevOps*
* 2014 State of DevOps Report, presented by Puppet Labs

25. Questions?