1. Calidad en entornos SAP
Álvaro del Ser // Engagement Manager
alvaro.delser@globetesting.com
2. ● Desafíos en entornos SAP
● Solución HP Software
● Visión general
● Gestión e integración
● Quality Center
● Pruebas funcionales
● Manuales – HP Sprinter
● Automáticas – HP UFT
● Pruebas no funcionales
● Rendimiento – HP LoadRunner
● Monitorización
● Procesos - HP APM
● Caso de éxito
● Preguntas
16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
Agenda
3. Desafíos en entornos SAP
La calidad como herramienta para la gestión del cambio
16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
4. .NET
JAVA
.NET
JAVA
ASP
SAP
.NET
ASP
.NET
JAVA
Equipo virtual
Equipo subcontratado
Asia
Equipo interno
Norteamérica
Equipo interno
Suramérica
Modernización de las Aplicaciones
Equipo interno
Norteamérica
Ayer
• Equipos locales, dedicados y en plantilla
• Enfoque monolítico, propietario, local, Web 1.0
• Autónomo, independiente, métodos escalonados
Hoy
• Equipos distribuidos, compartidos y virtuales
• Enfoque basado en servicios, abierto,
compartido, Web 2.0
• Integrado, metodologías versátiles
5. Evolución de las aplicaciones SAP
Composición flexible de
Procesos de negocio
Procesos de negocio
predefinidos
Plataforma de procesos de negocio
eSOA
Versatilidad
DW
CRM
3as partes
ERP
Tiempo
FI
R3
6. Gestión del cambio
• Governance
• Gestión del riesgo
• Cumplimiento normativas
• Ejemplos:
LOPD, SOX, SEC, FDA, Basel2
• Mantenimientos
• Nuevas funcionalidades
• Actualizaciones
• Rollouts nuevos módulos
• Cambios en los procesos de negocio
• Reorganizacion interna
• Nuevos productos, proveedores, …
Negocio Normativas Tecnología
… these change events impact the life cycle of most Enterprise Solutions
El cambio viene originado por 3 elementos principales
Consolid.
New
Implem.
Upgrades
Custom
Dev.Support
Pack
Hot
Packs
Effort
Cambios
constantes
New processes
Time
Cambios
planificados
Custom
Dev.Support
Pack
Custom
Dev.
7. Solución HP Software
Solución completa para entornos SAP y otras tecnologías
16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
8. Visión general
Preparación entornos y juego de datos de prueba
Creación de requisitos
desde Business Blueprint
Automatización y ejecución de pruebas
unitarias, funcionales e inicio a fin
HP Quality Center
HP LoadRunner
Actualiza SOLMAN
con información de
ejecuciones y defectos
Ejecución de pruebas
de rendimiento
HP Diagnostics
Diagnóstico de cuellos de botella
SAP Application
Diagnostics
HP Unified Functional
Testing
SAP Test Data Migration Server
9. HP QC / ALM
Quality Center (QC)
Requirements Management
Business Process Models
Test Management
Business Process Testing (BPT)
Defect management
Solution Manager
Business Blueprint
Definition of Scenarios, Business
Processes and Process Steps
SAP Business Content (BPR)
Solution Documentation Assistant for
semi-automatic setup
Business view: Documentation and
business requirements
Technical view: involved SAP and
non-SAP systems, Transactions,…
Starting point for customizing
Linked training material
Business Process Change
Analyzer (BPCA)
Identification of business processes
affected by code / customizing
changes / Support & Enhancement
Packages
Business Blueprint
Bus. Requirements
Test Objects
Documents
Incidents/Defects
Test results
Incidents/Defects
SolutionManagerAdapter
forQualityCenter
Performance Center (PC)
Performance Testing
Lab Management
Project Planning & Tracking
Test Acceleration & Optimization
Generation of Test Case and BPT components
for the SAP GUI Based Business Processes
Leverages BPCA Analysis for automated
maintenance of BPT test component and test
cases
HP UFT
Comprehensive UI Based Testing
Business Process Components Testing
HP Sprinter
Streamline manual testing by reuse and
by simplifying repetitive work
BPCA Analysis (Business Impact to Change Impact Testing)
Test Data Management Server (TDMS)
Reduce SAP data volume of non-production landscape
Scramble sensitive data according to your needs
Visión general
11. Gestión de versiones
Gestión de requisitos
Gestion de pruebas
Automatización Business Blueprint
Solution
Documentation
Gestión del cambio
Monitorización
Integración SAP Solution Manager
12. HP Quality Center
Gestión e integración
16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
13. HP Quality Center core
Supporting key stakeholders from across IT & the business
Development TeamsBusiness
Analysts
QA Teams
Allows organizations to lower costs by
capturing critical defects before they reach
production
Facilitates distributed collaboration and
communication between QA
teams, developers and business analysts on a
single platform
Enables organizations to manage release
process and make informed go/no go
decisions through real time reports
Single, scalable platform that enables a
consistent, repeatable process for:
• Requirement management
• Test planning, scheduling & execution
• Release & cycle management
• Defect management
• Real time reporting of progress and status
• Integration with Developer Environments
14. – Business analyst can collaborate on
application requirements without fear of
overriding other’s work
– Assess overall risk to the business through
real-time visibility of test coverage and
associated defects against business needs
– Assess the impact of change before changing
requirements
– Easy adoption by Business Analysts
Requirements Management
Key Benefits
Key Capabilities
– Define and track multiple requirement types
– Establish templates to ensure higher quality
requirements
– Manage requirements dependencies
– Bi-directional traceability from requirements
to requirements, tests and defects
– Manage change requests through formal
approval process
– Familiar rich test editor interface
– Version Control and Baselining
– Leverage existing assets in MS Word
15. Test Plan
– Create test cases to adequately test the
requirements
– Manage all test types (Functional,
Performance, Security) in one place
– Ensure requirements coverage through
traceability to requirements
– Manage change associated with
requirements changes
Key Benefits
Key Capabilities
– Design, build and manage manual and
automated test cases
– Link test cases to requirements
– Leverage test cases from MS Word and
MS Excel
– Version Control and Baselining
16. Test Scheduling and Execution
– Manage and control execution of manual and
automated tests
– Schedule the execution of automated test
scripts for unattended execution
– Execute manual tests via HP Sprinter
– View and assess test execution runs and
results including logging defects with run
details
Key Benefits
Key Capabilities
– Create ‘test sets’ or groups of tests to be
executed together
– Create ‘test sets’ based on releases and
cycles
– Define dependencies and design test
execution flows
– Assign to QA testers
– Assign to execution host
17. Defect Management
– Manage, track and enforce defects across the
application lifecycle
– Create defects from manually or directly from
the execution of manual and automated tests
– Clearly communicate bugs to developers with
context from requirements and tests
– Integrated into developers IDE
Key Benefits
Key Capabilities
– Enforce defect lifecycle process through
custom fields and workflow
– Log defects directly from test runs with test
details (test step, result, screenshots,
attachments) to ensure the developers can
reproduce the issue
– Traceability to requirements, tests and other
defects
– Alert key stakeholders through automated
emails
18. Reports, Graphs & Dashboard
– Make informed business decisions
– Clearly communicate to all stakeholders
– Understand the real-time status of an
application
– Full trending analysis and insight into
application projects
– Understand release and cycle progress
Key Benefits
Key Capabilities
– Fully customizable project reports (export
to MS Word)
– Integrated Dashboard
– Out of the box or customizable analysis
reports and graphs
– Report to MS Excel
– Embed graphs and charts into web portals
– Requirements traceability matrix
19. Pruebas Funcionales
Manuales o automáticas HP proporciona una solución integrada
16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
20. HP Sprinter
Pruebas manuales optimizadas
16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
37. Pruebas no funcionales
Certificación del rendimiento en entornos complejos
16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
39. The market leading solution for project performance validation
HP LoadRunner
Reduce Risk, Cost and Time
Enables consistent, repeatable process to:
• Emulate production workload
• Test a broad range of apps
• Identify performance bottlenecks
• Diagnose root cause of issues
• Optimize performance before deployment
40. 5 Analysis, Diagnostics and Reporting
DatabaseInternet/WAN
Middle Tier
(HTTP, WebSphere, Server, Network)ApplicationEnd User
Simulate
thousands of users
Transaction Record
‚Transfer
Funds‛
‚Check Balance‛
‚Pay Bills‛
Author Scripts1
Test
Scenario
Plan and Control Load
Tests
2
Generate Load3 Measure Impact4
How HP LoadRunner works
49. 16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
The business says: “Stop using our customers as monitoring devices”
“We’re always in catch-up”
“We monitor the infrastructure but still miss user experience
problems”
“It takes ages to figure out where the problem lies”
The business: “you need to demonstrate and control quality of service.”
End-User Experience Challenges
50. 16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
Early warning of actual
customer experience issues?
Plus adequate information to
prioritize them?
And detailed information in
order to resolve them?
• Allows for a proactive response
• Warning needs to based on
experiences for all users from all
locations all the time
• Isolate an issue to one customer, a
segment of customers, a location
or entire set of customers
• Associate business impact with
the issue
• Details of the path the user
performed during the transaction
• Details of how the user was truly
experiencing the application
when the issue occurred
If a service goes down, do you know
the business impact?
Do you have adequate information
to quickly resolve a customer
experience issue?
Do you monitor your application
based on customer calls?
What if you had…
51. 16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
Synthetic
Monitoring
•Proactively
monitor
application
performance and
availability
•Emulates user
behavior
Real User
Monitoring
•Monitor real user
transaction as they
flow across tiers
•Granular
Insight, Fast
Isolation
Service Level
Management
•Measure service
levels based on
user’s experience
•Report
application health
to the business
Anywhere
•24x7 Stability
•Global Scalability
•Monitor outside
the firewall from
any
location, cloud
ready
Run-Time Service Model
Solution HP End User Management
52. 16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
Integrated Business Service Health
Cloud,
SaaS &
Internal
Physical &
Virtual
Applications
Business
processes
Transactions
3rd party
data
BSM Run-time
Service Model
UCMDB
Event &
Performance Data
Business
Process
Application
and Services
Software
Infrastructure
Runtime Service Model
53. 16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
Synthetic User
Switzerland
Synthetic User
New York
Synthetic User
Singapore
• Synthetic Users are simulated by running scripts at
regular intervals from multiple locations
• Scripts verify availability and performance of your
critical business services
Description
• Proactive notification even when no one is using the
service (i.e. before banks open)
• Supports business-centric service level management
• Isolation capabilities reduce MTTR and associated
downtime cost
Benefits
Report
+
Alert
Launch
Script
Txn1 Txn2 Txn3
Verify Banking Service (script)
Synthetic Monitoring
54. 16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
• Proactively find availability and performance issues
before customers do
• Active monitoring from multiple locations
• Reduce end-user outages by proactively monitoring
performance and availability trends
• Leverages industry-standard HP LoadRunner load
testing scripts
• Support a broad range of protocols, technologies and
environments
• Automatic and dynamic calculation of
performance/availability thresholds
• Accelerate time to resolution through integration with
HP Diagnostics & TransactionVision
Synthetic Monitoring
55. 16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
HP Business Service
Management
Real
User Monitor
End
User
Mainframe/Database
Firewall
Web
Servers Application
Servers
Switch
Load Balancer
Internet
Mirrored
Traffic
• Agentless monitoring of transactions
• Gain visibility into real user behavior patterns
• Isolation capabilities reduce MTTR and associated
downtime cost
• Real user monitoring for all users, from all location, all the
time
• Captures real user experience from http/https or other
TCP/IP traffic
Description Benefits
Real User Monitoring
56. 16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
• Captures key user application performance
metrics such as roundtrip time, availability, and
application errors from all users, at all locations
, at all times
• Quantify business impact of an event by
drilling down to identify the precise number of
users affected, and specific domains impacted
• Detailed session data along with session replay
abilities to further isolation efforts
• Ability to agentlessly monitor application
transactions
Real User Monitoring
57. 16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
Requirement Synthetic Real
Check health when no one is using P
Monitor from multiple locations P
Diagnose actual user problems P
Track user behavior patterns P
Complete capture of business processes P P
Service level reporting P P
Unified End-User Monitoring
58. 16/05/2013Confidential and Propietary // All rights reserved // Globe Testing
Defines and publishes Performance &
Availability KPI’s for SLM
Monitors and Supports SLM for
Performance & Availability
Provides reporting and analytics for
Performance & Availability SLM
Business Rules & Financial Impact
Analysis
Service Level Management
61. Gracias
Álvaro del Ser // alvaro.delser@globetesting.com
Confidential and Propietary // All rights reserved // Globe Testing
Notes de l'éditeur
Equipos locales, dedicados y en plantilla (in-house)Métodosescalonados: Waterfall methodsMetodologíasversátiles: Agile methods[WEB 2.0 – RIA B/C PERFORMANCE AND SECURITY DRIVER; add to notes – even the vendors products are built this wayOrganizations have spent a decade or more automating their business through software. Most of the architecture was very siloed, monolithic and proprietary making it hard to maintain, change, or integrate which meant there was limited innovation. Not all have the supporting technology, systems and management processes to enable success throughout the lifecycle.Today we’re on the threshold of a massive refresh of Enterprise business applications. The next generation of SAP and Oracle applications will be based on SOA, which fundamentally requires a new architectural model. SOA adoption is also driving new custom applications and legacy integrations. And new Web 2.0 models like Ajax are leading customers to not only refresh web application and their web presence, but to build completely new models.All of these dynamics allow organizations to integrate and innovate business processes in a way they’ve never been able to do before. However, they need the right processes, the right products and the right management disciplines to realize the promise of agility and innovation while increasing quality and reducing cost.Slide MessageThe environment we are working in is changing – we cannot carry on with the same quality initiatives, we must recognise that the IT world is necessarily becoming more complex to support today’s agile business needs, and that means that to improve quality we need to develop even fasterSmall issues can have wider impact in today’s IT world. Increased reliance on new technologies such as SOA (whether directly or “under the covers” in the latest ERP versions), unproven technologies such as AJAX, and new platforms such as Vista mean that the IT world is changing underneath us. Building better quality in this environment is like building a house of cards during an earthquake. To ensure quality going forward, we need to first establish a solid platform
Requirements = translating business goals/objectives into a realized software-enabled business process. You need to understand the business goals and objectives AND you have to care about the IT approach and impact. This is a strategic control point in the process – if you don’t get it right, even if you do everything else perfectly, you will fail in the end if you have not delivered against the requirements. When you begin to understand the perspective of each side – you can see how the requirements will help bridge the gap between IT and the business.Key benefits:Manage requirements changes and impactMulti-dimensional traceabilityRequirements coverage analysisRequirements linkages to requirements, tests, defectsBi-directional traceability across the application quality lifecycleKey capabilitiesManage complete and verifiable requirements and dependenciesTrack multiple requirements typesAnalyze requirements change impactLeverage existing assets in MS WordIntegrates with demand systems, both strategic and operational
manage all test types in one place
Alert key stakeholders through automated emailsEnforce defect lifecycle process through custom fields and workflow
HP Quality Center has a new integrated Dashboard module to centralize Quality Center reporting and tools, including standard reports, excel reports and dashboard. Dashboard functionality is now integrated into QC for simplified installation, configuration and maintenanceHP Quality Center can export a report source into Microsoft Excel, letting your end users perform endless data manipulation. HP ALM adds the ability to produce standardized reports across projects and modules to provide end-to-end visibility of quality metrics across multiple QA initiatives.Features:Fully integrated Dashboard module to centralize HP Quality Center reporting tools including standard reports, excel reports and dashboardStandardized cross-project or cross-module reporting and drill-down graphsCustomizable pagesAnalysis tab with access to built-in reports and excel reports Make business decisions based upon holistic view of quality status, defect trends and requirements coverageAllocate resources based upon current progress and status of application releasesReport progress on test cyclesIntegrated dashboard provides simplified installation, configuration and maintenanceBenefits:Simplified installation, configuration and maintenanceEnd-to-end visibility of quality metrics across multiple QA initiativesFully integrated Dashboard module to centralize HP Quality Center reporting tools including standard reports, excel reports and dashboardCustom, role-based, shareable reportsCoverage graphs with drill down capability
Welcome to Sprinter 11.5, HP Application Lifecycle Management’s manual testing solution.Sprinter provides advanced functionality and capabilities to make manual test planning and execution more efficient and effective.
Sprinter Scanners automatically verify different aspects of application behavior and find potential defects. Using Scanners you can check whether strings in your application are spelled correctly, whether the application complies with Web Standards (for Web applications), if there are broken links or whether the user interface is translated correctly.You can select which scanners to use either before or during the run session. After each scan is completed, you can perform several actions on the results, such as create a defect or defect reminder.You can also extend Sprinter’s capabilities by defining custom scanners that can detect defects specific to your application.
HP Sprinter provides some unique capabilities to support exploratory testing. Exploratory testing is an effective approach for uncovering defects based on the tester’s knowledge of the functionality, of the changes to the application, and the high risk areas of the GUI. Exploratory testing may sound easy, but requires structure, context and accurate defect documentation to be useful. This can be challenging if the tester follows a path that leads to a defect, and then can’t remember how they got there. With HP Sprinter, you can apply process to your exploratory testing that cuts down on you test cycle time, creates reusable assets, and produces accurate, thorough defect descriptions.
We’re not done with what’s newAnnouncing UFT Mobile!And integrations with:SV integration– helps with hybrid composite appsTurnkey– accelerate testing even further with pre-built frameworksAnd tie into ALM to manage complete process and drive collaboration between dev and test
Purpose of Slide: Introduce LoadRunnerWith HP LoadRunner, project teams are able to effectively conduct load and performance testing of their solutions before impacting the production users. With LoadRunner’s wide range of supported protocols (over 50), projects are able effectively test almost any application. With the HP Diagnostics solution, difficult, deep code issues can be uncovered and corrected before end users discover the problems.With LoadRunner, project teams are able to:Reduce risk of deploying systems that do not meet performance requirementsReduce cost by predicting scalability and capacity and eliminating over-deploymentReduce time by shortening test cycle time. Accelerate delivery of high quality applications
Here it is the Virtual User generator – to develop scripts to test the load.
Once you are in the Virtual User generator (VUGen), you can select from a range of protocols based on the application/environment being tested.We will select the Ajax TruClient.
When using TruClient technology, you basically start executing the transition in the browser and the script gets automatically created.You can replay the script and then make few adjustments to your test.It is easy, quick and don’t require extensive knowledge.It reduces time and cost and increases productivity.
Here are the results of using TruClient. Scripts are automatically created when executing the transaction.
Now, it is time to test the load. Within the Controller, you can plan the load, control and execute the tests. You can select what views you want manage during the test and make adjustments in the load to get the best results in your load test.
Once tests are complete, you can analyze the results in many forms. LR provides robust graphics and reporting for test results analyses.Here we are looking at the Average response time per transactions.
As mentioned before, you can see multiple tabs with different data points for analyses. Here we are looking at the average download time (in seconds) for each web page and its components.