Alcino Vieira presents Oi's journey to structure agile testing in a bimodal IT and DevOps approach. Oi faced challenges with restrictions on time-to-market, ensuring stability in production environments, large data constraints, and tests not oriented to business processes. To address these challenges, Oi redesigned their QA and HP ALM strategy to be business-oriented and integrated CA solutions like Agile Requirements Designer, Service Virtualization, and Test Data Management. This new approach helped increase test coverage and automation, reduce costs, and better integrate agile and waterfall delivery pipelines.

1. World®
’16
Oi’s Journey on How to Structure Agile
Testing in a Bimodal IT and DevOps Approach
Alcino Vieira - IT Manager - OI
DO5X46S
DEVOPS

2. 2 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
© 2016 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2016 presentation is intended for informational purposes only and does not form any type
of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
For Informational Purposes Only
Terms of this Presentation

3. 3 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Abstract
Restructure the modus operandi of IT and Operations for Agile Testing approach within an IT
chain waterfall, with restrictions on time-to-market, ensure stability in production environments,
data mass constraints and tests not oriented to business processes.
With this focus, at OI SA hereby present a proposal for restructuring and repositioning of the
Quality process and team, thinking of Agile Testing, through disruptive methodology in
organizational culture, using CA solutions: CA Service Virtualization, CA Test Data Management
and Agile Requirements Designer.
Alcino Vieira
OI
Quality Assurance
IT Manager

4. 4 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
WHO IS OI?
IT OI: BIG NUMBERS
NEXT CHALLENGES
CHALLENGES
ADDRESSING THE CHALLENGES
ACHIEVEMENTS
1
2
3
4
5
6

5. 5 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
1. Who is Oi: A Convergent Telecom Services Company
Oi is one of the biggest companies in Brazil, employing, directly and indirectly, more
than 147,000 people. It’s started in 1998 during the privatization of the Brazilian
telecommunications sector. The pioneer among its competitors, the company offers
convergent telecom services, it has more than 72 million customers around the
country.
Oi has one of the biggest and most diverse telecom networks in the
world that reaches almost all the 5.570 Brazilian cities. Oi also has
the biggest Wi-Fi network of all of Latin America, with more than 1
million hotspots. The biggest fiber network in Brazil, which has
about 330,000 kilometers, also belongs to Oi.
RESIDENCIAL
SERVICES
B2B & M2M
SERVICES
PERSONAL MOBILE
FIX
MOBILE
BROADBAND
PAY TV

6. 6 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
2. IT OI: Big Numbers
+ 8000 integration test cases performed
manually in 30 applications and 3200
defects logged
+ 600 Change Requests/month deployed in production, where 240 Infrastructure,
360 Applications, being 100 from incidents, outside release timeline
~ 1500 Projects in progress across IT chain
196 Own Stores
630 Franchise owned
1.700 PAPs (door to door)
30.000 Call center positions
42 BI CDRs processed| 9.821 servers
14 MM invoiced clientes | 37 MM de recharges
+ 550
applications
Regression tests with 1500 test
cases p/month in 7 application:
1000 automated| 500 manually

7. 7 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
3. Challenges
In addition to the current challenges, new challenges have arrived, and already are reality…
§ Digital transformation | Agile Testing
§ DevOps | Bimodal
§ Continuous Integration | Continuous Delivery
Test oriented to business
§ Currently is systems-oriented, with focus on reducing
redundancies, increasing quality and efficiency.
§ Traceability between Tests Map and Monitoring Map
§ New responsibility of QA Leader / Business Analyst
Test Data and Service Virtualization
§ Reduce time and cost, increased security and quality
§ Maintenance of test scripts
Increased Test Coverage
§ + applications | + test cases | + tests types
§ in less time
Reduce and Integrate the Release Pipeline
§ Agile with Waterfall – legacy
§ From bimonthly to monthly or biweekly
…and, all this have to
integrated with OI
ecosystem
CHALLENGES
Test Automation
§ Acceptance
§ Functional
§ Integration
§ Unit
Release Mgmt.
Automation

8. 8 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
§ Digital transformation | Agile Testing
§ DevOps | Bimodal
§ Continuous Integration | Continuous Delivery
4. Addressing The Challenges (1/2)
Test oriented to business
§ Currently is systems-oriented, with focus on reducing
redundancies, increasing quality and efficiency.
§ Traceability between Tests Map and Monitoring Map
§ New responsibility of QA Leader / Business Analyst
Test Data and Service Virtualization
§ Reduce time and cost, increased security and quality
§ Maintenance of test scripts
Increased Test Coverage
§ + applications | + test cases | + tests types
§ in less time
Reduce and Integrate the Release Pipeline
§ Agile with Waterfall – legacy
§ From bimonthly to monthly or biweekly
…and, all this have to
integrated with OI
ecosystem
CHALLENGES
Test Automation
§ Acceptance
§ Functional
§ Integration
§ Unit
Release Manag.
Automation
SOLUTIONS in progress
§ QA Leader working together Business Analyst and Customer
during requirements phase to draw the Req. Diagram in ARD
§ QA and HP ALM strategy redesigned to be business-oriented
and integrate with CA ARD
§ The integration development area becomes responsible for SV and
dedicated contractor to develop and maintain the virtual services
§ The key development suppliers are being trained to consume SV
services during the construction phase
§ Automation of integration and regression tests
§ Increased functional coverage in working with Operations,
Software Factories and especially Business Areas
§ Review current release pipeline (new demands/ correctives)
§ Structure new environments for QA
§ Integrate Waterfall and Agile pipelines – Bimodal
§ Automated the Release Process
§ Scrum teams were defined
§ A cross functional structure was defined
§ New tools are being used/tested (Jenkins, Selenium, Docker,
GIT, Rally)
§ The entire IT lifecycle is being reviewed

9. 9 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA Agile Requirements Designer
PROJECT 002
CORRECTION (PKE) 001
PROJECT 003
PROJETO n
PROJECT 002
4. Addressing The Challenges (2/2)
CA Service Virtualization
CA Test Data Manager
Clarity PPM
RFT
ALM
UFT
LoadRunner
CUSTUMER BA
QA
Big Picture
Architecture +
Solution +
QA Strategy
Code +
Unit/ System
Tests
SIT + UAT
+ Regression
Production
RELEASE PIPELINE
Requirements

10. 10 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
5. ACHIEVEMENTS
TDM | SV | Automation | ARD | Transformation
Gestão de Release
Test Data Management § Automation of test cases with higher recurrence in 2016| saved ~U$ 300 k
Automated the 5 most common test case in 2016:
§ CREATE AN ACCOUNT
§ CREATE ACCOUNT CUSTOMER
§ CREATE ACCOUNT BILLING
§ CREDIT ANALYSIS
§ BILLING PROFILE CREATION
80h to specify
and build
Comparative runtimes:
§ 6,000 h of execution in 2016
§ ~ 400 manual test cases
§ Avg. Cost: ~ U$ 300,000
Volume Manual Automated Scripts TDM
1 Customer 15 Hours 20 Min 40 Seconds
100 Customers 1,460 Hours 30 Hours 1 Hour

11. 11 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
5. ACHIEVEMENTS
TDM | SV | Automation | ARD | Transformation
Gestão de Release
Test Data Management
Service Virtualization
Test Automation
Oriented to Business / ARD
Transformation
§ ~ 300 automated services last 2 months (with only 2 analysts)
§ Structuring a team dedicated to SV
§ Integration Test – 30% automated | saved ~ U$150,000 in 2016
§ Regression Test – 90% automated | saved ~ U$ 260,000 in 2016
§ Structure-oriented Business and traceability with monitoring map of critical
chain (operations)
§ Integrated Ecosystem – HP ALM, CA PPM, CA ARD, CA SV and CA TDM
§ COE Structured – Responsible for the development & maintenance of scripts
§ Board of Directors was created
§ 3 Scrum Teams were structured – Digital, Integration and Portal
§ Automation of test cases with higher recurrence in 2016| saved ~U$ 300 k

12. 12 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
6. Next Challenge – Integrate The Two World
CA Agile Requirements Designer
PROJECT 002
CORRECTION (PKE) 001
PROJECT 003
PROJETO n
PROJECT 002
CA Service Virtualization
CA Test Data Manager
Clarity PPM
RFT
ALM
UFT
LoadRunner
CUSTUMER BA
QA
Architecture +
Solution +
QA Strategy
Code +
Unit/ System
Tests
SIT + UAT
+ Regression
Production
RELEASE PIPELINE
Requirements

13. 13 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Questions?

14. 14 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Stay connected at communities.ca.com
Thank you.

15. 15 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
DevOps – Continuous Delivery
For more information on DevOps – Continuous Delivery, please
visit: http://cainc.to/PiTFpu