%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
Building a culture of quality at scale
1. Pranav Verma
Sr. Engineering Manager
Developer Experience Tools
EMAIL:
pverma@walmartlabs.com
Building a Culture of Quality at Scale
October 23, 2018
E X P E R I E N C E T O O L S
CUSTO M ER
E X P E R I E N C E T O O L S
DEVELOPER
3. E X P E R I E N C E T O O L S
DEVELOPER
A Cultural Shift in Quality Automation within
Customer Experience Engineering
2016
4. E X P E R I E N C E T O O L S
DEVELOPER
You have 6 months to
automate100% for your P1/P2
test cases
5. E X P E R I E N C E T O O L S
DEVELOPER
Automate 2000+ Manual Test
Train 600 Associates
On-board 25+ number of Apps
Migrate FE to new Platform
THE DETAILS
6. E X P E R I E N C E T O O L S
DEVELOPER
An Organization Going Through a Transformation
DENIAL UPSET RESISTANCE ACCEPTANCE
7. The Before and After Transformation
2000+ Manual Test
100% P1/P2
Automated
Lack of accountability
around Quality
Shared ownership of Quality
2 Deployments a month
Daily deployments
Test limited to a single
browser
Multi-browser combinations part
of CI process
8. E X P E R I E N C E T O O L S
DEVELOPER
THE
SOLUTION
9. End to end test platform for web, native, and backend
services in different environments with reporting
capabilities.
10. WHY IS TEST ARMADA NEEDED?
Help Improve Development Process Best Practices
Shift Left Policy Automate Testing
Increase Test Data Integrity
Ensure High Quality Product for
the Customer
12. Ecosystem
REAL-TIME TRENDING
FUNCTIONAL
REAL-TIME TRENDING
PERFORMANCE
PUSH API PULL API
API GATEWAY
TEST ARMADA
DATA INSIGHTS
JS CLIENT JAVA CLIENT
JS CLIENT JAVA CLIENT
JS CLIENT JAVA CLIENT
JS CLIENT JAVA CLIENT
RWEB
SERVICES
NATIVE iOS
DATABASE SQL
JS CLIENT JAVA CLIENT
JS CLIENT JAVA CLIENT
NATIVE ANDROID
DATABASE NoSQL
TEST ARMADA
MOCKING
JS
JS
RWEB
NATIVE iOS
JS JAVA
DECLARITIVE
NATIVE ANDROID
SERVICES
TEST ARMADA
FUNCTIONAL
DECLARITIVE
DECLARITIVE
RWEB
SERVICES
SWIFT
JAVA
NATIVE iOS
NATIVE ANDROID
TEST ARMADA
PERFORMANCE
13. TYPICAL DEVELOPER WORKFLOW
CODE CHECK-IN PASS PASS
FEATURE DEVELOPMENT PR VERIFY MASTER VERIFY PROD VERIFY
WHERE
Local Dev Environment
WHAT
Functional Tests
HOW
Mocked
RESOURCES
Local, Shared, 3rd Party
WHERE
Build Server
WHAT
Functional &
Continuous Performance
HOW
Mocked
RESOURCES
Shared & 3rd Party
WHERE
Non-Prod
WHAT
Functional Tests
HOW
Mocked or Real Services
RESOURCES
Shared & 3rd Party
WHERE
Stage
WHAT
Functional & Performance
HOW
Real Services
RESOURCES
Shared & 3rd Party
14. Scope Across the Company
TEAMS WE SUPPORT
85 projects in 2 years
200 projects by 2020
1.2M Development Hours Saved
19.5M Functional Tests Executed
196M Mocked API Calls
LOCATIONS WE SUPPORT NUMBERS AT SCALE
Bay Area
San Diego
Bangalore
Canada
Omaha Hoboken
Bentonville
UK
Mexico
Point of Sales RCT ASDA Growth
USGM Jet.com Pharmacy GIF Store Systems OmniChannel
Customer Promise Hayneedle
USGR
EXPO
Portland