This document discusses integrating mobile and web app testing capabilities into Visual Studio Teams to enable testing across real devices and user conditions as part of the development and release process. It highlights how Perfecto's Continuous Quality Lab integrates with Visual Studio through extensions that allow for interactive test development on devices, automated testing with every build, and exploratory testing. A demo then shows how these capabilities help achieve velocity and quality goals through increased test coverage and the ability to find issues earlier in development cycles. The document encourages attendees to try a free trial of Perfecto's integration with Visual Studio Teams.
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
Mobile and Web App Testing for Visual Studio Teams
1. Mobile and Web App Testing for Visual Studio Teams
Start testing real end-user conditions on real devices!
2. A few housekeeping items
1. Submit
questions using the
Q&A panel.
2. Slides and
recording sent
after the webinar.
3. Please complete
survey after the
presentation.
3. Mobile and Web App Testing for Visual Studio Teams
Start testing real end-user conditions on real devices!
Donovan Brown
Senior Program Manager
DevOps Microsoft
Amir Rozenberg
Dir. of Product Management
Perfecto Mobile
Uzi Eilon
Director of Technology
Perfecto Mobile
5. PEOPLE C O L L A B O R AT E M O R E
S H A R E C O M M O N G O A L S
F O C U S O N I M P R O V E M E N T
PROCESS E L I M I N AT E WA S T E
I N C R E A S E E F F I C I E N C Y
S T R E A M L I N E F E E D B A C K
PRODUCTS S U P P O R T P R O C E S S E S
E N A B L E C O L L A B O R AT I O N
FA C I L I TAT E E X P E R I M E N TAT I O N
‘DevOps is the union of people, process, and products to enable
continuous delivery of value to our end users.’
BRINGING PEOPLE TOGETHER
DELIVERING VALUE FASTER
EXECUTING THE DEVOPS STRATEGY
6. The Digital Experience Challenge
Need Challenge Pain
Quality
Multiple environments scenarios
All digital platforms (mobile, desktop)
All digital apps (Mobile + Web)
Complex lab setup and management
Velocity
High release frequently
% Automation coverage
Drive fast feedback loop
Lab is not a 24/7 operation
7. Quality Requires Bringing User Experience into SDLC
Practices
Application quality in the digital era means ensuring the right user experience to drive engagement
Name: Sara
Location: London
Device: iphone 6, Android M
Carrier: BT
Network condition: 3G
Background apps: Instagram
Align coverage
planning to business
priorities
Automate lab
configuration to end
user condition
Communicate
application quality
risks in business terms
Multiple devices
Mobile | Tablet | Desktop
End user conditions
More…
Data
?
Test Cases
8. Minimal Required Capabilities for Success
24/7 Lab
Unattended automation
Always-on test ready lab with real devices
Mimic accurately the user environment
Create exact end user conditions in the lab
(device, network, location, etc.)
Make environments part of your scripting
Measure performance
Organizational fit
Accessible & sharable anywhere
Skillset fit (IDE, framework, prog. language)
Support for offshore manual testers
No vendor lock-in
Shared Platform for Apps and Ops
Shared platform across teams to drive ‘shift
left’ and enable DevOps
Common assets (functional, performance,
monitoring)
Meet Enterprise Needs
Corporate standard compliant
Governance (SSO, auditing, roles, etc.)
D E V E LO P + T E S T
P L A N + T R A C K
M O N I TO R + L E A R N
R E L E A S E
D E V E L O P M E N T P R O D U C T I O N
9. Perfecto’s CQ Lab Integrated with Visual Studio
Visual Studio Extension
• Test automation development in C# with Selenium
• Interactive test development on real devices
Visual Studio Team Services Extension
• Build and Test Orchestration
• Parallel Test Execution
Visual Studio Team Services Chrome Plug-in
• Exploratory testing
• Test reporting and bug capture
10. Demo : Testing Across the SDLC in Visual Studio
Interactive Test Development
Automated Testing with Every Build
Exploratory Testing
Detailed Test + User Persona Reporting
12. Customer Perspective: Velocity & Quality Achievements
“Perfecto’s integration to Visual Studio helped us to develop automation tests in record time, and then run them
on multiple devices in parallel as part of our build process. We’re now able to cover our text matrix in-sprint and
we’ve achieved this milestone 3 months ahead of schedule.”
- Head of Digital, F500 retail brand
“We were pleasantly surprised by how easy the integration of Perfecto with Visual Studio was. Our mobile and web teams now
run test automation on real devices, using C# and Selenium RemoteWebDriver. We were able to start testing from day one,
without the need to learn a new test framework or language.”
- QA Manager, Leading Financial Services Firm
13.
14. Try it for free today!
Perfecto’s Continuous Quality Lab
• FREE 50 Hours for 3 Months – Limited time offer
• 20+ Devices across 3 Geographic Locations
• Community – getting started guides, sample code, answers
Download and start testing on real devices today!
http://bit.ly/Perfecto-VSTS-Free
Introductions:
Welcome to the webinar titled (read slide)
Logistics:
Add in Q&A, etc
Introduce yourself (Amir)
Today with me is:
Donovan Brown from Microsoft
Uzi Elon from Perfecto
Submit questions using the Q&A panel.
We try to answer all questions during and after the presentation.
Our experts do not have access to the chat interface
Participate in the polls
Your participation is critical to a relevant, meaningful discussion.
Watch your email for a copy of the recording and slides
Today’s presentation will be recorded and sent to you.
Complete the survey following the presentation
Your feedback helps us provide educational tools like this webinar.
Introductions:
Welcome to the webinar titled (read slide)
Logistics:
Add in Q&A, etc
Introduce yourself (Amir)
Today with me is:
Donovan Brown from Microsoft
Uzi Elon from Perfecto
Key Points:
Digital transformation is disruptive
Consolidation of skills, efforts
Organizational shifts
Digital Heads (of payment as example)
User experience is not defined by a single screen, but many…
Responsive web as an example
TBD: Donovan’s view/Microsoft’s view
Growth in web
Etc
Donvan’s talk track:
* DevOps, Agile, how mobile is effecting traditional practices?
Quality and Velocity anchor this presentation. For most organizations they are equally important and strategic. Combined they also define the requirements for a cloud based CQ lab.
Quality – quality in this era doesn’t only mean that the application works, it means the app works in all the different environment scenarios which can impact the quality of the experience greatly. This sets a new challenge for teams and adds additional dimensions which are needed to be covered in testing. Setting up a lab that enables this is very complex.
Velocity – Velocity is a necessity. Releasing very frequent is needed to allow organizations to react fast to market changes and users demands. Being able to release in high frequency means the lab has to be a 24/7 operation. This is not trivial. It means there cannot be a single day where the lab is down and can delay the process.Dell is one of the world’s largest ecommerce organization. They have completely embraced a modern SDLC approach with 50 feature teams supporting their .Net web site and mobile apps. Today, they have the ability to deploy 2-4 new website features per week and striving to achieve same with Perfecto using C# with Selenium, Visual Studio, ~20 devices per test iteration
Key points:
Mobile – real user conditions are unpredictable and suboptimal
Quality is measured in eye of end user
To be successful:
Testing matrix growth consider end-user conditions
Align business to engineering
SLIDE OBJECTIVE: This the minimal set of critical capabilities required to be successful
For customers moving towards a more modern SDLC and adopting CI, the need for an always available lab shifts from nice-to-have to required. Organizations like Paychex, CapOne, , Verizon and Dell recognize the value delivered availability issues.
Reiterate the message that quality for mobile includes re-creating expected user conditions as part of functional testing.
Many organizations today are exploring the shift from commercial to open source tools. Any solution must support and align to their technical strategy and team skills.
The solution: Perfecto + Microsoft
Accelerate time to market
Move towards continuous quality
Enable DevOps transformation for digital: mobile and web application
Donovan to add perspectives
Uzi/Amir/Donovan introduce Demo:
Complete worklow from:
Automated test development in C# with Selenium – Visual Studio IDE
Automation with CI, testing with every build – VSTS
Detailed reporting for both test procedures and personas
Post test exploratory testing and reporting to VSTS
UZI
Uzi/Amir/Donovan introduce Demo:
Complete worklow from:
Automated test development in C# with Selenium – Visual Studio IDE
Automation with CI, testing with every build – VSTS
Detailed reporting for both test procedures and personas
Post test exploratory testing and reporting to VSTS
UZI
Close out with:
Free hours, course
How to get VS/VSTS
Community – get answers, code examples, and getting started guides
Follow up email will include the details.