GTech Technology Focus Group organised an event on "Trends and Transformations on Quality Assurance & Quality Control"

1. ALM USING VISUAL STUDIO 2013
A TESTING PERSPECTIVE
MALINI VALSALA
07-AUG-2014
© Testhouse Ltd  Confidential and Proprietary

2. AGENDA
 About us
 ALM support in Visual Studio Suite
 Visual Studio
 Microsoft Test Manager
 Team Web Access
 Dashboards - Quality
 Q&A
© Testhouse Ltd.  Confidential and Proprietary

3. © Testhouse Ltd.  Confidential and Proprietary
 Headquartered in London with service centres in
UK, India and UAE, Kuwait, United States and
Africa
 Gold partnerships with Microsoft & HP
 Adoption of Testing Tools across different domains
 Sharing and adopting best practices and effective
strategies in multiple locations
ABOUT US

4. © Testhouse Ltd.  Confidential and Proprietary
TESTHOUSE SERVICES
People
Methods
&
Processes
Global Sourcing
• Dedicated testing experts
• Supported by a defined career path
• Aligned to a particular industry
• Actively involved in career-long training (industry-based and testing-based)
• Proven methodologies and processes – (Waterfall, Agile, Scrum etc)
• Informed by best practices and lessons learned from diverse projects
• Consistent application which ensures efficiency, consistency, and quality
• Approach that includes well-coordinated integration and hand-off points
between on and offshore testing functions
• Proven knowledge transfer and migration approaches
Technology
• Best of breed tools and assets applied consistently
• Structured approach to identifying what tools to use when
Keys to Success Components
Global provider of software Testing & QA services

5. ALM BENEFITS FROM VISUAL STUDIO SUITE
© Testhouse India Private Ltd.  Confidential and Proprietary
 Flexible environment
 Adapts to your team’s needs
 Removes barriers between roles
 Streamlines processes
Delivering high-quality software faster and more efficiently
 Plan
 Develop & Test
 Release
 Operate

6. MICROSOFT ALM SOLUTIONS
© Testhouse Ltd.  Confidential and Proprietary

7. ALM SOLUTIONS FOR QUALITY ENABLEMENT
© Testhouse Ltd.  Confidential and Proprietary
Work item tracking
Test lab
management
Build automation
Extensibility interfaces
SCM
Test execution
services
Deployment
automation
Reporting and BI
Lab infrastructure
Test recorders
and runners
Build engines
• Actionable
feedback
• Exploratory
testing
• Requirements
management
• Acceptance
criteria definition
• Developer testing
• Build automation
• Actionable
diagnostics
• Test planning and
management
• Test execution
• Lab management
• Production
monitoring
• Integrated incident
management
Quality metrics and
reporting
Role tailored tools
Role tailored tools
Microsoft Test Manager | Microsoft Visual Studio | Eclipse | Microsoft Feedback client | Microsoft Office | SharePoint | Browser apps |
System Center Operations Manager | SQL BI and Reporting

8. TOOLING
Team Foundation Server Reporting
Generalist Specialist
Manual Testing Some scripting
Creates scripts to
set up lab, create
data
Strong scripting
skills
Some
coding skills
Strong coding
Develops
automated testing
procedures
Expert
coding skills

9. VISUAL STUDIO – PROCESS IN PLACE
 Template support to handle diverse SDLC / STLC
processes
 Microsoft Visual Studio Scrum 2013
 MSF for Agile Software Development 2013
 MSF for CMMI Process Improvement 2013
 Version Control
 Team Foundation Version Control
 Git
 Build Control and Management
 Evaluate new builds and take them into testing

10. © Testhouse Ltd.  Confidential and Proprietary
TEST AUTOMATION
 Coded UI Tests
 Link Coded UI tests to manual tests
created in Test Manager
 Data driven with external file
 Define test effort
 Record manual test cases
 Automate using @parameters
Microsoft Test Manager Microsoft Visual Studio

11. © Testhouse Ltd.  Confidential and Proprietary
TEST AUTOMATION CODED UI TESTS
 Created in Visual Studio
 Generated from:
 Existing manual recording
 Coded UI recorder
 Locate controls to perform actions
 Add assertions

12. MICROSOFT TEST
MANAGER

13. © Testhouse Ltd.  Confidential and Proprietary
MTM OVERVIEW – TESTING CENTRE
 Testing Centre:
Create and execute test plans
Analyze test results
Enables good interactions within team

14. © Testhouse Ltd.  Confidential and Proprietary
MTM OVERVIEW – LAB CENTER
 Lab Centre:
Create and manage test environments
Execute tests on physical or virtual environments

15. © Testhouse Ltd.  Confidential and Proprietary
MICROSOFT TEST MANAGER - PLAN
Test Suites
Test Cases
Test Steps
Shared
Steps
Parameters

16. © Testhouse Ltd.  Confidential and Proprietary
EXAMPLE -REQUIREMENTS BASED TEST
SUITES
Automatically link Test Cases
to requirements or user
stories
• Add requirement to Test Plan
• Add Test Cases to the requirement
Can also be done manually
via Work Item link

17. © Testhouse Ltd.  Confidential and Proprietary
CREATE A NEW TEST CASE

18. © Testhouse Ltd.  Confidential and Proprietary
RUNNING A TEST CASE

19. © Testhouse Ltd.  Confidential and Proprietary
WHAT USUALLY HAPPENS WHEN A TESTER
FINDS A BUG?
 Submit rich bug reports from
the testing session
 Data logs to aid devs in
diagnosing issue
Graphic by Jeff Atwood (CodingHorror.com)
Works on
MY
Machine

20. © Testhouse Ltd.  Confidential and Proprietary
ANALYZE TEST RUNS
 Each execution of a test
produces results
 These results can be
analyzed to indicate a
‘Failure type’ and a
‘Resolution’
 Bugs can be raised during
analysis

21. © Testhouse Ltd.  Confidential and Proprietary
TEST PLAN - TEST RESULTS
 Displays test results for the
test plan as a whole
 How many tests failed /
passed / active
 Percentage of different
Failure types and Resolutions
of tests in the plan
 Filtered by test suite / tester

22. © Testhouse Ltd.  Confidential and Proprietary
EXPLORATORY TESTING
 Let an experienced tester use the application in
different user stories.
 A bug report can be created that contains all steps
in the test.
 A test case can also be generated for verification /
regression.
 A record is kept of every test session. These
contain links to added bugs, test cases etc.

23. TEAM WEB ACCESS &
DASHBOARD

24. TEAM WEB ACCESS
 Automatically installed, configured, and
updated when TFS is installed or updated
 Connect to Visual Studio Team Foundation
Server (TFS) through a web browser
 Provides much of the functionality that is
available through Team Explorer
 Tools for project management
 Team communications, track team processes,
and improve project oversight capabilities
“http:// ServerName:8080/tfs/CollectionName/ProjectName”
© Testhouse Ltd.  Confidential and Proprietary

25. TWA – FOR TESTING TEAMS
© Testhouse Ltd.  Confidential and Proprietary

26. © Testhouse Ltd.  Confidential and Proprietary
QUALITY DASHBOARD

27. © Testhouse Ltd.  Confidential and Proprietary
ALM INTEGRATION & TRACEABILITY
In a Nutshell:
Visual Studio ALM provides powerful, easy to use tools and reports to manage and track delivery
activity and quality throughout the whole development lifecycle.

28. REFERENCES
 Testing with Visual Studio Online
 Better Collaboration with Your Test Teams
Using Visual Studio 2013
 Improve your Automation Testing using VS
Coded UI
 Streamlining the SDLC using Release
Management
 Visual Studio Online for Application Insights &
Cloud Load Testing
© Testhouse Ltd.  Confidential and Proprietary
 http://th-ms.com/demo/visual-studio-online
 http://th-ms.com/demo/better-collaboration-
with-your-test-teams-using-visual-studio-
2013/
 http://th-ms.com/demo/improve-your-
automation-testing-using-vs-coded-ui/
 http://th-ms.com/demo/streamlinining-the-
sdlc-using-release-management-video/
 http://th-ms.com/demo/visual-studio-online-
for-application-insights-cloud-load-testing/

29. QUESTIONS?
© Testhouse Ltd.  Confidential and Proprietary

30. THANK YOU!!!
© Testhouse Ltd.  Confidential and Proprietary
CONTACT US:
T +91 471 270 0117
M +91 984 622 9995
MALINI.VALSALA@TESTHOUSE.NET