SlideShare une entreprise Scribd logo
1  sur  42
Télécharger pour lire hors ligne
QA with Microsoft Test 
Manager and Lab 
Management 
Rofiqi Setiawan, Technology Specialist 
Microsoft Indonesia
Modern business applications 
Edge facing Self discoverable Bring your own device 
Continuous services
Modern app lifecycle 
Continuous value delivery with modern business applications 
Define 
Ideation 
Develop 
Idea to working 
software 
Implement Monitor 
SHORTENED 
CYCLE TIMES
Conventional QA in the Modern app lifecycle 
QA 
Testing post 
implementation. Mostly 
manual with limited 
automation. 
UAT 
Operations 
readiness 
verification 
UAT post 
implementation 
and systems 
testing 
Pre-deployment 
verification 
Document requirements 
as BRDs and 
functional specs 
Write code to 
implement 
requirements
Quality 
Enablement
Quality enablement practices 
Continuous quality for continuous value delivery 
Continuous quality 
Shortened cycle times
Acceptance test planning 
Business goals 
Actionable 
requirements 
Acceptance 
criteria 
Acceptance test 
plan 
Acceptance test 
driven 
development
Continuous acceptance testing 
User 
Interface 
Services 
Business Processes 
Business Rules and Logic 
Service integrations 
Data access 
Identity 
Data 
Manual testing 
Automated testing 
Automated testing
Lab management automation
Quality Enablement Solution Architecture 
Work item tracking Build automation Test lab management 
Extensibility interfaces 
SCM 
Test execution 
services 
Deployment 
automation 
Reporting and BI 
Lab infrastructure 
Test recorders and 
runners 
Build engines 
• Actionable feedback 
• Exploratory testing 
• Requirements 
management 
• Acceptance criteria 
definition 
• Developer testing 
• Build automation 
• Actionable 
diagnostics 
• Test planning and 
management 
• Test execution and 
defect reporting 
• Lab management 
• Production monitoring 
• Integrated incident 
management 
Quality metrics and 
reporting 
Role tailored tools
Microsoft 
Solution
The Microsoft Solution 
Traceability with work item tracking 
Requirements 
management 
Test lab 
management 
Source code 
management 
Extensibility interfaces 
Team 
development 
services 
Testing services 
Build and 
deployment 
automation 
Reporting and 
Business 
Intelligence 
Lab infrastructure Test recorders and 
runners 
Build engines 
• Microsoft Office 
• Feedback client 
• Microsoft Office and 
SharePoint 
• Microsoft Project 
• Browser apps 
• Visual Studio IDE 
• Eclipse 
• Cross-platform 
command line tools 
• Microsoft Test 
Manger 
• Microsoft Visual 
Studio Premium or 
Ultimate 
Microsoft System Center Microsoft Office and 
SharePoint 
Project 
planning and 
management 
Git
Quality Enablement Solution Architecture 
Work item tracking Build automation Test lab management 
Extensibility interfaces 
SCM 
Test execution 
services 
Deployment 
automation 
Reporting and BI 
Lab infrastructure 
Test recorders and 
runners 
Build engines 
• Actionable feedback 
• Exploratory testing 
• Requirements 
management 
• Acceptance criteria 
definition 
• Developer testing 
• Build automation 
• Actionable 
diagnostics 
• Test planning and 
management 
• Test execution and 
defect reporting 
• Lab management 
• Production monitoring 
• Integrated incident 
management 
Quality metrics and 
reporting 
Role tailored tools
Manual Testing
Software testing with Visual Studio
Business 
challenges 
Long, opaque manual testing 
cycles 
“No-repro” defect reports 
Repetitive and error prone 
Unable to track tested vs. 
untested code 
Solutions 
Actionable bugs containing 
data to reproduce defects 
Code coverage reports show 
untested features 
Automated fast-forward 
Connect dev and test with 
tools to instrument and repro 
Business value 
Reduce dev-test “ping pong” 
to cut waste 
Speed delivery of high 
quality software 
Delivered software meets 
user and value expectations
Manual Testing
Demo 
Manual Testing
Organize testing in multiple 
configurations 
Playback a prior recording to save 
time with frequently-repeated setup 
steps and prerequisites 
Pause, save, close, return, and 
pick up where you left off 
Bind data to controls, to 
support multiple iterations 
and future automation
System logs & configuration 
IntelliTrace Logs 
Detailed status and history visible 
to all team members 
Audio & Video recordings
Get an overview of the test run 
with summary pie charts, or drill 
into the details for each test. 
Analyze code coverage for manual 
tests to determine which specific 
parts of your code were tested . 
Associate manual test runs with 
builds and environments.
Exploratory 
Testing
Software testing with Visual Studio
Business 
challenges 
Prescribed test cases can’t 
anticipate all possible bug 
scenarios 
Ad-hoc testing often results 
in “no-repro” defects 
Unable to validate original 
bug has been fixed 
Solutions 
Leverage inherent tester 
creativity with ad-hoc testing 
Record ad-hoc test steps 
Create test cases from bugs 
to reproduce complex 
scenarios or to verify bug 
fixes later 
Business value 
Discover unknown scenarios 
and hidden defects 
Eliminate manual capturing 
of test steps to cut waste 
Increase quality in delivered 
software
Exploratory Testing
Demo 
Exploratory Testing
Create rich text comments 
with screenshots while 
exploring 
Exploratory sessions can be 
recorded to increase 
reproducibility 
The Test Runner docks on the left side 
of the screen and automatically records 
your steps as you explore 
Explore your application to 
uncover new defects
Comments and steps are 
automatically added 
File new bugs without ending the 
exploratory test session 
The exploratory test session is 
paused while you create a bug 
report 
Attach the video recorded during 
the exploratory test session for 
maximum reproducibility 
Quickly create an 
automatically linked test 
case for this bug
Add verification values to indicate 
the expected result 
Session is paused while creating test 
cases 
Test steps are added 
automatically
Comment block reflects the 
added bugs and tests 
Continue exploratory testing right 
from where you left off 
Quick access to bugs and test cases 
created during the session
Lab 
Management
Software testing with Visual Studio
Business 
challenges 
Modern apps run in diverse 
environments 
Difficult to repro issues found 
Replicating environments for 
test is time-consuming, costly 
Solutions 
Virtualization reduces cost to 
provision environments 
Templates allow a wide range 
of baselines to be spun up 
quickly and on demand 
Snapshots capture states for 
reproducing test conditions 
and verifying defects 
Business value 
Dramatically reduced 
hardware and maintenance 
expenses 
Improved quality and 
reliability of apps across 
platforms 
Operations engaged in 
earlier phases of testing
Lab management automation 
On-premise | Cloud
Demo 
Lab Management
Create a new environment using 
virtual machine templates in 
SCVMM 
Create an environment 
using machines running on 
SCVMM 
Create new environments 
on existing machines
Quickly choose multiple test 
suites to run after 
deployment 
Choose your environment, and build, 
deploy and test in that environment 
from a single dialog
Spin up virtual test environments from 
within Test Manager, or attach a virtual 
environment to a manual testing session 
Snapshot environments during 
manual testing to increase 
reproducibility
Test run results are attached to 
specific builds and environments 
Collect all the data required to 
recreate bugs from virtual 
environments
The Microsoft differentiation 
Application 
Lifecycle 
Continuous quality practices Role tailored tools Hybrid IT capable 
New value 
Continuous value delivery
Call to Action 
• Take Microsoft Virtual Academy (MVA) courses 
• http://aka.ms/mvasoftwaretesting 
• http://aka.ms/mvaswtestingvs 
• Use TechNet Virtual Lab (http://aka.ms/virt-labs) 
• http://aka.ms/VLTestPlanning 
• http://aka.ms/VLTestCase 
• http://aka.ms/VLExploratoryTest 
• Use Azure Trial (http://azure.microsoft.com/en-us/ 
pricing/free-trial/) 
• Download Visual Studio ‘14 CTP 
• http://aka.ms/vsctp14
QA with Microsoft Test Manager and Lab Management

Contenu connexe

Tendances

WSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
WSO2Con Asia 2014 - Effective Test Automation in an Agile EnvironmentWSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
WSO2Con Asia 2014 - Effective Test Automation in an Agile EnvironmentWSO2
 
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010Clemens Reijnen
 
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...DevDay.org
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comIdexcel Technologies
 
Testing Frameworks
Testing FrameworksTesting Frameworks
Testing FrameworksMoataz Nabil
 
Test Tooling in Visual Studio 2012 an overview
Test Tooling in Visual Studio 2012 an overviewTest Tooling in Visual Studio 2012 an overview
Test Tooling in Visual Studio 2012 an overviewClemens Reijnen
 
Tutorial ranorex
Tutorial ranorexTutorial ranorex
Tutorial ranorexradikalzen
 
Writing Test Cases in Agile
Writing Test Cases in AgileWriting Test Cases in Agile
Writing Test Cases in AgileSaroj Singh
 
Tips To Follow For A Simple QA Process
Tips To Follow For A Simple QA ProcessTips To Follow For A Simple QA Process
Tips To Follow For A Simple QA ProcessBugRaptors
 
Automation Testing by Ashwin Shiv
Automation Testing by Ashwin Shiv Automation Testing by Ashwin Shiv
Automation Testing by Ashwin Shiv Ashwin Shiv
 
Automated Testing vs Manual Testing
Automated Testing vs Manual TestingAutomated Testing vs Manual Testing
Automated Testing vs Manual Testingdidev
 
STARWEST 2010 - 7 Steps To Improving Software Quality using Microsoft Test Ma...
STARWEST 2010 - 7 Steps To Improving Software Quality using Microsoft Test Ma...STARWEST 2010 - 7 Steps To Improving Software Quality using Microsoft Test Ma...
STARWEST 2010 - 7 Steps To Improving Software Quality using Microsoft Test Ma...Anna Russo
 
Improving Software Quality- 2-day Tester Training
Improving Software Quality- 2-day Tester TrainingImproving Software Quality- 2-day Tester Training
Improving Software Quality- 2-day Tester TrainingAnna Russo
 
Software testing tools (free and open source)
Software testing tools (free and open source)Software testing tools (free and open source)
Software testing tools (free and open source)Wael Mansour
 

Tendances (20)

WSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
WSO2Con Asia 2014 - Effective Test Automation in an Agile EnvironmentWSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
WSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
 
Automation Framework/QTP Framework
Automation Framework/QTP FrameworkAutomation Framework/QTP Framework
Automation Framework/QTP Framework
 
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
 
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
 
Qa process
Qa processQa process
Qa process
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.com
 
Testing Frameworks
Testing FrameworksTesting Frameworks
Testing Frameworks
 
Test Tooling in Visual Studio 2012 an overview
Test Tooling in Visual Studio 2012 an overviewTest Tooling in Visual Studio 2012 an overview
Test Tooling in Visual Studio 2012 an overview
 
Best Practices for Testing in salesforce.com
Best Practices for Testing in salesforce.comBest Practices for Testing in salesforce.com
Best Practices for Testing in salesforce.com
 
Tutorial ranorex
Tutorial ranorexTutorial ranorex
Tutorial ranorex
 
Test Automation - Keytorc Approach
Test Automation - Keytorc Approach Test Automation - Keytorc Approach
Test Automation - Keytorc Approach
 
Writing Test Cases in Agile
Writing Test Cases in AgileWriting Test Cases in Agile
Writing Test Cases in Agile
 
Tips To Follow For A Simple QA Process
Tips To Follow For A Simple QA ProcessTips To Follow For A Simple QA Process
Tips To Follow For A Simple QA Process
 
Automation Testing by Ashwin Shiv
Automation Testing by Ashwin Shiv Automation Testing by Ashwin Shiv
Automation Testing by Ashwin Shiv
 
Automated Testing vs Manual Testing
Automated Testing vs Manual TestingAutomated Testing vs Manual Testing
Automated Testing vs Manual Testing
 
Test Automation
Test AutomationTest Automation
Test Automation
 
STARWEST 2010 - 7 Steps To Improving Software Quality using Microsoft Test Ma...
STARWEST 2010 - 7 Steps To Improving Software Quality using Microsoft Test Ma...STARWEST 2010 - 7 Steps To Improving Software Quality using Microsoft Test Ma...
STARWEST 2010 - 7 Steps To Improving Software Quality using Microsoft Test Ma...
 
The Fitnesse Fix
The Fitnesse FixThe Fitnesse Fix
The Fitnesse Fix
 
Improving Software Quality- 2-day Tester Training
Improving Software Quality- 2-day Tester TrainingImproving Software Quality- 2-day Tester Training
Improving Software Quality- 2-day Tester Training
 
Software testing tools (free and open source)
Software testing tools (free and open source)Software testing tools (free and open source)
Software testing tools (free and open source)
 

En vedette

Microsoft Test Manager
Microsoft Test ManagerMicrosoft Test Manager
Microsoft Test ManagerMitchDenny
 
Automatización de la calidad con Microsoft Test Manager, CodedUI y Lab Manage...
Automatización de la calidad con Microsoft Test Manager, CodedUI y Lab Manage...Automatización de la calidad con Microsoft Test Manager, CodedUI y Lab Manage...
Automatización de la calidad con Microsoft Test Manager, CodedUI y Lab Manage...Globe Testing
 
Database administration task distribution
Database administration  task distributionDatabase administration  task distribution
Database administration task distributionwrightpc
 
Photo Management System PPT
Photo Management System PPTPhoto Management System PPT
Photo Management System PPTShanthan Reddy
 
MTM Presentation
MTM PresentationMTM Presentation
MTM Presentationcken2009
 
Team Foundation Server Demo
Team Foundation Server DemoTeam Foundation Server Demo
Team Foundation Server Demophase2int
 
Introduction to Team Foundation Server (TFS) Online
Introduction to Team Foundation Server (TFS) OnlineIntroduction to Team Foundation Server (TFS) Online
Introduction to Team Foundation Server (TFS) OnlineDenis Voituron
 
Introduction To Confluence
Introduction To ConfluenceIntroduction To Confluence
Introduction To ConfluenceHua Soon Sim
 
Online Quiz System Project PPT
Online Quiz System Project PPTOnline Quiz System Project PPT
Online Quiz System Project PPTShanthan Reddy
 
Introduction To Jira
Introduction To JiraIntroduction To Jira
Introduction To JiraHua Soon Sim
 
Beyond the Gig Economy
Beyond the Gig EconomyBeyond the Gig Economy
Beyond the Gig EconomyJon Lieber
 
Guided Reading: Making the Most of It
Guided Reading: Making the Most of ItGuided Reading: Making the Most of It
Guided Reading: Making the Most of ItJennifer Jones
 

En vedette (16)

Microsoft Test Manager
Microsoft Test ManagerMicrosoft Test Manager
Microsoft Test Manager
 
Julho 2016 - Microsoft Test Manager
Julho 2016 - Microsoft Test ManagerJulho 2016 - Microsoft Test Manager
Julho 2016 - Microsoft Test Manager
 
Automatización de la calidad con Microsoft Test Manager, CodedUI y Lab Manage...
Automatización de la calidad con Microsoft Test Manager, CodedUI y Lab Manage...Automatización de la calidad con Microsoft Test Manager, CodedUI y Lab Manage...
Automatización de la calidad con Microsoft Test Manager, CodedUI y Lab Manage...
 
Photo Lab Unit System
Photo Lab Unit SystemPhoto Lab Unit System
Photo Lab Unit System
 
Database administration task distribution
Database administration  task distributionDatabase administration  task distribution
Database administration task distribution
 
Final COOP Report
Final COOP ReportFinal COOP Report
Final COOP Report
 
Photo Management System PPT
Photo Management System PPTPhoto Management System PPT
Photo Management System PPT
 
MTM Presentation
MTM PresentationMTM Presentation
MTM Presentation
 
Team Foundation Server Demo
Team Foundation Server DemoTeam Foundation Server Demo
Team Foundation Server Demo
 
Introduction to Team Foundation Server (TFS) Online
Introduction to Team Foundation Server (TFS) OnlineIntroduction to Team Foundation Server (TFS) Online
Introduction to Team Foundation Server (TFS) Online
 
Introduction To Confluence
Introduction To ConfluenceIntroduction To Confluence
Introduction To Confluence
 
Online Quiz System Project PPT
Online Quiz System Project PPTOnline Quiz System Project PPT
Online Quiz System Project PPT
 
Introduction To Jira
Introduction To JiraIntroduction To Jira
Introduction To Jira
 
Beyond the Gig Economy
Beyond the Gig EconomyBeyond the Gig Economy
Beyond the Gig Economy
 
Bill Aulet GEC2016 keynote speech March 16 2016 Medellin Colombia
Bill Aulet GEC2016 keynote speech March 16 2016 Medellin ColombiaBill Aulet GEC2016 keynote speech March 16 2016 Medellin Colombia
Bill Aulet GEC2016 keynote speech March 16 2016 Medellin Colombia
 
Guided Reading: Making the Most of It
Guided Reading: Making the Most of ItGuided Reading: Making the Most of It
Guided Reading: Making the Most of It
 

Similaire à QA with Microsoft Test Manager and Lab Management

qawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagementqawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagementsunil singh
 
Qspectrum - Cloud based Test Automation Solutions
Qspectrum - Cloud based Test Automation SolutionsQspectrum - Cloud based Test Automation Solutions
Qspectrum - Cloud based Test Automation SolutionsQSpectrum
 
Rational Quality Manager
Rational Quality ManagerRational Quality Manager
Rational Quality ManagerAlan Kan
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughAngela Dugan
 
Triple Assurance: AI-Powered Test Automation in UI Design and Functionality
Triple Assurance: AI-Powered Test Automation in UI Design and FunctionalityTriple Assurance: AI-Powered Test Automation in UI Design and Functionality
Triple Assurance: AI-Powered Test Automation in UI Design and FunctionalityApplitools
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and executionClemens Reijnen
 
Test Automation
Test AutomationTest Automation
Test Automationrockoder
 
Aspires Testing Services Presentation
Aspires Testing Services PresentationAspires Testing Services Presentation
Aspires Testing Services PresentationVasanthmusic
 
Microsoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingMicrosoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingAngela Dugan
 
04 test controlling and tracking
04   test controlling and tracking04   test controlling and tracking
04 test controlling and trackingClemens Reijnen
 
1 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 20091 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 2009Pepe
 
Lightning Talks by Globant - Automation (This app runs by itself )
Lightning Talks by Globant -  Automation (This app runs by itself ) Lightning Talks by Globant -  Automation (This app runs by itself )
Lightning Talks by Globant - Automation (This app runs by itself ) Globant
 
The state of testing @ Microsoft
The state of testing @ MicrosoftThe state of testing @ Microsoft
The state of testing @ MicrosoftRobert MacLean
 
Microsoft Testing Tour - Setting up a Test Environment
Microsoft Testing Tour - Setting up a Test EnvironmentMicrosoft Testing Tour - Setting up a Test Environment
Microsoft Testing Tour - Setting up a Test EnvironmentAngela Dugan
 
DevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementDevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementMicrosoft Developer Norway
 
Overview of Lab Management and TFS
Overview of Lab Management and TFSOverview of Lab Management and TFS
Overview of Lab Management and TFSChris Kadel, MBA
 
2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release Management2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release ManagementMicrosoft Switzerland (DX)
 
SV Training Intro - 20181129 4.pptx
SV Training Intro - 20181129 4.pptxSV Training Intro - 20181129 4.pptx
SV Training Intro - 20181129 4.pptxCAIKYPALLETAMOURALIM
 
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...[DevDay2019] Power of Test Automation and DevOps combination - One click savi...
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...DevDay.org
 

Similaire à QA with Microsoft Test Manager and Lab Management (20)

qawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagementqawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagement
 
Qspectrum - Cloud based Test Automation Solutions
Qspectrum - Cloud based Test Automation SolutionsQspectrum - Cloud based Test Automation Solutions
Qspectrum - Cloud based Test Automation Solutions
 
Rational Quality Manager
Rational Quality ManagerRational Quality Manager
Rational Quality Manager
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools Walkthrough
 
Triple Assurance: AI-Powered Test Automation in UI Design and Functionality
Triple Assurance: AI-Powered Test Automation in UI Design and FunctionalityTriple Assurance: AI-Powered Test Automation in UI Design and Functionality
Triple Assurance: AI-Powered Test Automation in UI Design and Functionality
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and execution
 
Test Automation
Test AutomationTest Automation
Test Automation
 
Aspires Testing Services Presentation
Aspires Testing Services PresentationAspires Testing Services Presentation
Aspires Testing Services Presentation
 
Microsoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingMicrosoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated Testing
 
Automation Concepts
Automation ConceptsAutomation Concepts
Automation Concepts
 
04 test controlling and tracking
04   test controlling and tracking04   test controlling and tracking
04 test controlling and tracking
 
1 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 20091 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 2009
 
Lightning Talks by Globant - Automation (This app runs by itself )
Lightning Talks by Globant -  Automation (This app runs by itself ) Lightning Talks by Globant -  Automation (This app runs by itself )
Lightning Talks by Globant - Automation (This app runs by itself )
 
The state of testing @ Microsoft
The state of testing @ MicrosoftThe state of testing @ Microsoft
The state of testing @ Microsoft
 
Microsoft Testing Tour - Setting up a Test Environment
Microsoft Testing Tour - Setting up a Test EnvironmentMicrosoft Testing Tour - Setting up a Test Environment
Microsoft Testing Tour - Setting up a Test Environment
 
DevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementDevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release management
 
Overview of Lab Management and TFS
Overview of Lab Management and TFSOverview of Lab Management and TFS
Overview of Lab Management and TFS
 
2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release Management2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release Management
 
SV Training Intro - 20181129 4.pptx
SV Training Intro - 20181129 4.pptxSV Training Intro - 20181129 4.pptx
SV Training Intro - 20181129 4.pptx
 
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...[DevDay2019] Power of Test Automation and DevOps combination - One click savi...
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...
 

Dernier

Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxYounusS2
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncObject Automation
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Things you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceThings you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceMartin Humpolec
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum ComputingGDSC PJATK
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdfJamie (Taka) Wang
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 

Dernier (20)

Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptx
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation Inc
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Things you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceThings you didn't know you can use in your Salesforce
Things you didn't know you can use in your Salesforce
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum Computing
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 

QA with Microsoft Test Manager and Lab Management

  • 1. QA with Microsoft Test Manager and Lab Management Rofiqi Setiawan, Technology Specialist Microsoft Indonesia
  • 2. Modern business applications Edge facing Self discoverable Bring your own device Continuous services
  • 3. Modern app lifecycle Continuous value delivery with modern business applications Define Ideation Develop Idea to working software Implement Monitor SHORTENED CYCLE TIMES
  • 4. Conventional QA in the Modern app lifecycle QA Testing post implementation. Mostly manual with limited automation. UAT Operations readiness verification UAT post implementation and systems testing Pre-deployment verification Document requirements as BRDs and functional specs Write code to implement requirements
  • 6. Quality enablement practices Continuous quality for continuous value delivery Continuous quality Shortened cycle times
  • 7. Acceptance test planning Business goals Actionable requirements Acceptance criteria Acceptance test plan Acceptance test driven development
  • 8. Continuous acceptance testing User Interface Services Business Processes Business Rules and Logic Service integrations Data access Identity Data Manual testing Automated testing Automated testing
  • 10. Quality Enablement Solution Architecture Work item tracking Build automation Test lab management Extensibility interfaces SCM Test execution services Deployment automation Reporting and BI Lab infrastructure Test recorders and runners Build engines • Actionable feedback • Exploratory testing • Requirements management • Acceptance criteria definition • Developer testing • Build automation • Actionable diagnostics • Test planning and management • Test execution and defect reporting • Lab management • Production monitoring • Integrated incident management Quality metrics and reporting Role tailored tools
  • 12. The Microsoft Solution Traceability with work item tracking Requirements management Test lab management Source code management Extensibility interfaces Team development services Testing services Build and deployment automation Reporting and Business Intelligence Lab infrastructure Test recorders and runners Build engines • Microsoft Office • Feedback client • Microsoft Office and SharePoint • Microsoft Project • Browser apps • Visual Studio IDE • Eclipse • Cross-platform command line tools • Microsoft Test Manger • Microsoft Visual Studio Premium or Ultimate Microsoft System Center Microsoft Office and SharePoint Project planning and management Git
  • 13. Quality Enablement Solution Architecture Work item tracking Build automation Test lab management Extensibility interfaces SCM Test execution services Deployment automation Reporting and BI Lab infrastructure Test recorders and runners Build engines • Actionable feedback • Exploratory testing • Requirements management • Acceptance criteria definition • Developer testing • Build automation • Actionable diagnostics • Test planning and management • Test execution and defect reporting • Lab management • Production monitoring • Integrated incident management Quality metrics and reporting Role tailored tools
  • 15. Software testing with Visual Studio
  • 16. Business challenges Long, opaque manual testing cycles “No-repro” defect reports Repetitive and error prone Unable to track tested vs. untested code Solutions Actionable bugs containing data to reproduce defects Code coverage reports show untested features Automated fast-forward Connect dev and test with tools to instrument and repro Business value Reduce dev-test “ping pong” to cut waste Speed delivery of high quality software Delivered software meets user and value expectations
  • 19. Organize testing in multiple configurations Playback a prior recording to save time with frequently-repeated setup steps and prerequisites Pause, save, close, return, and pick up where you left off Bind data to controls, to support multiple iterations and future automation
  • 20. System logs & configuration IntelliTrace Logs Detailed status and history visible to all team members Audio & Video recordings
  • 21. Get an overview of the test run with summary pie charts, or drill into the details for each test. Analyze code coverage for manual tests to determine which specific parts of your code were tested . Associate manual test runs with builds and environments.
  • 23. Software testing with Visual Studio
  • 24. Business challenges Prescribed test cases can’t anticipate all possible bug scenarios Ad-hoc testing often results in “no-repro” defects Unable to validate original bug has been fixed Solutions Leverage inherent tester creativity with ad-hoc testing Record ad-hoc test steps Create test cases from bugs to reproduce complex scenarios or to verify bug fixes later Business value Discover unknown scenarios and hidden defects Eliminate manual capturing of test steps to cut waste Increase quality in delivered software
  • 27. Create rich text comments with screenshots while exploring Exploratory sessions can be recorded to increase reproducibility The Test Runner docks on the left side of the screen and automatically records your steps as you explore Explore your application to uncover new defects
  • 28. Comments and steps are automatically added File new bugs without ending the exploratory test session The exploratory test session is paused while you create a bug report Attach the video recorded during the exploratory test session for maximum reproducibility Quickly create an automatically linked test case for this bug
  • 29. Add verification values to indicate the expected result Session is paused while creating test cases Test steps are added automatically
  • 30. Comment block reflects the added bugs and tests Continue exploratory testing right from where you left off Quick access to bugs and test cases created during the session
  • 32. Software testing with Visual Studio
  • 33. Business challenges Modern apps run in diverse environments Difficult to repro issues found Replicating environments for test is time-consuming, costly Solutions Virtualization reduces cost to provision environments Templates allow a wide range of baselines to be spun up quickly and on demand Snapshots capture states for reproducing test conditions and verifying defects Business value Dramatically reduced hardware and maintenance expenses Improved quality and reliability of apps across platforms Operations engaged in earlier phases of testing
  • 34. Lab management automation On-premise | Cloud
  • 36. Create a new environment using virtual machine templates in SCVMM Create an environment using machines running on SCVMM Create new environments on existing machines
  • 37. Quickly choose multiple test suites to run after deployment Choose your environment, and build, deploy and test in that environment from a single dialog
  • 38. Spin up virtual test environments from within Test Manager, or attach a virtual environment to a manual testing session Snapshot environments during manual testing to increase reproducibility
  • 39. Test run results are attached to specific builds and environments Collect all the data required to recreate bugs from virtual environments
  • 40. The Microsoft differentiation Application Lifecycle Continuous quality practices Role tailored tools Hybrid IT capable New value Continuous value delivery
  • 41. Call to Action • Take Microsoft Virtual Academy (MVA) courses • http://aka.ms/mvasoftwaretesting • http://aka.ms/mvaswtestingvs • Use TechNet Virtual Lab (http://aka.ms/virt-labs) • http://aka.ms/VLTestPlanning • http://aka.ms/VLTestCase • http://aka.ms/VLExploratoryTest • Use Azure Trial (http://azure.microsoft.com/en-us/ pricing/free-trial/) • Download Visual Studio ‘14 CTP • http://aka.ms/vsctp14

Notes de l'éditeur

  1. Microsoft Virtual Academy (MVA) => www.microsoftvirtualacademy.com TechNet Virtual Lab => http://aka.ms/virt-labs