SlideShare une entreprise Scribd logo
1  sur  43
Télécharger pour lire hors ligne
Usability Testing 
2014 Highlights & Findings 
Ecaterina Moraru — 26 July 2014 —
Why is good to do usability 
sessions? 
You confirm issues you've suspected 
Get amazed by new things you discover 
“ 
” 
· 
·
SCENARIO 
Scenario #4 
PERIOD 
27 May - 12 June 2014 
VERSION 
XE 6.0 
SKIN 
Colibri 
DURATION 
9:45:45 h 
FEATURES 
Profile, Navigation, Pages, Wikis, 
Applications 
Usability Sessions 
3/44
Tasks
Tasks 
1 | First Impressions 
2 | Profile Editing 
3.1 | Wiki Navigation 
3.2 | Page Editing 
3.3 | Page Hierarchy 
4 | Sending Message 
6 | Welcome Editing 
7.1 | Wiki Creation 
7.2 | Application Install 
5 | Conclusions 
5/44
Task 1
INSTRUCTIONS HYPOTHESES 
What are your first 
impressions of XWiki? 
What do you think you can 
do with it? 
You can scroll, hover, but 
please don't click on 
anything yet. 
Introduction 
Testing: Homepage 
Status: Not-logged-in 
Status: Logged-in 
Task 1 
· 
· 
· 
· 
7/44
Task 2
INSTRUCTIONS HYPOTHESES 
Imagine this is your first 
day at work and XWiki is 
used internally. 
You want to customise 
your profile and add some 
information about yourself. 
How can you do that? 
UC1 : Measure the performance of 'menu-button' 
vs. 'icon-link' (#tmEdit vs. 
.editProfileCategory) 
9/9 'icon-link' usage 
Testing: Profile 
9/9 Success 
Task 2 
· 
· 
· 
9/44
(video) 
Task 2 - Profile Editing 
Safari Power Saver 
Click to Start Flash Plug-in 
· Add hints to Profile Preferences · Specify default values 
10/44
Task 3
INSTRUCTIONS SUBTASKS 
You've been given the assignment to add some 
content (text+image) for the Marketing team. 
Task 3.1 
Task 3.2 
Task 3.3 
INSTRUCTIONS HYPOTHESES 
First let's browse a bit the 
product and locate where 
the Marketing material is 
found. 
UC2 : Measure the performance of Search, 
Search Suggest vs. Wiki Index 
7/9 Search Suggest 
2/9 Wiki Index 
Testing: Navigation 
3/9 couldn't find 
Marketing without 
help 
Task 3 
Task 3.1 
· 
· 
· 
· 
12/44
(playlist) 
No suggest for partial words 
No Wiki results in Search 
Pressing Enter too fast 
3/9 Suggest worked in 
first try 
4/9 Suggest failed in 
first try 
Task 3.1 - Navigation - Search Suggest 
Safari Power Saver 
Click to Start Flash Plug-in 
· 
· 
· 
· 
· 
13/44
(video) 
Harder to find under menu 
No Wikis gadget on Homepage 
No Applications panel entry 
1/9 Used only Wiki Index 
2/9 Found it alone after 
Suggest fail 
Task 3.1 - Navigation - Wiki Index 
Safari Power Saver 
Click to Start Flash Plug-in 
· 
· 
· 
· 
· 
14/44
Task 3.2
INSTRUCTIONS HYPOTHESES 
You need to create a page 
called 'XWiki Enterprise' (in 
the Marketing location). 
As a result, the page should 
look similar to: 
UC3 : In order to edit, you need to be a 
member of the wiki. Measure task 
success. 
UC4 : Measure 'Add image' dialog naming. 
UC5 : Measure table performances. 
Testing: Page Creation 
Testing: Page Editing 
Extended: wiki syntax 
Extended: macro usage 
Task 3.2 
· 
· 
· 
· 
16/44
Task 3.2 - Page Creation 
EXPECTED RESULT 
0/9 expected result 
3/9 created Wiki 
2/9 edited Sandbox 
ACTUAL RESULTS 
· 
· 
· 
x2 x2 
17/44
(video) 
Task 3.2 - Page Creation 
EXPECTED RESULT ACTUAL RESULTS 
Safari Power Saver 
Click to Start Flash Plug-in 
18/44
(video) 
Task 3.2 - Page Creation 
EXPECTED RESULT ACTUAL RESULTS 
Safari Power Saver 
Click to Start Flash Plug-in 
19/44
(video) 
Task 3.2 - Page Creation 
EXPECTED RESULT ACTUAL RESULTS 
Safari Power Saver 
Click to Start Flash Plug-in 
20/44
(video) 
Task 3.2 - Page Creation 
ACTUAL RESULTS ACTUAL RESULTS 
Safari Power Saver 
Click to Start Flash Plug-in 
21/44
Task 3.2 - Page Creation 
Challenges: 
Finding the Add button 
Creating a Page and not something else 
Creating the page in the right location 
Issues: 
Problems finding the Add button 
Missing Add and Edit actions from Indexes 
Difficulties in finding Wiki Index and understand current location 
Confusion between Page and Wiki concepts 
Depending on the current location, having automatically Parent set 
Missing permissions by not completing the Join this wiki step 
· 
··· 
· 
······ 22/44
(video) 
4/9 used 'Join this wiki' 
Confusing between Move - Copy - 
Rename - Export 
Missing 'Add - Page' option 
Missing Rights to move pages 
Task 3.2 - Join this wiki 
Safari Power Saver 
Click to Start Flash Plug-in 
· 
· 
· 
· 
23/44
(playlist) 
Preference for 'External image' 
Save confirmation needed 
Improvements: Single click, Pre-filled 
label, etc. 
Task 3.2 - Page Editing 
Safari Power Saver 
Click to Start Flash Plug-in 
· 
· 
· 
24/44
Task 3.3
INSTRUCTIONS HYPOTHESES 
Create another page called 
'Products'. 
Link the 2 pages one from 
another in order to be able 
to navigate between them. 
Is it possible also to make 
an hierarchy? 
(where 'Products' page is 
on an upper level than 
'XWiki Enterprise' page) 
UC6 : Measure discoverability for 'Page 
Parent' functionality. 
UC7 : Asses the clearness of hierarchy 
display (breadcrumb, document 
index tree, document information, 
etc.). 
Testing: Page Linking 
7/9 WYSIWYG Page 
Linking 
Testing: Page Parent 
1/9 Page Parent 
Task 3.3 
· 
· 
· 
· 
26/44
(video) 
Missing visibility for Parent 
Cross wikis issues 
Tree is hidden and ambiguous 
Task 3.3 - Page Parent 
Safari Power Saver 
Click to Start Flash Plug-in 
· 
· 
· 
27/44
Task 4
INSTRUCTIONS HYPOTHESES 
You would like to let the 
manager know that the 
content has been added 
and the page is ready. 
How would you do that? 
UC8 : Evaluate alternative communication 
methods. 
8/9 Send Message 
1/9 Send Page by mail 
Testing: Send Message 
Testing: Page 
Comments 
Testing: Send Page by e-mail 
Task 4 
· 
· 
· 
· 
· 
29/44
Task 6
INSTRUCTIONS HYPOTHESES 
Go to the Home page and 
remove the first paragraph 
from the 'Welcome to your 
wiki' section. 
UC9 : As simple users the ability to edit 
inline is not available. Since the 
default editor is WYSIWYG, the user 
will not be able to remove the 
paragraph without removing the 
whole Dashboard macro. 
8/8 failed to edit the text 
2/8 changed the title 
2/8 deleted gadget 
Testing: Dashboard 
Testing: Inline Editing 
Task 6 
· 
· 
· 
· 
· 
31/44
Task 6 - Welcome Editing - Main (playlist) 
Safari Power Saver 
Click to Start Flash Plug-in 
32/44
Task 6 - Welcome Editing - Dashboard (playlist) 
Safari Power Saver 
Click to Start Flash Plug-in 
33/44
Task 7.1
INSTRUCTIONS HYPOTHESES 
You would like to create a 
dedicated place for 
Development material, just 
like the one existing for the 
Marketing team. 
Create such a location. 
UC10 : Evaluate the preference for wiki or 
space solution. 
3/9 Space instead of Wiki 
UC11 : Evaluate Distribution Wizard's 
impact and friendliness. 
6/9 Later 
1/9 Never 
2/9 Install 
Testing: Wiki Creation 
Testing: Space Creation 
Testing: Distribution 
Wizard 
Prereq: X user has 'Add 
Wiki' right 
Task 7.1 
· 
· 
· 
· 
· 
· 
· 
· 
35/44
Task 7.1 - Wiki Creation (video) 
Safari Power Saver 
Click to Start Flash Plug-in 
36/44
Task 7.2
INSTRUCTIONS HYPOTHESES 
The Development team 
could use a Calendar 
application. 
Find out how to install this 
application on your wiki. 
UC12 : Evaluate multiple Calendar 
applications naming ambiguity. 
6/8 Full Calendar Macro 
1/8 Calendar Panel 
Application 
1/8 Mocca Calendar 
Application 
Testing: Administration 
Testing: Application 
Panel 
Testing: Extension 
Manager 
Task 7.2 
· 
· 
· 
· 
· 
· 
38/44
(playlist) 
Display only Applications 
Add a Search button 
Provide entries in Suggest 
Task 7.2 - Application Install 
· 
· 
· 
39/44
Task 5
INSTRUCTIONS HYPOTHESES 
Thinking about your overall 
Conclusions 
experience with XWiki, 
what did you like about the 
product? 
What did you not like? 
Would you use it in the 
future? Why or why not? 
Task 5 
· 
41/44
Questions?
Thank you to all the participants 
and for your attention 
Ecaterina Moraru — 26 July 2014 —

Contenu connexe

En vedette (15)

About XWiki.org
About XWiki.orgAbout XWiki.org
About XWiki.org
 
Design process in an Open Community
Design process in an Open CommunityDesign process in an Open Community
Design process in an Open Community
 
Future of XWiki Skins
Future of XWiki SkinsFuture of XWiki Skins
Future of XWiki Skins
 
Interconectarea Semantica A Datelor In Contextul Managementului Informatiilor...
Interconectarea Semantica A Datelor In Contextul Managementului Informatiilor...Interconectarea Semantica A Datelor In Contextul Managementului Informatiilor...
Interconectarea Semantica A Datelor In Contextul Managementului Informatiilor...
 
XWiki Improvements Review (ver 2.4 - 5.1)
XWiki Improvements Review (ver 2.4 - 5.1)XWiki Improvements Review (ver 2.4 - 5.1)
XWiki Improvements Review (ver 2.4 - 5.1)
 
Mashups
MashupsMashups
Mashups
 
Development Process, the XWiki way
Development Process, the XWiki wayDevelopment Process, the XWiki way
Development Process, the XWiki way
 
Evolution of CSS
Evolution of CSSEvolution of CSS
Evolution of CSS
 
Do you really need to test with only 5 users
Do you really need to test with only 5 usersDo you really need to test with only 5 users
Do you really need to test with only 5 users
 
Exploring and Integrating UX in Open Source Software Development
Exploring and Integrating UX in Open Source Software Development Exploring and Integrating UX in Open Source Software Development
Exploring and Integrating UX in Open Source Software Development
 
Success stats from OSD community
Success stats from OSD communitySuccess stats from OSD community
Success stats from OSD community
 
Software Testing
Software TestingSoftware Testing
Software Testing
 
Visual Communication through Infographics
Visual Communication through InfographicsVisual Communication through Infographics
Visual Communication through Infographics
 
Captcha
CaptchaCaptcha
Captcha
 
Visual Cryptography
Visual CryptographyVisual Cryptography
Visual Cryptography
 

Similaire à XWiki Usability Testing Sessions

NI Package Manager
NI Package ManagerNI Package Manager
NI Package ManagerDMC, Inc.
 
Web 2.0 Quiz & Assessment Tools
Web 2.0 Quiz & Assessment ToolsWeb 2.0 Quiz & Assessment Tools
Web 2.0 Quiz & Assessment ToolsMohamed Amin Embi
 
Lessons learn from building accessible complex web apps
Lessons learn from building accessible complex web appsLessons learn from building accessible complex web apps
Lessons learn from building accessible complex web appsIntopia
 
UiPath Community - Dallas - Studio Web.pdf
UiPath Community - Dallas - Studio Web.pdfUiPath Community - Dallas - Studio Web.pdf
UiPath Community - Dallas - Studio Web.pdfDianaGray10
 
UXPA2019 I am the LAAW! The Lean Accessibility Audit Workshop
UXPA2019  I am the LAAW!   The Lean Accessibility Audit WorkshopUXPA2019  I am the LAAW!   The Lean Accessibility Audit Workshop
UXPA2019 I am the LAAW! The Lean Accessibility Audit WorkshopUXPA International
 
Group presentation final1
Group presentation final1Group presentation final1
Group presentation final1MEDT7462
 
Drupalcon Sessions about Devops
Drupalcon Sessions about DevopsDrupalcon Sessions about Devops
Drupalcon Sessions about DevopsAGILEDROP
 
I Am the LAAW! (Lean Accessibility Audit Workshops)
I Am the LAAW! (Lean Accessibility Audit Workshops)I Am the LAAW! (Lean Accessibility Audit Workshops)
I Am the LAAW! (Lean Accessibility Audit Workshops)Michael Ryan
 
iLife & iWork PowerBoost Presentation
iLife & iWork PowerBoost PresentationiLife & iWork PowerBoost Presentation
iLife & iWork PowerBoost PresentationTracy Zang
 
Interview Projects
Interview ProjectsInterview Projects
Interview Projectsyichen
 
10 Web Performance Lessons For the 21st Century
10 Web Performance Lessons For the  21st Century10 Web Performance Lessons For the  21st Century
10 Web Performance Lessons For the 21st CenturyMateusz Kwasniewski
 
Towards Collaborative Portable Web Spaces
Towards Collaborative Portable Web SpacesTowards Collaborative Portable Web Spaces
Towards Collaborative Portable Web Spacesstsire
 
OpenY: Scaling and Sharing with Custom Drupal Distribution
OpenY: Scaling and Sharing with Custom Drupal DistributionOpenY: Scaling and Sharing with Custom Drupal Distribution
OpenY: Scaling and Sharing with Custom Drupal DistributionDrupalCamp Kyiv
 
Building, Collaborating and Scaling Drupal Distributions for Federated Organi...
Building, Collaborating and Scaling Drupal Distributions for Federated Organi...Building, Collaborating and Scaling Drupal Distributions for Federated Organi...
Building, Collaborating and Scaling Drupal Distributions for Federated Organi...Acquia
 
A Complete Solution for Web Development
A Complete Solution for Web DevelopmentA Complete Solution for Web Development
A Complete Solution for Web DevelopmentEdureka!
 

Similaire à XWiki Usability Testing Sessions (20)

NI Package Manager
NI Package ManagerNI Package Manager
NI Package Manager
 
Web 2.0 Quiz & Assessment Tools
Web 2.0 Quiz & Assessment ToolsWeb 2.0 Quiz & Assessment Tools
Web 2.0 Quiz & Assessment Tools
 
Lessons learn from building accessible complex web apps
Lessons learn from building accessible complex web appsLessons learn from building accessible complex web apps
Lessons learn from building accessible complex web apps
 
UiPath Community - Dallas - Studio Web.pdf
UiPath Community - Dallas - Studio Web.pdfUiPath Community - Dallas - Studio Web.pdf
UiPath Community - Dallas - Studio Web.pdf
 
UXPA2019 I am the LAAW! The Lean Accessibility Audit Workshop
UXPA2019  I am the LAAW!   The Lean Accessibility Audit WorkshopUXPA2019  I am the LAAW!   The Lean Accessibility Audit Workshop
UXPA2019 I am the LAAW! The Lean Accessibility Audit Workshop
 
Group presentation final1
Group presentation final1Group presentation final1
Group presentation final1
 
Drupalcon Sessions about Devops
Drupalcon Sessions about DevopsDrupalcon Sessions about Devops
Drupalcon Sessions about Devops
 
SFSCON23 - Juri Solovjov - Flaky tests – how to deal with them
SFSCON23 - Juri Solovjov - Flaky tests – how to deal with themSFSCON23 - Juri Solovjov - Flaky tests – how to deal with them
SFSCON23 - Juri Solovjov - Flaky tests – how to deal with them
 
I Am the LAAW! (Lean Accessibility Audit Workshops)
I Am the LAAW! (Lean Accessibility Audit Workshops)I Am the LAAW! (Lean Accessibility Audit Workshops)
I Am the LAAW! (Lean Accessibility Audit Workshops)
 
iLife & iWork PowerBoost Presentation
iLife & iWork PowerBoost PresentationiLife & iWork PowerBoost Presentation
iLife & iWork PowerBoost Presentation
 
Interview Projects
Interview ProjectsInterview Projects
Interview Projects
 
10 Web Performance Lessons For the 21st Century
10 Web Performance Lessons For the  21st Century10 Web Performance Lessons For the  21st Century
10 Web Performance Lessons For the 21st Century
 
Towards Collaborative Portable Web Spaces
Towards Collaborative Portable Web SpacesTowards Collaborative Portable Web Spaces
Towards Collaborative Portable Web Spaces
 
OpenY: Scaling and Sharing with Custom Drupal Distribution
OpenY: Scaling and Sharing with Custom Drupal DistributionOpenY: Scaling and Sharing with Custom Drupal Distribution
OpenY: Scaling and Sharing with Custom Drupal Distribution
 
Clicksmart
ClicksmartClicksmart
Clicksmart
 
Building, Collaborating and Scaling Drupal Distributions for Federated Organi...
Building, Collaborating and Scaling Drupal Distributions for Federated Organi...Building, Collaborating and Scaling Drupal Distributions for Federated Organi...
Building, Collaborating and Scaling Drupal Distributions for Federated Organi...
 
Homestead demo
Homestead demoHomestead demo
Homestead demo
 
A Complete Solution for Web Development
A Complete Solution for Web DevelopmentA Complete Solution for Web Development
A Complete Solution for Web Development
 
Drupalusability
DrupalusabilityDrupalusability
Drupalusability
 
Learning selenium sample
Learning selenium sampleLearning selenium sample
Learning selenium sample
 

Plus de Ecaterina Moraru (Valica)

Plus de Ecaterina Moraru (Valica) (14)

UI/UX Tips & Tricks for developers - FOSDEM2020
UI/UX Tips & Tricks for developers - FOSDEM2020UI/UX Tips & Tricks for developers - FOSDEM2020
UI/UX Tips & Tricks for developers - FOSDEM2020
 
UI/UX Tips & Tricks for developers
UI/UX Tips & Tricks for developersUI/UX Tips & Tricks for developers
UI/UX Tips & Tricks for developers
 
Sketching Session
Sketching SessionSketching Session
Sketching Session
 
CSS Grid vs. Flexbox
CSS Grid vs. FlexboxCSS Grid vs. Flexbox
CSS Grid vs. Flexbox
 
Designing in the open
Designing in the openDesigning in the open
Designing in the open
 
XWiki Skin 10.x+ ideas
XWiki Skin 10.x+ ideasXWiki Skin 10.x+ ideas
XWiki Skin 10.x+ ideas
 
Difficulties in having more designers participate in Open Source
Difficulties in having more designers participate in Open SourceDifficulties in having more designers participate in Open Source
Difficulties in having more designers participate in Open Source
 
CSS Variables — Native reusable custom properties
CSS Variables — Native reusable custom propertiesCSS Variables — Native reusable custom properties
CSS Variables — Native reusable custom properties
 
Icon Themes
Icon ThemesIcon Themes
Icon Themes
 
Design proposals status 9.x
Design proposals status 9.xDesign proposals status 9.x
Design proposals status 9.x
 
What's new in XWiki 8.x and half of 9.x
What's new in XWiki 8.x and half of 9.x What's new in XWiki 8.x and half of 9.x
What's new in XWiki 8.x and half of 9.x
 
Expectations from Open Source Designers
Expectations from Open Source DesignersExpectations from Open Source Designers
Expectations from Open Source Designers
 
Tehnici De Tip Mashup Pentru Interactiuni Web In Sisteme Informationale Geogr...
Tehnici De Tip Mashup Pentru Interactiuni Web In Sisteme Informationale Geogr...Tehnici De Tip Mashup Pentru Interactiuni Web In Sisteme Informationale Geogr...
Tehnici De Tip Mashup Pentru Interactiuni Web In Sisteme Informationale Geogr...
 
Interconectarea Semantica A Datelor In Contextul Managementului Informatiilor...
Interconectarea Semantica A Datelor In Contextul Managementului Informatiilor...Interconectarea Semantica A Datelor In Contextul Managementului Informatiilor...
Interconectarea Semantica A Datelor In Contextul Managementului Informatiilor...
 

Dernier

Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 

Dernier (20)

Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 

XWiki Usability Testing Sessions

  • 1. Usability Testing 2014 Highlights & Findings Ecaterina Moraru — 26 July 2014 —
  • 2. Why is good to do usability sessions? You confirm issues you've suspected Get amazed by new things you discover “ ” · ·
  • 3. SCENARIO Scenario #4 PERIOD 27 May - 12 June 2014 VERSION XE 6.0 SKIN Colibri DURATION 9:45:45 h FEATURES Profile, Navigation, Pages, Wikis, Applications Usability Sessions 3/44
  • 5. Tasks 1 | First Impressions 2 | Profile Editing 3.1 | Wiki Navigation 3.2 | Page Editing 3.3 | Page Hierarchy 4 | Sending Message 6 | Welcome Editing 7.1 | Wiki Creation 7.2 | Application Install 5 | Conclusions 5/44
  • 7. INSTRUCTIONS HYPOTHESES What are your first impressions of XWiki? What do you think you can do with it? You can scroll, hover, but please don't click on anything yet. Introduction Testing: Homepage Status: Not-logged-in Status: Logged-in Task 1 · · · · 7/44
  • 9. INSTRUCTIONS HYPOTHESES Imagine this is your first day at work and XWiki is used internally. You want to customise your profile and add some information about yourself. How can you do that? UC1 : Measure the performance of 'menu-button' vs. 'icon-link' (#tmEdit vs. .editProfileCategory) 9/9 'icon-link' usage Testing: Profile 9/9 Success Task 2 · · · 9/44
  • 10. (video) Task 2 - Profile Editing Safari Power Saver Click to Start Flash Plug-in · Add hints to Profile Preferences · Specify default values 10/44
  • 12. INSTRUCTIONS SUBTASKS You've been given the assignment to add some content (text+image) for the Marketing team. Task 3.1 Task 3.2 Task 3.3 INSTRUCTIONS HYPOTHESES First let's browse a bit the product and locate where the Marketing material is found. UC2 : Measure the performance of Search, Search Suggest vs. Wiki Index 7/9 Search Suggest 2/9 Wiki Index Testing: Navigation 3/9 couldn't find Marketing without help Task 3 Task 3.1 · · · · 12/44
  • 13. (playlist) No suggest for partial words No Wiki results in Search Pressing Enter too fast 3/9 Suggest worked in first try 4/9 Suggest failed in first try Task 3.1 - Navigation - Search Suggest Safari Power Saver Click to Start Flash Plug-in · · · · · 13/44
  • 14. (video) Harder to find under menu No Wikis gadget on Homepage No Applications panel entry 1/9 Used only Wiki Index 2/9 Found it alone after Suggest fail Task 3.1 - Navigation - Wiki Index Safari Power Saver Click to Start Flash Plug-in · · · · · 14/44
  • 16. INSTRUCTIONS HYPOTHESES You need to create a page called 'XWiki Enterprise' (in the Marketing location). As a result, the page should look similar to: UC3 : In order to edit, you need to be a member of the wiki. Measure task success. UC4 : Measure 'Add image' dialog naming. UC5 : Measure table performances. Testing: Page Creation Testing: Page Editing Extended: wiki syntax Extended: macro usage Task 3.2 · · · · 16/44
  • 17. Task 3.2 - Page Creation EXPECTED RESULT 0/9 expected result 3/9 created Wiki 2/9 edited Sandbox ACTUAL RESULTS · · · x2 x2 17/44
  • 18. (video) Task 3.2 - Page Creation EXPECTED RESULT ACTUAL RESULTS Safari Power Saver Click to Start Flash Plug-in 18/44
  • 19. (video) Task 3.2 - Page Creation EXPECTED RESULT ACTUAL RESULTS Safari Power Saver Click to Start Flash Plug-in 19/44
  • 20. (video) Task 3.2 - Page Creation EXPECTED RESULT ACTUAL RESULTS Safari Power Saver Click to Start Flash Plug-in 20/44
  • 21. (video) Task 3.2 - Page Creation ACTUAL RESULTS ACTUAL RESULTS Safari Power Saver Click to Start Flash Plug-in 21/44
  • 22. Task 3.2 - Page Creation Challenges: Finding the Add button Creating a Page and not something else Creating the page in the right location Issues: Problems finding the Add button Missing Add and Edit actions from Indexes Difficulties in finding Wiki Index and understand current location Confusion between Page and Wiki concepts Depending on the current location, having automatically Parent set Missing permissions by not completing the Join this wiki step · ··· · ······ 22/44
  • 23. (video) 4/9 used 'Join this wiki' Confusing between Move - Copy - Rename - Export Missing 'Add - Page' option Missing Rights to move pages Task 3.2 - Join this wiki Safari Power Saver Click to Start Flash Plug-in · · · · 23/44
  • 24. (playlist) Preference for 'External image' Save confirmation needed Improvements: Single click, Pre-filled label, etc. Task 3.2 - Page Editing Safari Power Saver Click to Start Flash Plug-in · · · 24/44
  • 26. INSTRUCTIONS HYPOTHESES Create another page called 'Products'. Link the 2 pages one from another in order to be able to navigate between them. Is it possible also to make an hierarchy? (where 'Products' page is on an upper level than 'XWiki Enterprise' page) UC6 : Measure discoverability for 'Page Parent' functionality. UC7 : Asses the clearness of hierarchy display (breadcrumb, document index tree, document information, etc.). Testing: Page Linking 7/9 WYSIWYG Page Linking Testing: Page Parent 1/9 Page Parent Task 3.3 · · · · 26/44
  • 27. (video) Missing visibility for Parent Cross wikis issues Tree is hidden and ambiguous Task 3.3 - Page Parent Safari Power Saver Click to Start Flash Plug-in · · · 27/44
  • 29. INSTRUCTIONS HYPOTHESES You would like to let the manager know that the content has been added and the page is ready. How would you do that? UC8 : Evaluate alternative communication methods. 8/9 Send Message 1/9 Send Page by mail Testing: Send Message Testing: Page Comments Testing: Send Page by e-mail Task 4 · · · · · 29/44
  • 31. INSTRUCTIONS HYPOTHESES Go to the Home page and remove the first paragraph from the 'Welcome to your wiki' section. UC9 : As simple users the ability to edit inline is not available. Since the default editor is WYSIWYG, the user will not be able to remove the paragraph without removing the whole Dashboard macro. 8/8 failed to edit the text 2/8 changed the title 2/8 deleted gadget Testing: Dashboard Testing: Inline Editing Task 6 · · · · · 31/44
  • 32. Task 6 - Welcome Editing - Main (playlist) Safari Power Saver Click to Start Flash Plug-in 32/44
  • 33. Task 6 - Welcome Editing - Dashboard (playlist) Safari Power Saver Click to Start Flash Plug-in 33/44
  • 35. INSTRUCTIONS HYPOTHESES You would like to create a dedicated place for Development material, just like the one existing for the Marketing team. Create such a location. UC10 : Evaluate the preference for wiki or space solution. 3/9 Space instead of Wiki UC11 : Evaluate Distribution Wizard's impact and friendliness. 6/9 Later 1/9 Never 2/9 Install Testing: Wiki Creation Testing: Space Creation Testing: Distribution Wizard Prereq: X user has 'Add Wiki' right Task 7.1 · · · · · · · · 35/44
  • 36. Task 7.1 - Wiki Creation (video) Safari Power Saver Click to Start Flash Plug-in 36/44
  • 38. INSTRUCTIONS HYPOTHESES The Development team could use a Calendar application. Find out how to install this application on your wiki. UC12 : Evaluate multiple Calendar applications naming ambiguity. 6/8 Full Calendar Macro 1/8 Calendar Panel Application 1/8 Mocca Calendar Application Testing: Administration Testing: Application Panel Testing: Extension Manager Task 7.2 · · · · · · 38/44
  • 39. (playlist) Display only Applications Add a Search button Provide entries in Suggest Task 7.2 - Application Install · · · 39/44
  • 41. INSTRUCTIONS HYPOTHESES Thinking about your overall Conclusions experience with XWiki, what did you like about the product? What did you not like? Would you use it in the future? Why or why not? Task 5 · 41/44
  • 43. Thank you to all the participants and for your attention Ecaterina Moraru — 26 July 2014 —