SlideShare a Scribd company logo
1 of 27
Download to read offline
Katrien Verbert
Designing Augmented Reality
Applications for Personal Health
Decision-Making
Francisco Gutiérrez Nyi Nyi Htun
Sven Charleer Robin De Croon
1
https://augment.cs.kuleuven.be/
PokemonGo 19 Crimes AR
2
[augment reality]
Apple’s AR
measure
3
4
Food labels are
considered an
essential element in
strategies against
unhealthy diets and
obesity. (Cecchini and
Warin, 2016)
5
6
PHARA: Personal Health Augmented Reality assistant
7
● Study AR in the critical moment of decision: when
users hold the food product in their hands.
● Assist users by providing rich and consistent visual
components that support their decision-making
process.
● Follow a user-centered approach in a iterative design
process.
● Study the impact of AR interfaces on how to present
information to the end-users in decision-making.
[goals]
8
Regarding subjective and objective factors:
What are the benefits and tradeoffs of using popular
layouts such as, stack, grid, list and pie in AR
applications within handheld and HMD experiences
to support decision-making?
[research question]
9
a) MS HoLolens (HMD) c) iPhone 6S (Smartphone)
b) NSW Joycon (controller)
[devices]
10
[iterative design]
11
[AR components]
12
[AR components]
Users' Decision Behavior in
Recommender Interfaces: Impact of
Layout Design (Chen and Tsoi, 2011)
List Layout
Stack Layout
13
[AR components]
Smartphone HoloLens
14
[AR components]
List Layout
List Layout
Smartphone HoloLens
15
[AR components]
List Layout
Grid Layout
Smartphone HoloLens
16
[AR components]
List Layout
Pie Layout
Smartphone HoloLens
● Within Subjects
● n = 28 (1F, 27M) Ages from 22 to 38 (M = 25.81, SD = 4.57)
● Number of conditions: 2 (HoloLens, Smartphone)
● Task 1:
- Select two products that you would like to have for dinner...
- Select two similar products...
- Select and replace with two alternatives...
- Reflection...
● Task 2:
- Imagine that you have some friends coming over... select two products… and put them in
the basket.
● Post-Questionnaires
○ TAM (Technology Acceptance)
○ NASA-TLX (Task Load Index)
17
[user study]
18
[scenario]
19
[results]
food choices overtime
Choice 1 Choice 2 Choice 3 Choice 4
Choice 1 Choice 2 Choice 3 Choice 4
20
[results]
21
[results]
22
[results]
23
[results]
24
[conclusions]
● We explored and evaluated different layouts to present
information in a decision-making scenario.
○ Our results are comparable to those of (Chen and Tsoi, 2011)
● PHARA allows users to make informed decisions, and
resulted in selecting healthier food products.
● Stack layout performs better with HMD devices with a
limited field of view, like the HoloLens, at the cost of some
affordances.
● The grid and pie layouts performed better in handheld
devices, allowing to explore with more confidence,
enjoyability and less effort.
25
[future work]
● Long-term goal: influence healthy grocery store
shopping and in-restaurant purchase behavior.
● Evaluate the potential of our approach in real-life
settings.
● Development of more AR components following a
user-centered approach.
● Wine decision-support scenario coming up.
(PHARA Wine)
26
[phara wine]
27
[questions]
Francisco Gutiérrez
[Augment/HCI - KU Leuven]
francisco.gutierrez@cs.kuleuven.be
@FranciscoGhz | Twitter
https://augment.cs.kuleuven.be/
Thanks!! :)

More Related Content

Similar to Designing Augmented Reality Applications for Personal Health Decision-Making (HICSS 52)

G486972.pdf
G486972.pdfG486972.pdf
G486972.pdfaijbm
 
International User research eGuide - Usability247
International User research eGuide - Usability247 International User research eGuide - Usability247
International User research eGuide - Usability247 UX247
 
Mixed-initiative recommender systems
Mixed-initiative recommender systemsMixed-initiative recommender systems
Mixed-initiative recommender systemsKatrien Verbert
 
Ch02 project selection (pp_tshare)
Ch02 project selection (pp_tshare)Ch02 project selection (pp_tshare)
Ch02 project selection (pp_tshare)Napex Terra
 
Content validity study: a gamification model to drive behavior change in defe...
Content validity study: a gamification model to drive behavior change in defe...Content validity study: a gamification model to drive behavior change in defe...
Content validity study: a gamification model to drive behavior change in defe...IJECEIAES
 
WCIT 2014 Peter Elkin - Human computer interaction, evaluation, usability tes...
WCIT 2014 Peter Elkin - Human computer interaction, evaluation, usability tes...WCIT 2014 Peter Elkin - Human computer interaction, evaluation, usability tes...
WCIT 2014 Peter Elkin - Human computer interaction, evaluation, usability tes...WCIT 2014
 
Human Computer Interaction (HCI)
Human Computer Interaction (HCI)Human Computer Interaction (HCI)
Human Computer Interaction (HCI)Lahiru Danushka
 
Team-Based Product Ownership
Team-Based Product OwnershipTeam-Based Product Ownership
Team-Based Product OwnershipMark Weeks
 
Team-Based Product Ownership
Team-Based Product OwnershipTeam-Based Product Ownership
Team-Based Product OwnershipMark Weeks
 
Apply Web-based Analytic Tool and Eye Tracking to Study The Consumer Preferen...
Apply Web-based Analytic Tool and Eye Tracking to Study The Consumer Preferen...Apply Web-based Analytic Tool and Eye Tracking to Study The Consumer Preferen...
Apply Web-based Analytic Tool and Eye Tracking to Study The Consumer Preferen...Waqas Tariq
 
Cognitive Science Perspective on User eXperience!
Cognitive Science Perspective on User eXperience!Cognitive Science Perspective on User eXperience!
Cognitive Science Perspective on User eXperience!Hamed Abdi
 
RE2021 tutorial human values in requirements engineering
RE2021 tutorial   human values in requirements engineeringRE2021 tutorial   human values in requirements engineering
RE2021 tutorial human values in requirements engineeringJon Whittle
 
Bunnyfoot UX Strategy Workshop
Bunnyfoot UX Strategy WorkshopBunnyfoot UX Strategy Workshop
Bunnyfoot UX Strategy WorkshopDavid Williams
 
Product Design Team6
Product Design Team6Product Design Team6
Product Design Team6Kienho Chan
 
A concept based model for product development in the emerging market
A concept based model for product development in the emerging marketA concept based model for product development in the emerging market
A concept based model for product development in the emerging marketeSAT Journals
 
Usability methods to improve EMRs
Usability methods to improve EMRsUsability methods to improve EMRs
Usability methods to improve EMRsJeffery Belden
 

Similar to Designing Augmented Reality Applications for Personal Health Decision-Making (HICSS 52) (20)

G486972.pdf
G486972.pdfG486972.pdf
G486972.pdf
 
International User research eGuide - Usability247
International User research eGuide - Usability247 International User research eGuide - Usability247
International User research eGuide - Usability247
 
Mixed-initiative recommender systems
Mixed-initiative recommender systemsMixed-initiative recommender systems
Mixed-initiative recommender systems
 
Ch02 project selection (pp_tshare)
Ch02 project selection (pp_tshare)Ch02 project selection (pp_tshare)
Ch02 project selection (pp_tshare)
 
ICS3211 Lecture 3
ICS3211 Lecture 3ICS3211 Lecture 3
ICS3211 Lecture 3
 
ICS3211 lecture 03
ICS3211 lecture 03ICS3211 lecture 03
ICS3211 lecture 03
 
Content validity study: a gamification model to drive behavior change in defe...
Content validity study: a gamification model to drive behavior change in defe...Content validity study: a gamification model to drive behavior change in defe...
Content validity study: a gamification model to drive behavior change in defe...
 
TP Vision final
TP Vision finalTP Vision final
TP Vision final
 
WCIT 2014 Peter Elkin - Human computer interaction, evaluation, usability tes...
WCIT 2014 Peter Elkin - Human computer interaction, evaluation, usability tes...WCIT 2014 Peter Elkin - Human computer interaction, evaluation, usability tes...
WCIT 2014 Peter Elkin - Human computer interaction, evaluation, usability tes...
 
Viva presentation3
Viva presentation3Viva presentation3
Viva presentation3
 
Human Computer Interaction (HCI)
Human Computer Interaction (HCI)Human Computer Interaction (HCI)
Human Computer Interaction (HCI)
 
Team-Based Product Ownership
Team-Based Product OwnershipTeam-Based Product Ownership
Team-Based Product Ownership
 
Team-Based Product Ownership
Team-Based Product OwnershipTeam-Based Product Ownership
Team-Based Product Ownership
 
Apply Web-based Analytic Tool and Eye Tracking to Study The Consumer Preferen...
Apply Web-based Analytic Tool and Eye Tracking to Study The Consumer Preferen...Apply Web-based Analytic Tool and Eye Tracking to Study The Consumer Preferen...
Apply Web-based Analytic Tool and Eye Tracking to Study The Consumer Preferen...
 
Cognitive Science Perspective on User eXperience!
Cognitive Science Perspective on User eXperience!Cognitive Science Perspective on User eXperience!
Cognitive Science Perspective on User eXperience!
 
RE2021 tutorial human values in requirements engineering
RE2021 tutorial   human values in requirements engineeringRE2021 tutorial   human values in requirements engineering
RE2021 tutorial human values in requirements engineering
 
Bunnyfoot UX Strategy Workshop
Bunnyfoot UX Strategy WorkshopBunnyfoot UX Strategy Workshop
Bunnyfoot UX Strategy Workshop
 
Product Design Team6
Product Design Team6Product Design Team6
Product Design Team6
 
A concept based model for product development in the emerging market
A concept based model for product development in the emerging marketA concept based model for product development in the emerging market
A concept based model for product development in the emerging market
 
Usability methods to improve EMRs
Usability methods to improve EMRsUsability methods to improve EMRs
Usability methods to improve EMRs
 

Recently uploaded

From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DaySri Ambati
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 

Recently uploaded (20)

DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 

Designing Augmented Reality Applications for Personal Health Decision-Making (HICSS 52)

  • 1. Katrien Verbert Designing Augmented Reality Applications for Personal Health Decision-Making Francisco Gutiérrez Nyi Nyi Htun Sven Charleer Robin De Croon 1 https://augment.cs.kuleuven.be/
  • 2. PokemonGo 19 Crimes AR 2 [augment reality] Apple’s AR measure
  • 3. 3
  • 4. 4 Food labels are considered an essential element in strategies against unhealthy diets and obesity. (Cecchini and Warin, 2016)
  • 5. 5
  • 6. 6 PHARA: Personal Health Augmented Reality assistant
  • 7. 7 ● Study AR in the critical moment of decision: when users hold the food product in their hands. ● Assist users by providing rich and consistent visual components that support their decision-making process. ● Follow a user-centered approach in a iterative design process. ● Study the impact of AR interfaces on how to present information to the end-users in decision-making. [goals]
  • 8. 8 Regarding subjective and objective factors: What are the benefits and tradeoffs of using popular layouts such as, stack, grid, list and pie in AR applications within handheld and HMD experiences to support decision-making? [research question]
  • 9. 9 a) MS HoLolens (HMD) c) iPhone 6S (Smartphone) b) NSW Joycon (controller) [devices]
  • 12. 12 [AR components] Users' Decision Behavior in Recommender Interfaces: Impact of Layout Design (Chen and Tsoi, 2011)
  • 13. List Layout Stack Layout 13 [AR components] Smartphone HoloLens
  • 14. 14 [AR components] List Layout List Layout Smartphone HoloLens
  • 15. 15 [AR components] List Layout Grid Layout Smartphone HoloLens
  • 16. 16 [AR components] List Layout Pie Layout Smartphone HoloLens
  • 17. ● Within Subjects ● n = 28 (1F, 27M) Ages from 22 to 38 (M = 25.81, SD = 4.57) ● Number of conditions: 2 (HoloLens, Smartphone) ● Task 1: - Select two products that you would like to have for dinner... - Select two similar products... - Select and replace with two alternatives... - Reflection... ● Task 2: - Imagine that you have some friends coming over... select two products… and put them in the basket. ● Post-Questionnaires ○ TAM (Technology Acceptance) ○ NASA-TLX (Task Load Index) 17 [user study]
  • 19. 19 [results] food choices overtime Choice 1 Choice 2 Choice 3 Choice 4 Choice 1 Choice 2 Choice 3 Choice 4
  • 24. 24 [conclusions] ● We explored and evaluated different layouts to present information in a decision-making scenario. ○ Our results are comparable to those of (Chen and Tsoi, 2011) ● PHARA allows users to make informed decisions, and resulted in selecting healthier food products. ● Stack layout performs better with HMD devices with a limited field of view, like the HoloLens, at the cost of some affordances. ● The grid and pie layouts performed better in handheld devices, allowing to explore with more confidence, enjoyability and less effort.
  • 25. 25 [future work] ● Long-term goal: influence healthy grocery store shopping and in-restaurant purchase behavior. ● Evaluate the potential of our approach in real-life settings. ● Development of more AR components following a user-centered approach. ● Wine decision-support scenario coming up. (PHARA Wine)
  • 27. 27 [questions] Francisco Gutiérrez [Augment/HCI - KU Leuven] francisco.gutierrez@cs.kuleuven.be @FranciscoGhz | Twitter https://augment.cs.kuleuven.be/ Thanks!! :)