Ian Power from Healthy Digital presents an update of some cool AR stuff happening in healthcare, and an intro to an idea to improve patient adherence with long term medicines.
Presented to the Auckland UX meet up, September 2013
14. • AR apps can be tricky.
• Hardware: sensors, cameras, and
network connections that work.
• Software: strong image recognition
algorithms to identify objects from a
variety of angles.
23. 72% physicians now use smart
phones or tablets in their
everyday routines
24. AR on the ward might look something like this…
25. Developed by German company Fraunhofer MEVIS, this AR app helps surgeons locate
critical structures such as tumors and blood vessels (using data from CT scans).
26. This is liver surgery. Your liver has many blood vessels, which the app helps the
surgeon avoid or be prepared for when he/ she cuts.
27. Endoscopic surgery often means the surgeon has a very disjointed view of proceedings,
limited to the keyhole camera via a monitor, medical imaging data on a second display,
and the outside of the patient. The surgeon has to assemble the data in their head,
and this really complicates the intuitive use of surgical tools.
Here we’re seeing an AR view of minimally invasive intervention vertebroplasty (on a model),
via a HMD, developed by a team at Technische Universität München (TUM).
Vertebroplasty is the insertion of cement into weak and brittle vertebrae through a trocar
(metal tube) for stabilization
29. Nursing and midwifery students at Sheffield Hallam University will benefit from a new
iPad based augmented reality (AR) tool to improve their communication skills.
They used to hire actors to be patients for students, but now, it’s all on an iPad!
32. CPR GLASS
• Someone in the street collapses
• Glass wearer says “OK GLASS, CPRGLASS”
• App opens. Instructions appear - ABC (Assess Airway, Breathing
and Circulation). App measures pulse.
• Eulerian video magnification – are the compressions adequate?
and has patient regained pulse if we stop compressions…
33. Eulerian video magnification amplifies changes over time, can detect pulse from
skin colour changes. MIT-developed software, open source, uses standard
video camera footage.
35. Anyway – back to CPRGlass –
“OK GLASS, No Pulse!”
Triggers the following:
• Staying Alive music starts which will guide you to do the
compressions at a rate of 100/min.
• Gyroscope in Glass tells you if compressions are adequate
• App tracks TIME of CPR initiation and number of compressions
• Calls emergency services with your GPS-based location
• Via GPS will try to find nearest AED via AED4US
• Sends Txt Msg to nearest hospital with information regarding
ongoing CPR for them to get prepared
36.
37. Acute vs Ongoing
• Acute – new and exciting
• Interventions
• Technology
• Ongoing
• Supporting people
• Motivation
39. In Health, often the last thing users
want is an ‘experience’. They want
to find it, use it and forget it. The
best experience is invisible.
Peter Morville
40. Over my career in marketing and healthcare advertising 95% SELL, 5% support
42. • Between 30% and 50% of patients with
long-term diseases in developed countries
follow treatment recommendations.
- asthma
- diabetes
- CVD
- osteoporosis
43. WHY?
• Low level engagement
• Poor understanding of treatment benefits
• Side effects management
• Poor communication
51. Jesse James Garrett’s flow diagram Elements of User Experience
I really wanted to use this – this being a UX meet up and everything…
But I couldn’t. Sorry…
52. Goal:
Help users feel more
connected to their HCP, to
better understand their
treatment and to take their
medicine correctly
+
55. The patient can open the app and point it at the trigger, and it will play video content
of the practice nurse or doctor explaining what the treatments are for, why they are
important, and the agreed goals that the patient and the HCPs are working towards.
56. MedTech 32 interface – what most of the Drs and Nurses in primary care are using