DBI World Conference 2019 Technology stream: Concurrent session 10C Presenter: Eric van Heuvelen Topic: Converting vibrotactile information in daily practice of people with deafblindness

1. Eric van Heuvelen
assistive technology specialist
Bartiméus, the Netherlands
Converting vibrotactile information
in daily practice for people with
deafblindness

2. no conflicts of interest to disclose

3. Centre of Expertise
B:
support assisted livingeducation

4. Some context:
• one of two centres of expertise
• 17 million inhabitants
• 350.000 visually impaired
• 80.000 – 85.000 people with deafblindness
• 2.000 people congenital
• 1.500 acquired
• Approxmately 80.000 elderly

5. Existing adapted tools

6. FabLabsmart technology for people with a disability
Bartiméus FabLab

7. Mission

8. Centre of expertise on deafblindness

9. Dreaming about an accessible life
Brainstorming sessions with people with deafblindness

10. • one tool
• different devices
• signaling as warning, attention, recognition
One of the main conclusions :

11. • who is at the door?
But also:
• when someone is approaching you in the garden
• smoke detection
• a smart status detector: the status of household electrical
appliances e.g. whether a coffee maker is switched on or
off
Developing the “Smart doorbell”

12. Prototype

13. Evaluation
• evaluation of prototype with people with deafblindness
• options for improvement were discussed

14. • use of regular consumer technology (smartwatch)
• integration of more devices
• pre-alert, color and text
First results

15. Conclusion so far…..
Worked well in lab conditions, but…….
Problems:
• using own wifi network to set up
• small range
• poor reliabilty
• poor wifi strenght
• not easy to start up after break down

16. Follow up
Further development by Bartiméus

17. 1. explore the perception of vibrotactile
patterns (tactons) with people with
deafblindness (master thesis)
2. user needs to work with mainstream
(consumer) technology
Conditions

18. Research
• what kind of vibrotactile patterns should be
used
• how many different tactons can be
distinguished
• will these patterns be recognized when a
user is going about his day doing regular
daily activities?

19. • can tactons be accurately detected and linked to a
specific meaning when presented on the wrist?
• can these tactons also be recognized when
participants are engaged in cognitive and distracting
activities?
• the effect of long-term memory on tacton detection
and recognition in a call-back testing setting
Current Research

20. Tacton parameters
• amplitude
• frequency
• timing

21. Tactons presented to the wrist have shown to be
effective in providing information to people with
deafblindness.
Research result

22. Let‘s get practical!

23. • smart remote control
• connects to all your devices
• control device with your voice or
smartphone
Homey

24. • Wi-Fi, Bluetooth, Infra-red, Zigbee, NFC/NRF,
433 MHz and Z-Wave
• Homey app: to create scenes and set up
responses to events
• developers can create own applications (API)
• open platform (easily integrated with other
solutions)
Homey

25. Homey and the smartwatch

26. • building an application
• smartwatch app
• using API
Further development by Bartiméus

27. Testing
• testing with at least 5 people with
deafblindness at their home
• testing is currently in progress.

28. Results 1:
• male, 65 years old, blind, hard of hearing
• hearing aid
• strongly focused on hearing
• prefers short vibrations
• vibrations too weak, other wearable?
• nice addition: high user-friendliness

29. Results 2:
• female, 70 years old, hard of hearing
• tunnel vision
• vibrations were strong enough, also during activities
• increase of sense of security

34. Feedback
• watersensor: watch vibrates as long as the tap is
running
• possible feedback to doorbel (i’m coming!)
• facial recognition

35. How to continue…
Connect more devices
Integrate in daily practice
Magic 7!

36. Final conlusion
The projects shows:
Mainstream technology can cause more
safety and self-sufficiency to those living
with deafblindness.
Tactile information is key.

37. Questions?
www.bartimeus.nl/fablab
evheuvelen@bartimeus.nl
Eric van Heuvelen
Bartiméus, the Netherlands