DBI World Conference 2019 Technology stream: Concurrent session 10B Presenter: Wendy L. Buckley Topic: Eye gaze technology: more than meets the eye!

1. 1
Eye Gaze Technology: More Than Meets the Eye!
Wendy L. Buckley, M.Ed., Ed.S
17th Deafblind International World Conference
Gold Coast, Australia

2. 2
Eye Gaze Tracker

3. 3
3
Eye tracker device: operates computer mouse functions
Detects and follows eye movements
Light emitting diodes illuminate the eyes
Reflections off corneal surface
System tracks eye movements
Calculations estimate position of eye and point of gaze (x,y coordinates)
Monocular or binocular
Eye Gaze Technology

4. 4
4
Computer Screen:
Adjustable height
Articulating arm or stand
Adjustable height table
Computer location
Background clutter
Room lighting
Windows/light sources
Distraction free
APH Tri-fold Board
User Positioning

5. 5
5

6. 6

7. 7
7
Visual skills
Fixation
Recognition
Preferences
Choosing
Applications for Training & Analysis

8. 8
What Can We Learn?
Eye Gaze Technology for Children with Deafblindness

9. 9
9
Can the user attend to screen? Initiate interaction? Sustain
attention?
What colors result in the most attention?
Does the user attend to images with more or less detail?
Moving shapes vs. moving characters
Does the user track equally in all directions?
Questions

10. 10
10
Can the user sustain attention on a single object for short periods?
Does the user demonstrate a preference for certain images or
patterns?
Does the user demonstrate awareness of features of an image?
Does the user demonstrate understanding of cause & effect?
Questions

11. 11
11
Can the user communicate a preference?
Can the user sustain concentration for a longer period?
Can the user look at and explore the entire screen?
Can the user explore the screen to interact with objects?
Does the user demonstrate emerging awareness of control by
looking?
Questions

12. 12
12
Online subscription:
Insight
Desktop Software:
Attention and Looking
Exploring and Learning
Choosing and Playing
Analytics: Eye Gaze Software

13. 13
13
Online subscription
Intelligent analytics
Provides objective and detailed measurement and analysis of early
vision and cognition behaviors using eye gaze technology.
Insight

14. 14
14
Insight
Early Vision Early Cognition

15. 15
15
Activities with small incremental steps
Gradual increase in complexity
Progression Road Map

16. 16
16
Age 18
CVI phase 1
Non-ambulatory
Uses a switch
Student: J

17. 17
17
Learning Goal: Visual Attention
Learning to attend to different visual stimuli and engage with the
screen
Game Play: Experiential
An experiential activity with no interaction required!
Levels represent a general progression of visual complexity
Level: 1 – Petals
Attend to very high contrast patterns of bold black and white lines and
shapes.
Student: J
Initial session

18. 18
18
Visual Attention Activity
Video: moving pattern with musical tune

19. 19
19
Initial Session: Overall Performance 17%
Visual Attention: J demonstrated poor visual attention skills in this activity. (17%)
Attention: J attended to the screen briefly. (1%)
Reaction: J reacted to most images after a short delay. (62%)
Quality: When attending J's attention was sustained. (98%)
Consistency: J's behavior was consistent throughout the activity. (94%)

20. 20
20
Learning Goal: Visual Attention
Game Play: Experiential
Level: 2 – Petals
Attend to very high contrast patterns
of bold black and single colors lines
and shapes.
End of Year 1

21. 21
21
One Year Later: Performance Scores 50-80%
Visual Attention: Jared demonstrated some visual attention skills in this activity. (52%)
Attention: Jared attended to the screen for some of the time. (43%)
Reaction: Jared reacted to most images quickly. (81%)
Quality: When attending Jared's attention was sustained. (95%)
Consistency: Jared's behavior was consistent throughout the activity. (72%)

22. 22
22
End of Year Two
Learning Goal: Visual Attention
Game Play: Experiential
Level: 3 – Cubes
Attend to detailed patterns of multi-
colored, textured, and 3D images

23. 23
23

24. 24
24
Transition time for activities
Attends to color; possible preference for green
Extended periods of absence: regression with recovery to previous
point
Time available for instruction (sandwich transitions)
Visual fatigue
Overwhelmed by combined visual/auditory stimuli
Outcomes: What Have We Learned?

25. 25
25
Student: B

26. 26
26
Age 3
Medically complex
Limited muscle control
CVI early phase 1
Early Vision activities
Student: B

27. 27
27
 Black & white patterns: 4 to 23%
 Black & single color patterns: 45 to 98%
 Multi-colored patterns: 22 to 85%
Performance Scores

28. 28
28
Increased visual attention
Moving to "noticing" activities
End of Eight Months

29. 29
29
End of Eight Months
Learning Goal: Noticing Images
Learning to direct visual attention to specific
images
Game Play:
Look at an image to make it "pop." Eight images
in each activity.
Level: 1 – Balloons (Color)
Notice large images in the center of the screen.

30. 30
30
Noticing Images Activity

31. 31
31
Preference for color over black & white
Prefers colors green and neon pink
Left field weakness
Learning to exert minimal movement to reposition visual focus
Strong response to visual activities
Fatigue factors
Outcomes: What Have We Learned?

32. 32
32
Age 10
CVI phase 2
Physical limitations
Student: E

33. 33
33
Activity: Control and Predict

34. 34
34
Activity: Control and Predict

35. 35
35
Incremental steps
Demonstrating preferences
Uses vision to communicate preferences
Cause & effect
Outcomes: What Have We Learned?

36. 36
36
Activity Example: Simple Linear Tracking

37. 37
37
Activity Example: Simple Linear Tracking

38. 38
38
Video: Simple Linear Tracking
Video does not have audio

39. 39
39
Tracking: Analytics
Visual line trace

40. 40
40
Tracking: Analytics
Visual heat map

41. 41
41
Using vision to experience, interact, create
Cause & effect using eye control
Visual attention with fixation on a single image
Initial skills for dwell selection
Early cursor control
Purposeful cursor movement
Application of Eye Gaze

42. 42
42
Color preferences
Placement of materials
Patterns of behavior
Visual skills
Communication skills
Simple vs. complex images
Time “available” for instruction
What Can We Learn?

43. 43
43
Inclusive Technology Guidebooks: http://www.inclusivetlc.com
Eye Gaze in the Classroom
Attention and Looking
Exploring and Playing
Choosing and Telling
How to Use myGaze® with HelpKidzLearn
Resources

44. 44
44
Unlocking Abilities Guides
http://ilc.com.au/unlocking-abilities/
 An Introduction to Eye Gaze Devices
 Assessment and Setup for Eye Gaze Device Use
 Keys to Developing Eye Gaze Skills
 Software for Developing Eye Gaze Skills
 Eye Gaze Monitoring Sheets
Resources