1. Visual cues of speech

2. Auditory-visual speech recognition (Grant et al 1998)

3. Cognitive Perceptual (Grant et al 1998)

4. Auditory-visual speech recognition Intersection density Words in greater intersection density is harder to comprehend (Grant et al 1998)

5. Compare Intersection density

6. When BOTH auditory and visual information is available, individuals with hearing loss tend to do better on communication tasks Example (Auditory plus Vision): Speech Recognition Score = 50% Speechreading Score = 20% Combined Visual/Auditory Score = 90% Auditory plus Vision

7. Children are in a phase of skill acquisition By 5 months of age, infants already attend to visual cues, preferring synchronous facial/speech modulations About 40% of speech sounds are visible on the face

8. AV release from masking 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 8 voices, 4♀ 4♂ Target (65 dB SPL) “Ready, Baron, go to [color] [number] now.” Distractor (-35 - +15 SNR) “Ready, [call-sign], go to [color] [number] now.” (Wightman et al 2006)

9. AV release from masking

10. Speech reading enhancement Audiovisual score — Audio only score Enhancement

11. Viseme groups Can vary depending on neighboring phonemes Walden, B. E., Prosek, R. A., Montgomery, A. A., Scherr, C. K., & Jones, C. J. (1977). Effects of training on the visual recognition of consonants. Journal of Speech and Hearing Research, 20(1), 130-145.

12. Viseme groups Can vary depending on neighboring phonemes Erber, N. P. (1974). Visual perception of speech by deaf children: Recent developments and continuing needs. Journal of Speech and Hearing Disorders, 39, 178-185.

13. Viseme groups Can vary depending on neighboring phonemes Lesner, K., Sandridge, S., and Kricos, P. (1987). Training influences on visual consonant and sentence recognition. Ear and Hearing, 8, 283-287.

14. Visemes associated with different vowels

15. Place is visible Manner and voicing are invisible

16. /u, i/ contrast Using visual to discriminate what hearing loss cannot

17. Sentences Utley Sentence test Denver Quick test Words + Sentences Craig inventory Words appropriate for Pre-K, Kindergarten Assessing speechreading

18. Homophenous words bun putt buzz mud puck Is it better to train clients to differentiate phonemes or visemes during speechreading training? sick

19. Differentiation of viseme groups Training

20. Differentiation of viseme groups Not differentiation within viseme group Training

21. Analytic – phoneme level few cues apart from visual if this becomes automatic, then cognitive resources released for auditory processing Synthetic – sentence/conversational level sentence topic provides cues “Put your shoes on your feet” Training

22. Factors enhancing visual cues Good lighting No obstructions Optimal speech rate Unexaggerated articulation Speaker familiarity Close proximity

23. Should children be trained in speechreading?

24. Perhaps at an age where they can benefit from training better than anyone. Can enhance understanding in situations where auditory signal is distorted by noise or reverberation. (~15 dB release from masking). Should we only focus on auditory process? Should children be trained in speechreading?

25. McGurk effect mouth goes “ba” voice goes “ga” perception is “da” Effect is weaker in children than adults children more strongly encode auditory stimulus Five-month-old infants demonstrate McGurk effect Audiovisual interactions

26. From close to birth, children processing language supramodally, attending to auditory and visual cues.

27. Direction of eye gaze during speechreading Prosodic judgments Phonemic judgments Lansing & McConkie, 1999

28. Factors influencing speechreading

30. DeShaun is a 10-year-old girl fit with bilateral hearing aids. Her family is taking her to Dave & Buster’s to celebrate her good report card. Make a diagram to help DeShaun’s family (Mother, Father, and brother) know where they should sit in a restaurant to maximize communication and speechreading.