RAATE Conference, 29 November 2010, Coventry, UK

1. Prof Maurice Mulvenna, University of Ulster
Interfacing with Brain Computer
Interfaces
2

2. Outline
• What is BCI?
• Advances & problems
• The BRAIN project
3

3. BCI Schematic

4. Types of BCIs
Signal acquisition:
non-invasive / invasive (field-potentials / spiking activity)
Environment:
exogenous / endogenous
Mental or Experimental strategy:
focused/selective attention / specific mental tasks / operant conditioning
Signal patterns:
ERD/ERS / P300 / SSEP / SCP / intracortical recordings
Operation mode:
synchronous (cue-paced) / asynchronous (self-paced)

5. Selective Attention: SSVEP
Flickering light with a specific frequency evokes SSVEP
pattern with the same frequency.
Herrmann et al, Exp. Brain Research 2001

6. Selective Attention: P300
Component of an evoked potential (e.g. VEP) elicited by
selective/focused attention in an oddball experiment.
Donchin et al, IEEE Rehab 2000

7. Motor Imagery: ERD/ERS
Subjects produce specific signal patterns (ERD/
ERS) by performing motor imagery.
Pfurtscheller et al, Proceedings IEEE, 2001

8. Recent advances
• Improved sensors
• Numerous patient successes
• Home and field validation
• BCI approaches compared
• Parameters developed and assessed
• Improved signal processing
• BCI2000 software platform
• Standardized application interfaces

9. Present problems
• BCI setup is slow and unpleasant
• Expert help is required for BCI:
– Setup
– Cleaning
– Customization
• Very limited options with:
– Approach
– Parameters
– Interface
– Applications

10. Project
• BCIs with Rapid Automated Interfaces for Nonexperts
(BRAIN) will develop BCIs into practical assistive tools
to enhance inclusion for users with impaired
communication due to illness and injury (e.g., Cerebral
Palsy, brain and spinal cord injury, and stroke).
• Supported by European Commission’s ICT for
Inclusion Unit, under EU FP7 grant agreement No.
224156
• Academia, industry and service users to develop a
Brain-Computer Interface system linked directly to
assistive technology and services within the home
environment

11. BRAIN consortium
• University of Bremen
• Philips Research Europe
• University of Ulster
• The Cedar Foundation
• University of Warsaw
• Telefonica
• Twente Medical Systems Intl.

12. 13

13. BRAIN solutions
• New electrodes and amplifier system eliminate:
– Long setup times and discomfort
– Cleaning
– Expert help
• Automated tools assess:
– Approach (ERD, SSVEP, P300)
– Parameters (spatial filters, features, stimuli)
– User preferences
• New:
– Signal processing tools (SSVEP and other)
– Parameters (spatial filter, features, stimuli)
– Intuitive Graphical User Interface (IGUI)
– Universal Application Interface (UAI)
– Communications and Entertainment Package

14. BRAIN solutions II
• Evaluation and testing:
– In field settings
– Including patients
– Strong ethical focus
– Integration within BRAIN
• Dissemination and exploitation:
– Conferences and workshops
– Journal publications
– Product development
– Intellectual property
– Media publicity

15. Impact
• Users with severe disabilities
• Users with mild to moderate disabilities
• Healthy users in limited situations
• Scientific researchers and developers
• European standards

16. Advances
• New electrodes and amplifier system eliminate:
– long setup times and discomfort
– Cleaning
– Expert help
• Automated tools assess:
– approach (ERD, SSVEP, P300)
– Parameters (spatial filters, features, stimuli)
– User preferences
• New:
– Intuitive Graphical User Interface (IGUI)
– Universal Application Interface (UAI)
– Communications and Entertainment Package
• Reliability, flexibility, usability, accessibility
17

17. Discussion
• Understanding the EEG, and EEG dysfunction
associated with complex conditions
• Calibration / re-calibration
– Variability
• Evolution phase: Changing algorithms & approaches
• Still too much effort to operate!
• Training: practicality?
• Assistive technology of choice?
18

18. Engagement
19

19. Conclusions
• Significant technical complexity
• Getting results outside the lab is still difficult
• Integration of the technologies is troublesome
• Consistency of results id difficult to achieve
• Recognition of need for person-centred approach
• Participants like being part of process but…
• Are we there yet?
20

20. Thanks and Acknowledgements
• The BRAIN consortium gratefully acknowledge the
support of the European Commission’s ICT for
Inclusion Unit, under grant agreement No. 224156.
21