Intro to Brain–computer interfaces for iOS developers.

1. iOS + Neuroscience
Brain-iPhone interfaces

2. Imagine
• Cocoa
• Cocoa Touch
• Cocoa Thought

3. Biology

4. Connectome

5. Open Worm Project

6. Neurointerfaces

7. Backyard Brain

8. Roboroach video

9. Transcranial direct current stimulation

10. Foc.Us
• Enhance language and mathematical
ability, attention span, problem
solving, memory, and coordination.
• accepted maximum 2 mA, usually 1
mA or less
• stimulation time - 20 minutes
• 10 minutes - effects lasting for up to
an hour.
• 48 hours to a week before repeating
the stimulation.
• Studies indicates SAFETY in a SINGLE
session.
• No studies about long-term safety of
repeated sessions of stimulation.

11. Foc.Us API
- (void)peripheralDidWriteChracteristic:(CBCharacteristic *)characteristic
withPeripheral:(CBPeripheral *)peripheral
withError:(NSError *)error;
- (void)peripheralDidReadChracteristic:(CBCharacteristic *)characteristic
withPeripheral:(CBPeripheral *)peripheral
withError:(NSError *)error;
- (void)hardwareDidNotifyBehaviourOnCharacteristic:(CBCharacteristic *)characteristic
withPeripheral:(CBPeripheral *)peripheral
error:(NSError *)error;
http://www.foc.us/bluetooth
https://github.com/FocusBluetooth/focus-bluetooth-ios/blob/master/C

12. Foc.Us

13. Electroencephalography

14. δ <4 Gz
slow-wave sleep,
some continuous-attention tasks
θ 4-7 Gz drowsiness,
idling,
inhibition of elicited responses
α 7-14 Gz
relaxed/reflecting,
closing the eyes
β 15-30 Gz
active thinking, focus,
hi alert, anxious
γ 30-100 Gz cross-modal sensory processing,
short-term memory matching of
recognized objects, sounds, or tactile
sensations
μ 8-13 Gz
Shows rest-state motor neurons,
mirror neurons activity(?)
σ 10-16 Gz
Stage N2 sleep (consciousness
shutdown)

15. MindWave Mobile by NeuroSky
2 mind states:
- Attention (0 – 100).
- Meditation (0 – 100).
• Blinking and it’s “power”.
- Contact with skin.
- Signal quality.
1 electrode
$99.95

16. API
- (void)dataReceived:(NSDictionary *)data {
if([data valueForKey:@"blinkStrength"])
if([data valueForKey:@"raw"]) {
if([data valueForKey:@"heartRate"])
if([data valueForKey:@"poorSignal"]) {
if([data valueForKey:@"respiration"]) {
if([data valueForKey:@"heartRateAverage"]) {
if([data valueForKey:@"heartRateAcceleration"]) {
if([data valueForKey:@"rawCount"]) {
if([data valueForKey:@"eSenseAttention"]){
eSenseValues.attention = [[data valueForKey:@"eSenseAttention"] intValue];
eSenseValues.meditation = [[data valueForKey:@"eSenseMeditation"] intValue];
eegValues.delta = [[data valueForKey:@"eegDelta"] intValue];
eegValues.theta = [[data valueForKey:@"eegTheta"] intValue];
eegValues.lowAlpha = [[data valueForKey:@"eegLowAlpha"] intValue];
eegValues.highAlpha = [[data valueForKey:@"eegHighAlpha"] intValue];
eegValues.lowBeta = [[data valueForKey:@"eegLowBeta"] intValue];
eegValues.highBeta = [[data valueForKey:@"eegHighBeta"] intValue];
eegValues.lowGamma = [[data valueForKey:@"eegLowGamma"] intValue];
eegValues.highGamma = [[data valueForKey:@"eegHighGamma"] intValue];

17. Reverse-engineering
Tools:
• lipo
• otool
• Hopper Disassembler
• MachOView
Results:
• Spline interpolation
• Spectral density
estimation
• Fast Fourier transform
• …

18. Appl
icati
ons

19. https://github.com/orbotix/Sphero-iOS-SDK
https://github.com/MariaStoica/MindSphero
+

20. BrainOSC
Converts data from ThinkGear's MindWave to
OSC data
AdFence
Mood and proximity based advertising using the
MindWave headset by NeuroSky and the
Qualcomm Gimbal Proximity chip.

21. Melon
3 electrodes on the
forehead.
Detects focus and
meditation.
Detects sleep phases.
$149.
Uses NeuroSky’s chip.
SDK will be available in
summer.

22. Muse by InteraXon

23. Muse
6 dry sensors
$ 299
Sleep, calmness,
attention.
Has an iOS app.
Native library will be
available “soon”.
Right now: console,
sockets, protobuf.

24. Emotive EPOC

25. Emotive Insight

26. iOS SDK will be in summer.
C++, really ?
$ 229

27. API
struct emokit_contact_quality {//values > 4000 are good
short F3, FC6, P7, T8, F7, F8, T7, P8, AF4, F4, AF3, O2, O1, FC5;
};
struct emokit_frame {
unsigned char counter; //loops from 0 to 128 (129 values)
int F3, FC6, P7, T8, F7, F8, T7, P8, AF4, F4, AF3, O2, O1, FC5; //raw data values
struct emokit_contact_quality cq;
char gyroX, gyroY;
unsigned char battery; //percentage of full charge, read on counter=128
};

28. API

29. Insight video

30. Emotive Insight
https://sites.google.com/a/emotiv.
com/wiki/documentation

31. Additional Resources
http://www.openbci.com/ - opensource BCI
http://personalneuro.com/about.htm - neuro
apps development
http://neurogadget.com/ - blog
http://www.neurogamingconf.com/ -
conference 2014
http://en.wikipedia.org/wiki/Brain
%E2%80%93computer_interface
http://neuroscience.uth.tmc.edu/toc.htm

32. Additional Resources
http://wsyachina.narod.ru/biology/brain_17.ht
ml
http://wsyachina.narod.ru/medicine/drug_depe
ndence.html
https://eyewire.org/signup

33. Thanks for your
[[data valueForKey:@"eSenseAttention"]
intValue]