Demola mind reader 20120903
•Download as PPTX, PDF•
0 likes•261 views
Demola Academy Autumn 2012 project
Recommended
More Related Content
Recently uploaded
Recently uploaded (20)
Featured
Featured (20)
Demola mind reader 20120903
- 1. version date author details 0.1 29.08.2012 Rod Walsh Created & first draft 0.2 30.08.2012 Rod Walsh Background added 0.3 03.09.2012 Rod Walsh First version ready
Editor's Notes
- Kinetic body input setup and coding:MS Kinect or openNI/Asus – preferably with Java appSmoothing, reading, messaging static poses & motionsComparison and “difference” from dictionary of posesComputer Vision knowledge and coding experienceFeature extraction (e.g. LBP, AAM, eigenfaces, more)Classification/pattern recognition (e.g. SVM, Tree-based, Hidden Markov)Desire and ability to integrate and code (Java, C, C++ or combo)Other Signal ProcessingAudio feature description (e.g. GMM) and classificationSimple kinect (skeleton) description & classificationAction models - Simple thought/cognition models for real-world visual/audio detection e.g. Ekman facial micro-expressions as emotions; e.g. tiredness detection my eyelid or gaze trackingRunning lots of “crowdsourcing” app sessions to collect “expert action” labeled kinect, camera and microphone dataApplication & UI Design and Implementation:Crowdsourcing/expert-input app: for given “action” user acts-out (gives examples of) body-pose/face-expression/sound. “Expert actions” come from action models (and “training sessions” – provided by other project)Simple multimodal action game: player mimiks an example body-pose/face-expression/sound and get’s “rated”Great looking UI: Unity 3D (inc. C#), HTML5 (inc. JavaScript & some helper libraries & CSS) or Java based
- - A social robot is an autonomous robot that interacts and communicates with humans or other autonomous physical agents by following social behaviors and rules attached to its role. - Autonomous robots are robots that can perform desired tasks in unstructured environments without continuous human guidance. - Being social is bound to humans and their society which defines necessary social values, norms and standards. This results in a cultural dependency of social robots since social values, norms and standards differ between cultures.