final presentation of my project emotionBox for my major studio

1. Major Studio:KatherineMoriwaki / Final Project basakhaznedaroglu emotionBox

2. The digital world around us leading to desensitization Dissolution of expressions and the loss of facial reactions to the physical world around Losingconnectionin connected world concept

3. Facial expressions communicate information about emotions and enhance the verbal patterns of communication concept

4. A social phenomenon that individual emotional states are highly affected by other people’s emotional states around. concept

5. If only they had an Olympic event for facial athletes. (Paul Ekman) -Text messaging, instant messaging, voice messaging became a part of our lives. -We are using emoticons instead of showing how we feel. motivation

6. Providing a set ofemotional stimuliand evoking emotions for experimental investigations offacial expressions and bringing them back goal

7. Why am I doing this? Exploring the facial expressions and the emotional reactions Enhancing the nonverbal communication with others / Investigating a social phenomenon whether emotional reactions are contagious goal

8. Literature Review Researching on UX and Using audio and visual elements as emotional stimuli Discussing and getting feedback from colleagues Installing physical computing elements and building physical constructions methodology

9. experimental psychology cognitive science sociology physical computing audio visualization domains

10. MIT Media Lab and affective computing department / human face expression studies for sociable robots precedents

11. Bill Viola, The Passions / Depicting ambiguous or mixedfaces, examiningthe manifestations of emotions precedents

12. Colorwave Monochrome Digital Art Workshop/ Projecting visuals on human face to evoke emotion precedents

13. Paul Ekman/ studying on non verbal-behavioral science, exploring the cross-cultural differences in facial expressions precedents

14. arduino + processing + skype technology

15. system diagram

16. Box installation inthe space scenario

17. Audio and visualizerto attract people’s attention scenario

18. Participant interacts with the remote control to choose which experience to go through scenario

19. Positive or negative emotional stimuli options scenario

20. Exposing a stream of still images and videos supported by audio visualizers scenario

21. Recording the participant face inside the box scenario

22. In the other room projecting it live scenario

23. Live screen supported with the previous records of facial expressions scenario

24. Prototype #1 design process

25. Prototype #1 Results -Feedback on which visuals to use / User survey on favorite funny movies, happy moments, songs, etc.. -Too distracting to concentrate on the experience / feedback on building the box design process

26. Paper Prototype design process

27. Prototype #2 Digital characters on both edges of the uncanny valley / Cartoon-like digital character vs. Humanized digital characters design process

28. Prototype #2 design process

29. Prototype #2 Results -Using one of the most intense emotion=disgust! -Instead of displaying a streamline, participant should choose the visual (button based interface) -Triggering a curiosity for the installation (what should be before the participant approaches?) -Feedback on projection in a separate space to enhance the surprising affect design process

30. Prototype #3 design process

31. Prototype #3 Results -Sequence of visuals and audio, feedback on the structure of the visuals -Projecting reactions on a bigger screen in a darker open space -Watching other people’s reactions is weird but achieves to evoke emotion -Pushing buttons to change videos is distracting. -Recording other people watching other people’s reactions? -A collage of images of reactions might be exhibited? design process

32. Final Result precedents

34. Next? Carrying this experiment into an online platform and giving a facial expression exercise sessions. future implementation

35. Thank you!