SlideShare une entreprise Scribd logo
1  sur  21
Developing a  Multimodal Transcription  to account for Interaction in 3D Virtual Worlds:  the  3M method Joan Tomàs Pujolà Cristina Palomeque
3M transcription M ULTI-  M ODAL M UVE 3
index ,[object Object],[object Object],[object Object],[object Object],[object Object]
3D muves Social dimension Interaction: environment, objects, avatars Immersive experience Multimodal communication
senses ,[object Object],presence immersiveness creativity gaming
interact ,[object Object],interaction (n) –  interactional (adj)
channels ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],multitasking
video example   ,[object Object],[object Object],[object Object],[object Object],[object Object]
aim ,[object Object]
multimodal transcriptions ,[object Object],[object Object],[object Object],[object Object]
multimodal transcriptions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
 
 
[object Object],[object Object],[object Object],[object Object],transcription levels
macro level
multimodal transcription
3M transcription
tagging system TYPES Body posture <bp> Sitting <bps> Laying <bpl> Kneeling <kpl> Standing (default, not tagged)  Kinesics <k> ,[object Object],[object Object],[object Object],[object Object],[object Object],Proxemics <p> Facing <pf> Backing <pb>  Haptics <h> Touching <ht> Pointing <hp>  Chronemics <c> Wating <cw> Short / medium / long pause waiting <cspw>, <cmpw>, <clpw>  Thinking <ct> Short / medium / long pause thinking  <cspt>, <cmpt>, <clpt>
future directions Transcription on the  web - trying to visualize the multiplicity of channels  Video streaming - trying to visualize the spatial dimension
3M M UVE of a m ultimodality  to describe the m ultimodal transcription We are pursuing a

Contenu connexe

Tendances

The nature of learner language
The nature of learner languageThe nature of learner language
The nature of learner languageNandu Prakoso
 
Social aspects of interlanguage
Social aspects of interlanguageSocial aspects of interlanguage
Social aspects of interlanguageLina Andriani
 
Fossilization of the Interlanguage system.
Fossilization of the Interlanguage system. Fossilization of the Interlanguage system.
Fossilization of the Interlanguage system. Ana Stefanelli
 
Models of tla
Models of tlaModels of tla
Models of tlaCameliaN
 
L2 acquisition
L2 acquisitionL2 acquisition
L2 acquisitionCameliaN
 

Tendances (8)

Interlanguage in SLA
Interlanguage in SLAInterlanguage in SLA
Interlanguage in SLA
 
Tenses
TensesTenses
Tenses
 
The nature of learner language
The nature of learner languageThe nature of learner language
The nature of learner language
 
Linguistic factors presentation
Linguistic factors presentationLinguistic factors presentation
Linguistic factors presentation
 
Social aspects of interlanguage
Social aspects of interlanguageSocial aspects of interlanguage
Social aspects of interlanguage
 
Fossilization of the Interlanguage system.
Fossilization of the Interlanguage system. Fossilization of the Interlanguage system.
Fossilization of the Interlanguage system.
 
Models of tla
Models of tlaModels of tla
Models of tla
 
L2 acquisition
L2 acquisitionL2 acquisition
L2 acquisition
 

En vedette

Europa, quale futuro?
Europa, quale futuro? Europa, quale futuro?
Europa, quale futuro? Federico Gobbo
 
What can we know of computational inforgs?
What can we know of computational inforgs?What can we know of computational inforgs?
What can we know of computational inforgs?Federico Gobbo
 
Achieveing the Ying-Yang in language teaching and learning in virtual worlds
Achieveing the Ying-Yang in language teaching and learning in virtual worldsAchieveing the Ying-Yang in language teaching and learning in virtual worlds
Achieveing the Ying-Yang in language teaching and learning in virtual worldsCristina Palomeque
 
From simulations to (3D) virtuality: Mirorring tasks from language learning
From simulations to (3D) virtuality: Mirorring tasks from language learningFrom simulations to (3D) virtuality: Mirorring tasks from language learning
From simulations to (3D) virtuality: Mirorring tasks from language learningCristina Palomeque
 
Communication Strategies in synchronous CMC and face-to-face interactions
Communication Strategies in synchronous CMC and face-to-face interactionsCommunication Strategies in synchronous CMC and face-to-face interactions
Communication Strategies in synchronous CMC and face-to-face interactionsCristina Palomeque
 
Measuring Computational Complexity the qualitative and quantitative intertwin...
Measuring Computational Complexity the qualitative and quantitative intertwin...Measuring Computational Complexity the qualitative and quantitative intertwin...
Measuring Computational Complexity the qualitative and quantitative intertwin...Federico Gobbo
 
FinTechGroup: FinTech Fenyegetettség
FinTechGroup: FinTech FenyegetettségFinTechGroup: FinTech Fenyegetettség
FinTechGroup: FinTech Fenyegetettséglemakg
 

En vedette (8)

Europa, quale futuro?
Europa, quale futuro? Europa, quale futuro?
Europa, quale futuro?
 
What can we know of computational inforgs?
What can we know of computational inforgs?What can we know of computational inforgs?
What can we know of computational inforgs?
 
Achieveing the Ying-Yang in language teaching and learning in virtual worlds
Achieveing the Ying-Yang in language teaching and learning in virtual worldsAchieveing the Ying-Yang in language teaching and learning in virtual worlds
Achieveing the Ying-Yang in language teaching and learning in virtual worlds
 
From simulations to (3D) virtuality: Mirorring tasks from language learning
From simulations to (3D) virtuality: Mirorring tasks from language learningFrom simulations to (3D) virtuality: Mirorring tasks from language learning
From simulations to (3D) virtuality: Mirorring tasks from language learning
 
Communication Strategies in synchronous CMC and face-to-face interactions
Communication Strategies in synchronous CMC and face-to-face interactionsCommunication Strategies in synchronous CMC and face-to-face interactions
Communication Strategies in synchronous CMC and face-to-face interactions
 
Measuring Computational Complexity the qualitative and quantitative intertwin...
Measuring Computational Complexity the qualitative and quantitative intertwin...Measuring Computational Complexity the qualitative and quantitative intertwin...
Measuring Computational Complexity the qualitative and quantitative intertwin...
 
FinTechGroup: FinTech Fenyegetettség
FinTechGroup: FinTech FenyegetettségFinTechGroup: FinTech Fenyegetettség
FinTechGroup: FinTech Fenyegetettség
 
Time andspacecomplexity
Time andspacecomplexityTime andspacecomplexity
Time andspacecomplexity
 

Similaire à Developing a Multimodal Transcription to account for Interaction in 3D Virtual Worlds: the 3M method

Cmc Sig Leon Workshop Mh Rh 200409
Cmc Sig Leon Workshop Mh Rh 200409Cmc Sig Leon Workshop Mh Rh 200409
Cmc Sig Leon Workshop Mh Rh 200409lamericaana
 
Ijaia040203
Ijaia040203Ijaia040203
Ijaia040203ijaia
 
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for Jens Grubert
 
UXD Multimedia output
UXD Multimedia outputUXD Multimedia output
UXD Multimedia outputrolfHRO
 
A Transliteracy Conversation
A Transliteracy ConversationA Transliteracy Conversation
A Transliteracy ConversationBruce Mason
 
HCI 3e - Ch 10: Universal design
HCI 3e - Ch 10:  Universal designHCI 3e - Ch 10:  Universal design
HCI 3e - Ch 10: Universal designAlan Dix
 
Cognitive plausibility in learning algorithms
Cognitive plausibility in learning algorithmsCognitive plausibility in learning algorithms
Cognitive plausibility in learning algorithmsAndré Karpištšenko
 
The Uses of Transliteracy
The Uses of TransliteracyThe Uses of Transliteracy
The Uses of TransliteracyDr Sue Thomas
 

Similaire à Developing a Multimodal Transcription to account for Interaction in 3D Virtual Worlds: the 3M method (11)

Hands and Speech in Space
Hands and Speech in SpaceHands and Speech in Space
Hands and Speech in Space
 
Cmc Sig Leon Workshop Mh Rh 200409
Cmc Sig Leon Workshop Mh Rh 200409Cmc Sig Leon Workshop Mh Rh 200409
Cmc Sig Leon Workshop Mh Rh 200409
 
Ijaia040203
Ijaia040203Ijaia040203
Ijaia040203
 
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
 
UXD Multimedia output
UXD Multimedia outputUXD Multimedia output
UXD Multimedia output
 
A Transliteracy Conversation
A Transliteracy ConversationA Transliteracy Conversation
A Transliteracy Conversation
 
HCI 3e - Ch 10: Universal design
HCI 3e - Ch 10:  Universal designHCI 3e - Ch 10:  Universal design
HCI 3e - Ch 10: Universal design
 
Cognitive plausibility in learning algorithms
Cognitive plausibility in learning algorithmsCognitive plausibility in learning algorithms
Cognitive plausibility in learning algorithms
 
Txting Disasters
Txting DisastersTxting Disasters
Txting Disasters
 
universaldesign
 universaldesign universaldesign
universaldesign
 
The Uses of Transliteracy
The Uses of TransliteracyThe Uses of Transliteracy
The Uses of Transliteracy
 

Plus de Cristina Palomeque

Interaction and Language Leraning in 3D Virtual Worlds
Interaction and Language Leraning in 3D Virtual WorldsInteraction and Language Leraning in 3D Virtual Worlds
Interaction and Language Leraning in 3D Virtual WorldsCristina Palomeque
 
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...Cristina Palomeque
 
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...Cristina Palomeque
 
Task Design in Virtual Worlds: Towards a Frame of Reference
Task Design in Virtual Worlds: Towards a Frame of ReferenceTask Design in Virtual Worlds: Towards a Frame of Reference
Task Design in Virtual Worlds: Towards a Frame of ReferenceCristina Palomeque
 
The use of ICT tools to involve students in their learning/assessment process
The use of ICT tools to involve students in their learning/assessment processThe use of ICT tools to involve students in their learning/assessment process
The use of ICT tools to involve students in their learning/assessment processCristina Palomeque
 

Plus de Cristina Palomeque (6)

Interaction and Language Leraning in 3D Virtual Worlds
Interaction and Language Leraning in 3D Virtual WorldsInteraction and Language Leraning in 3D Virtual Worlds
Interaction and Language Leraning in 3D Virtual Worlds
 
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...
 
Sedll 2010 multimodalitat
Sedll 2010 multimodalitatSedll 2010 multimodalitat
Sedll 2010 multimodalitat
 
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...
 
Task Design in Virtual Worlds: Towards a Frame of Reference
Task Design in Virtual Worlds: Towards a Frame of ReferenceTask Design in Virtual Worlds: Towards a Frame of Reference
Task Design in Virtual Worlds: Towards a Frame of Reference
 
The use of ICT tools to involve students in their learning/assessment process
The use of ICT tools to involve students in their learning/assessment processThe use of ICT tools to involve students in their learning/assessment process
The use of ICT tools to involve students in their learning/assessment process
 

Dernier

FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024Elizabeth Walsh
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the ClassroomPooky Knightsmith
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxRamakrishna Reddy Bijjam
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701bronxfugly43
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...Poonam Aher Patil
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfSherif Taha
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSCeline George
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...ZurliaSoop
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17Celine George
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...Nguyen Thanh Tu Collection
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Association for Project Management
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfPoh-Sun Goh
 
Vishram Singh - Textbook of Anatomy Upper Limb and Thorax.. Volume 1 (1).pdf
Vishram Singh - Textbook of Anatomy  Upper Limb and Thorax.. Volume 1 (1).pdfVishram Singh - Textbook of Anatomy  Upper Limb and Thorax.. Volume 1 (1).pdf
Vishram Singh - Textbook of Anatomy Upper Limb and Thorax.. Volume 1 (1).pdfssuserdda66b
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Jisc
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentationcamerronhm
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 

Dernier (20)

FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Vishram Singh - Textbook of Anatomy Upper Limb and Thorax.. Volume 1 (1).pdf
Vishram Singh - Textbook of Anatomy  Upper Limb and Thorax.. Volume 1 (1).pdfVishram Singh - Textbook of Anatomy  Upper Limb and Thorax.. Volume 1 (1).pdf
Vishram Singh - Textbook of Anatomy Upper Limb and Thorax.. Volume 1 (1).pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 

Developing a Multimodal Transcription to account for Interaction in 3D Virtual Worlds: the 3M method

Notes de l'éditeur

  1. Virtual worlds in learning are becoming increasingly popular and there is an extended belief that VW can be used as VLEs basically for 4 reasons. VW allow for multimodal communication: voice chat, text chat, private and public. There is a strong social dimension as users are represented by avatars. The residents of VW are usually quite friendly and willing to help newcomers. Apart from interacting with other avatars, you can interact with objects (e.g. when you open a door) or with the environment itself (you can contribute to create the environment). It is an immersive experience: the environment really makes you feel like if you really were in that place.