Metaverse Learning

Mark Billinghurst
Mark BillinghurstDirector at HIT Lab NZ à University of South Australia
METAVERSE LEARNING
Mark Billinghurst
mark.billinghurst@unisa.edu.au
June 18th 2022
The Metaverse
Metaverse Learning
The Metaverse
• Neal Stephenson’s “Snow Crash” (1992)
• The Metaverse is the convergence of:
• 1) virtually enhanced physical reality
• 2) physically persistent virtual space
Defining the Metaverse
• Real-time, 3D, Interactive, Social, Persistent
AWE 2022 John Riccitiello
CEO, Unity Technologies
Metaverse Taxonomy
• Four Key Components
• Virtual Worlds
• Augmented Reality
• Mirror Worlds
• Lifelogging
• Metaverse Roadmap
• http://metaverseroadmap.org/
Sensing
Immersing
Augmenting
Capturing
Traditional Corporate Learning
Traditional Corporate Learning
• Common Features
• Instructor led
• Learning in groups
• Face to face learning
• Specific learning events
• Everyone taught the same
• Discrete assessment events
• Learning away from task site
Source: https://elearningindustry.com/top-5-trends-corporate-elearning-for-2020
Applying Metaverse Concepts
• Learning in the flow of work
• Just in time learning
• Hard skills learning
• Soft skills learning
• Team training
• Always accessible learning
• Adaptive/personal learning
Virtual Reality
• Ideal for
• Spatial skills
• Object manipulation, equipment operation
• Social skills
• Public speaking, people management
• Simulation
• Difficult/expensive tasks
• Team training
• Shared VR environments
https://www.youtube.com/watch?v=uR6935nl_qE
Using VR for Soft Skills Training
• Key Elements
• Immersive learning space
• Realistic characters
• Artificial Intelligence
• Natural interaction
• Examples
• Talespin:
• Using VR to teach HR processes
• Walmart:
• Customer service – 18K HMD distributed
• Learning improves by 15%
https://www.youtube.com/watch?v=UMRFVluYcTc
Team Training
• Perform team training in VR
• Use collaborative VR
• Monitor group behaviour
• Provide feedback and analysis
• Reproduce real world training activity
• Example
• Capability Group
• Leadership training
• Behaviourial psychological analysis
https://www.youtube.com/watch?v=dS_Auufvbsc
Augmented Reality
• Ideal For
• Training with real objects
• Remote assistance
• Just in time learning
• Meeting support
• Example
• ScopeAR
• AR training on real equipment
• Platform for AR authoring
• Microsoft Dynamics 365 Remote Assist
• Remote expert assistance in AR
• Bring conferencing into the real world
https://www.youtube.com/watch?v=PWHy6njUr8o
https://www.youtube.com/watch?v=PG3tQYlZ6JQ
Lifelogging
• Using sensory data
• Track learning over time
• Adapt training in real time
• Natural integration with AR/VR
• Examples
• VR + EEG
• Measure cognitive load
• Ovation speaking training
• Eye gaze, heart rate, speech analysis
• Typical VR training system
VR Training
Sensor Enhanced HMDs
Eye tracking, heart rate,
pupillometry, and face camera
HP Omnicept Project Galea
EEG, EMG, EDA, PPG,
EOG, eye gaze, etc.
Metaverse Learning
Adaptive VR Training
Adapt based on stress,
cognitive load, etc.
https://www.youtube.com/watch?v=u1sGCYWRDQU
Mirror Worlds
• Real world learning
• Capturing and sharing surroundings
• Training for real world task
• Photorealistic content
• Digital twins
Shared Sphere – 360 Video Sharing
Shared
Live 360 Video
Host User Guest User
https://www.youtube.com/watch?v=q_giuLot76k
Realistic Social Agents
• Realistic Digital Twins
• Copy real people
• Intelligent digital characters
• Combine
• Scene capture
• Shared tele-presence
• Trust/emotion recognition
• Enhanced communication cues
Soul Machines Digital Character
Bringing the Pieces Together
• The Metaverse is
• Real time
• Three dimensional
• Interactive
• Persistent
• Social
Metaverse learning through combining
AR + VR + Lifelogging + Mirror Worlds
https://www.youtube.com/watch?v=uVEALvpoiMQ
How can Metaverse
concepts be applied
to the Leadership
Development
Journey?
www.empathiccomputing.org
@marknb00
mark.billinghurst@auckland.ac.nz
1 sur 34

Recommandé

Empathic Computing: Designing for the Broader Metaverse par
Empathic Computing: Designing for the Broader MetaverseEmpathic Computing: Designing for the Broader Metaverse
Empathic Computing: Designing for the Broader MetaverseMark Billinghurst
231 vues50 diapositives
2022 COMP4010 Lecture1: Introduction to XR par
2022 COMP4010 Lecture1: Introduction to XR2022 COMP4010 Lecture1: Introduction to XR
2022 COMP4010 Lecture1: Introduction to XRMark Billinghurst
389 vues126 diapositives
ISS2022 Keynote par
ISS2022 KeynoteISS2022 Keynote
ISS2022 KeynoteMark Billinghurst
1.3K vues51 diapositives
Comp4010 Lecture7 Designing AR Systems par
Comp4010 Lecture7 Designing AR SystemsComp4010 Lecture7 Designing AR Systems
Comp4010 Lecture7 Designing AR SystemsMark Billinghurst
1.7K vues156 diapositives
Empathic Computing: Developing for the Whole Metaverse par
Empathic Computing: Developing for the Whole MetaverseEmpathic Computing: Developing for the Whole Metaverse
Empathic Computing: Developing for the Whole MetaverseMark Billinghurst
549 vues83 diapositives
Comp 4010 2021 - Snap Tutorial-1 par
Comp 4010 2021 - Snap Tutorial-1Comp 4010 2021 - Snap Tutorial-1
Comp 4010 2021 - Snap Tutorial-1Mark Billinghurst
791 vues52 diapositives

Contenu connexe

Tendances

Comp4010 Lecture5 Interaction and Prototyping par
Comp4010 Lecture5 Interaction and PrototypingComp4010 Lecture5 Interaction and Prototyping
Comp4010 Lecture5 Interaction and PrototypingMark Billinghurst
916 vues147 diapositives
Comp 4010 2021 Snap Tutorial 2 par
Comp 4010 2021 Snap Tutorial 2Comp 4010 2021 Snap Tutorial 2
Comp 4010 2021 Snap Tutorial 2Mark Billinghurst
414 vues38 diapositives
Comp4010 2021 Lecture2-Perception par
Comp4010 2021 Lecture2-PerceptionComp4010 2021 Lecture2-Perception
Comp4010 2021 Lecture2-PerceptionMark Billinghurst
1.6K vues105 diapositives
2022 COMP4010 Lecture 6: Designing AR Systems par
2022 COMP4010 Lecture 6: Designing AR Systems2022 COMP4010 Lecture 6: Designing AR Systems
2022 COMP4010 Lecture 6: Designing AR SystemsMark Billinghurst
156 vues176 diapositives
2022 COMP4010 Lecture2: Perception par
2022 COMP4010 Lecture2: Perception2022 COMP4010 Lecture2: Perception
2022 COMP4010 Lecture2: PerceptionMark Billinghurst
161 vues175 diapositives
Novel Interfaces for AR Systems par
Novel Interfaces for AR SystemsNovel Interfaces for AR Systems
Novel Interfaces for AR SystemsMark Billinghurst
404 vues84 diapositives

Tendances(20)

Comp4010 Lecture5 Interaction and Prototyping par Mark Billinghurst
Comp4010 Lecture5 Interaction and PrototypingComp4010 Lecture5 Interaction and Prototyping
Comp4010 Lecture5 Interaction and Prototyping
2022 COMP4010 Lecture 6: Designing AR Systems par Mark Billinghurst
2022 COMP4010 Lecture 6: Designing AR Systems2022 COMP4010 Lecture 6: Designing AR Systems
2022 COMP4010 Lecture 6: Designing AR Systems
Comp 4010 2021 Lecture1-Introduction to XR par Mark Billinghurst
Comp 4010 2021 Lecture1-Introduction to XRComp 4010 2021 Lecture1-Introduction to XR
Comp 4010 2021 Lecture1-Introduction to XR
Mark Billinghurst1.8K vues
COMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays par Mark Billinghurst
COMP 4010 - Lecture4 VR Technology - Visual and Haptic DisplaysCOMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
COMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
Mark Billinghurst3.9K vues
Introduction to Extended Reality - XR par Kumar Ahir
Introduction to Extended Reality - XRIntroduction to Extended Reality - XR
Introduction to Extended Reality - XR
Kumar Ahir987 vues
Talk to Me: Using Virtual Avatars to Improve Remote Collaboration par Mark Billinghurst
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationTalk to Me: Using Virtual Avatars to Improve Remote Collaboration
Talk to Me: Using Virtual Avatars to Improve Remote Collaboration
COMP 4010 - Lecture 5: Interaction Design for Virtual Reality par Mark Billinghurst
COMP 4010 - Lecture 5: Interaction Design for Virtual RealityCOMP 4010 - Lecture 5: Interaction Design for Virtual Reality
COMP 4010 - Lecture 5: Interaction Design for Virtual Reality
Mark Billinghurst2.3K vues

Similaire à Metaverse Learning

COMP 4010: Lecture 6 Example VR Applications par
COMP 4010: Lecture 6 Example VR ApplicationsCOMP 4010: Lecture 6 Example VR Applications
COMP 4010: Lecture 6 Example VR ApplicationsMark Billinghurst
1.9K vues50 diapositives
Lecture7 Example VR Applications par
Lecture7 Example VR ApplicationsLecture7 Example VR Applications
Lecture7 Example VR ApplicationsMark Billinghurst
3.7K vues63 diapositives
COMP 4010 Lecture 6: VR Applications par
COMP 4010 Lecture 6: VR ApplicationsCOMP 4010 Lecture 6: VR Applications
COMP 4010 Lecture 6: VR ApplicationsMark Billinghurst
643 vues63 diapositives
The Google of Learning par
The Google of LearningThe Google of Learning
The Google of LearningBalasubramanian Krishnan
39 vues17 diapositives
Effective e-Training par
Effective e-TrainingEffective e-Training
Effective e-TrainingAndre Harris
1.1K vues13 diapositives
Will I Be Out of a Job? Remaining Relevant in a Social Learning Environment par
Will I Be Out of a Job? Remaining Relevant in a Social Learning EnvironmentWill I Be Out of a Job? Remaining Relevant in a Social Learning Environment
Will I Be Out of a Job? Remaining Relevant in a Social Learning Environmentweejeelearning
198 vues26 diapositives

Similaire à Metaverse Learning(20)

COMP 4010: Lecture 6 Example VR Applications par Mark Billinghurst
COMP 4010: Lecture 6 Example VR ApplicationsCOMP 4010: Lecture 6 Example VR Applications
COMP 4010: Lecture 6 Example VR Applications
Mark Billinghurst1.9K vues
Will I Be Out of a Job? Remaining Relevant in a Social Learning Environment par weejeelearning
Will I Be Out of a Job? Remaining Relevant in a Social Learning EnvironmentWill I Be Out of a Job? Remaining Relevant in a Social Learning Environment
Will I Be Out of a Job? Remaining Relevant in a Social Learning Environment
weejeelearning198 vues
Remaining Relevant in a Social Learning Environment par Ian Huckabee
Remaining Relevant in a Social Learning EnvironmentRemaining Relevant in a Social Learning Environment
Remaining Relevant in a Social Learning Environment
Ian Huckabee351 vues
Learning frameworks par nvandam
Learning frameworksLearning frameworks
Learning frameworks
nvandam2.2K vues
Conole icem keynote_final_28_sept par Grainne Conole
Conole icem keynote_final_28_septConole icem keynote_final_28_sept
Conole icem keynote_final_28_sept
Grainne Conole646 vues
Case Study: Making Cornwall Agile par allan kelly
Case Study: Making Cornwall AgileCase Study: Making Cornwall Agile
Case Study: Making Cornwall Agile
allan kelly1.1K vues
Mc on-line course delivery vr1.3 par Anwar Bashir
Mc   on-line course delivery vr1.3Mc   on-line course delivery vr1.3
Mc on-line course delivery vr1.3
Anwar Bashir166 vues
FR201 - The Creative Blend: New Tools to Engage Learners par TorranceLearning
FR201 - The Creative Blend: New Tools to Engage LearnersFR201 - The Creative Blend: New Tools to Engage Learners
FR201 - The Creative Blend: New Tools to Engage Learners
TorranceLearning640 vues
Effective Tools for Effective Change par Jennifer Davis
Effective Tools for Effective ChangeEffective Tools for Effective Change
Effective Tools for Effective Change
Jennifer Davis466 vues
Lettp m5 4_mocibob_read_fin par CMocibob
Lettp m5 4_mocibob_read_finLettp m5 4_mocibob_read_fin
Lettp m5 4_mocibob_read_fin
CMocibob205 vues
5 Ways Organizations Get eLearning Wrong par John Schulz
5 Ways Organizations Get eLearning Wrong5 Ways Organizations Get eLearning Wrong
5 Ways Organizations Get eLearning Wrong
John Schulz599 vues
Creating BYOT Learning objects par John Allan
Creating BYOT Learning objectsCreating BYOT Learning objects
Creating BYOT Learning objects
John Allan444 vues

Plus de Mark Billinghurst

Empathic Computing: Delivering the Potential of the Metaverse par
Empathic Computing: Delivering  the Potential of the MetaverseEmpathic Computing: Delivering  the Potential of the Metaverse
Empathic Computing: Delivering the Potential of the MetaverseMark Billinghurst
496 vues80 diapositives
Empathic Computing: Capturing the Potential of the Metaverse par
Empathic Computing: Capturing the Potential of the MetaverseEmpathic Computing: Capturing the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the MetaverseMark Billinghurst
452 vues46 diapositives
2022 COMP 4010 Lecture 7: Introduction to VR par
2022 COMP 4010 Lecture 7: Introduction to VR2022 COMP 4010 Lecture 7: Introduction to VR
2022 COMP 4010 Lecture 7: Introduction to VRMark Billinghurst
325 vues236 diapositives
2022 COMP4010 Lecture5: AR Prototyping par
2022 COMP4010 Lecture5: AR Prototyping2022 COMP4010 Lecture5: AR Prototyping
2022 COMP4010 Lecture5: AR PrototypingMark Billinghurst
332 vues205 diapositives
2022 COMP4010 Lecture3: AR Technology par
2022 COMP4010 Lecture3: AR Technology2022 COMP4010 Lecture3: AR Technology
2022 COMP4010 Lecture3: AR TechnologyMark Billinghurst
315 vues106 diapositives
Empathic Computing and Collaborative Immersive Analytics par
Empathic Computing and Collaborative Immersive AnalyticsEmpathic Computing and Collaborative Immersive Analytics
Empathic Computing and Collaborative Immersive AnalyticsMark Billinghurst
406 vues28 diapositives

Plus de Mark Billinghurst(13)

Empathic Computing: Delivering the Potential of the Metaverse par Mark Billinghurst
Empathic Computing: Delivering  the Potential of the MetaverseEmpathic Computing: Delivering  the Potential of the Metaverse
Empathic Computing: Delivering the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the Metaverse par Mark Billinghurst
Empathic Computing: Capturing the Potential of the MetaverseEmpathic Computing: Capturing the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the Metaverse
Empathic Computing and Collaborative Immersive Analytics par Mark Billinghurst
Empathic Computing and Collaborative Immersive AnalyticsEmpathic Computing and Collaborative Immersive Analytics
Empathic Computing and Collaborative Immersive Analytics
Comp4010 Lecture13 More Research Directions par Mark Billinghurst
Comp4010 Lecture13 More Research DirectionsComp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research Directions
Mark Billinghurst1.2K vues
Advanced Methods for User Evaluation in Enterprise AR par Mark Billinghurst
Advanced Methods for User Evaluation in Enterprise ARAdvanced Methods for User Evaluation in Enterprise AR
Advanced Methods for User Evaluation in Enterprise AR
Mark Billinghurst1.2K vues
Comp4010 Lecture4 AR Tracking and Interaction par Mark Billinghurst
Comp4010 Lecture4 AR Tracking and InteractionComp4010 Lecture4 AR Tracking and Interaction
Comp4010 Lecture4 AR Tracking and Interaction
Mark Billinghurst1.3K vues

Dernier

Future of Indian ConsumerTech par
Future of Indian ConsumerTechFuture of Indian ConsumerTech
Future of Indian ConsumerTechKapil Khandelwal (KK)
24 vues68 diapositives
MVP and prioritization.pdf par
MVP and prioritization.pdfMVP and prioritization.pdf
MVP and prioritization.pdfrahuldharwal141
37 vues8 diapositives
Uni Systems for Power Platform.pptx par
Uni Systems for Power Platform.pptxUni Systems for Power Platform.pptx
Uni Systems for Power Platform.pptxUni Systems S.M.S.A.
58 vues21 diapositives
SAP Automation Using Bar Code and FIORI.pdf par
SAP Automation Using Bar Code and FIORI.pdfSAP Automation Using Bar Code and FIORI.pdf
SAP Automation Using Bar Code and FIORI.pdfVirendra Rai, PMP
25 vues38 diapositives
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... par
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...James Anderson
126 vues32 diapositives
Data Integrity for Banking and Financial Services par
Data Integrity for Banking and Financial ServicesData Integrity for Banking and Financial Services
Data Integrity for Banking and Financial ServicesPrecisely
29 vues26 diapositives

Dernier(20)

GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... par James Anderson
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
James Anderson126 vues
Data Integrity for Banking and Financial Services par Precisely
Data Integrity for Banking and Financial ServicesData Integrity for Banking and Financial Services
Data Integrity for Banking and Financial Services
Precisely29 vues
Unit 1_Lecture 2_Physical Design of IoT.pdf par StephenTec
Unit 1_Lecture 2_Physical Design of IoT.pdfUnit 1_Lecture 2_Physical Design of IoT.pdf
Unit 1_Lecture 2_Physical Design of IoT.pdf
StephenTec15 vues
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors par sugiuralab
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
sugiuralab23 vues
Igniting Next Level Productivity with AI-Infused Data Integration Workflows par Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software317 vues
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... par TrustArc
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc72 vues
Five Things You SHOULD Know About Postman par Postman
Five Things You SHOULD Know About PostmanFive Things You SHOULD Know About Postman
Five Things You SHOULD Know About Postman
Postman38 vues
"Surviving highload with Node.js", Andrii Shumada par Fwdays
"Surviving highload with Node.js", Andrii Shumada "Surviving highload with Node.js", Andrii Shumada
"Surviving highload with Node.js", Andrii Shumada
Fwdays33 vues
PharoJS - Zürich Smalltalk Group Meetup November 2023 par Noury Bouraqadi
PharoJS - Zürich Smalltalk Group Meetup November 2023PharoJS - Zürich Smalltalk Group Meetup November 2023
PharoJS - Zürich Smalltalk Group Meetup November 2023
Noury Bouraqadi139 vues
Case Study Copenhagen Energy and Business Central.pdf par Aitana
Case Study Copenhagen Energy and Business Central.pdfCase Study Copenhagen Energy and Business Central.pdf
Case Study Copenhagen Energy and Business Central.pdf
Aitana17 vues

Metaverse Learning