Contenu connexe Similaire à Building a sub-second virtual ThunderDome: Considerations for mass scale sub-second production broadcasts Jerod Venema (20) Building a sub-second virtual ThunderDome: Considerations for mass scale sub-second production broadcasts Jerod Venema1. © LiveSwitch Inc. 2022
Prepared by LiveSwitch
© LiveSwitch, Inc. All rights reserved
Any trademarks or logos used throughout this document are the property of their respective owners.
Nov 9, 2022
Jerod Venema
Chief Executive Officer
2. © LiveSwitch Inc. 2022
LiveSwitch - References
LiveSwitch provides critical
video infrastructure
that powers the most engaging
real-time
communications and
entertainment experiences on
the web.
3. © LiveSwitch Inc. 2022
Spatial leverages LiveSwitch to
create XR experiences including
spatial audio and meta-data
(location, position, etc) using data
channels in virtual spaces with 3D
avatars.
Metaverse meeting space
Spatial
Client product marquee image or video
(hi-res, should show LiveSwitch usage up front)
LiveSwitch - References
3
4. © LiveSwitch Inc. 2022
Showboat Live uses LiveSwitch to
enhance its 3D virtual event spaces
with audio and video, including
distance aware audio levels, presence,
and grouped conversations..
Virtual event web application
Showboat Live
Client product marquee image or video
(hi-res, should show LiveSwitch usage up front)
LiveSwitch - References
4
5. © LiveSwitch Inc. 2022
Cavrnus is a Metaverse builder platform
that uses LiveSwitch video for versatile
spatial immersion and collaboration
technology.
Metaverse platform
Cavrnus RT
Client product marquee image or video
(hi-res, should show LiveSwitch usage up front)
LiveSwitch - References
5
6. © LiveSwitch Inc. 2022
ShoCap leverages LiveSwitch to
provide a 4-audience circus
experience, using the various
platforms LiveSwitch supports to
merge in-person, browser, game,
and VR experiences into one.
Cross-reality live concert series
LiViCi - Carry Me Home
Client product marquee image or video
(hi-res, should show LiveSwitch usage up front)
LiveSwitch - References
6
7. © LiveSwitch Inc. 2022
LiveSwitch - References
7
What is LiViChi?
Through an exceptional combination of
music, circus, dance, and theatrical
performances, together with real-time motion
capture, virtual reality and gaming
technology, Carry Me Home, invites
audiences around the world to an inspiring,
meaningful, and uplifting event. A tribute to
the mind’s incredible capacity to imagine,
dream, and create — a truly unique human
trait that connects us all.
In their words
8. © LiveSwitch Inc. 2022
LiveSwitch - References
8
Let’s break it down
An in-person Cirque du Soleil style
experience
Incredible musical performance
Real-time motion capture
Using a four-audience model
- In-person
- Live streamed
- Interactive gameplay
- Immersive VR
9. © LiveSwitch Inc. 2022
LiveSwitch - References
9
Progressive experiences
First ever four-audience model
- In person
- Stream (browser)
- VR
- Game
Other examples of progressive experiences
- Spatial
- Cavrnus
- Showboat
Have you tried getting started in VR?
10. © LiveSwitch Inc. 2022
LiveSwitch - References
10
What does LiveSwitch solve?
- Broad platform support
- A/V encoding on all the above
- High quality audio/video capture and
render
- High quality stream @ sub-second for
interactivity
- Large scale
11. © LiveSwitch Inc. 2022
LiveSwitch - References
11
Technical details
Unreal as the source for everything -
mixing etc took place there.
Bridge via the CLR to LiveSwitch to stream
various interactions and the main feed
itself
Virtual cameras concept inside Unreal for
remote participants for interactivity
Live-streamed via WebRTC to the audience
to keep latency low
Mapping of facial expressions to avatars
through AI - phoneme detection, facial
recognition
12. © LiveSwitch Inc. 2022
LiveSwitch - References
12
Takeaways
- Hybrid in person/virtual experiences
are possible and can be engaging
- Large scale virtual, real-time
experiences are possible and fun
- A progressive experience is
absolutely necessary to drive
adoption
- People are willing to pay $ for this
14. © LiveSwitch Inc. 2022
LiveSwitch - References
14
What is it?
-An interactive circus entertainment experience
-Delivered in a 4-audience model
What is a 4-audience model?
-Progressive XR experiences
-This is important!!
Why LiveSwitch?
-multiple platforms
-high quality a/v
-large scale
Some technical details
What are the major takeaways?
-hybrid experiences are possible and can be engaging
-large scale virtual, real-time experiences are possible and fun
-people are willing to pay $
-a progressive experience is absolutely necessary