Optimizing your vr app for mixed reality video

1. Optimizing your VR app for
Mixed Reality Video
By Az Balabanian
@azadux azadux.com/mixed-reality
@peopleinVR_

2. What is Mixed Reality?
A real time CGI solution using Virtual Reality.
@azadux azadux.com/mixed-reality
@peopleinVR_

3. What is Mixed Reality?
● A real time CGI solution using Virtual Reality.
○ Avatar developed SIMULCAM in 2009
● A way to render another person in the VR
environment
@azadux azadux.com/mixed-reality
@peopleinVR_

4. What is Mixed Reality?
FG (color)
@azadux azadux.com/mixed-reality
@peopleinVR_
FG (alpha)
BG comp First Person

5. What is Mixed Reality?
@azadux azadux.com/mixed-reality
@peopleinVR_

6. What is Mixed Reality?
@azadux azadux.com/mixed-reality
@peopleinVR_

7. Why does it matter?
● Because people need to WATCH your product to want it.
● “First person view” videos don’t do the game justice. Requires too much
cognitive load to translate the movements
Full article:
https://medium.com/@WizardofAz/why-mixed-reality-videos-matter-614370a
8bed6#.vb11zwtdx
@azadux azadux.com/mixed-reality
@peopleinVR_

8. HOW DO I DO IT?
Tutorials:
● Northway Games Original tutorial
○ http://northwaygames.com/how-to-mixed-reality/
● UploadVR Tutorial
○ http://uploadvr.com/make-mixed-reality-video-livestream-two-realities/
● High Quality Mixed Reality tutorial
○ http://www.kertgartner.com/making-mixed-reality-vr-trailers-and-videos/
● Video Tutorial
○ https://www.youtube.com/watch?v=IZI7-3rK-X4
@azadux azadux.com/mixed-reality
@peopleinVR_

9. HOW DO I DO IT?
What you need:
● 2 ways (depending on what you’re trying to do)
○ Live compositing
■ OBS
○ Post compositing
■ Premiere/After Effects
@azadux azadux.com/mixed-reality
@peopleinVR_

10. HOW DO I DO IT?
What you need:
● Cheap and Easiest
○ C920 Logitech webcam - 60$
■ https://www.amazon.com/Logitech-Widescreen-Calling-Recording-Desktop/dp/B006JH8
T3S/ref=sr_1_3?s=electronics&ie=UTF8&qid=1480801833&sr=1-3&keywords=webcam
○ Green screen - 20$
■ https://www.amazon.com/LimoStudio-Chromakey-Backdrop-Background-AGG1777/dp/B
017WNJS3M/ref=sr_1_4?s=photo&ie=UTF8&qid=1480801778&sr=1-4&keywords=gree
n+screen
○ Simple lighting - 100$
■ https://www.amazon.com/Chromakey-Flourescent-lightstand-Fancierstudio-9004S-3/dp/
B003Y31CAC/ref=sr_1_6?s=photo&ie=UTF8&qid=1480801887&sr=1-6&keywords=gree
n+screen+lighting@azadux azadux.com/mixed-reality
@peopleinVR_

11. HOW DO I DO IT?
What you need:
● More Advanced
○ Sony Handicams - $749.991
■ http://www.sony.com/electronics/handycam-camcorders/fdr-ax33
○ Shoulder Stablizer - 70$
■ https://www.amazon.com/Neewer-FilmMaker-Camcorder-Dual-hand-Camcorders/dp/B0
0GTMBA7K/ref=pd_lpo_421_tr_t_3?_encoding=UTF8&psc=1&refRID=Q56WWQE4HC
QWFN8PCZV3
@azadux azadux.com/mixed-reality
@peopleinVR_

12. HOW DO I DO IT?
What you need:
● More Advanced
○ Capture Cards
■ Black Magic Intensity Pro 4k - 200$
● https://www.bhphotovideo.com/c/product/1123881-REG/blackmagic_design_bintsp
ro_4k_intensity_pro_4k.html
■ Avermedia 1080p - 150$
● https://www.amazon.com/AVerMedia-Streaming-Definition-Hardware-C985/dp/B00
7UXJ6LE
○ Audio Interface
■ Scarlet Focusrite
● https://www.amazon.com/Focusrite-Scarlett-18i6-Interface-Featuring/dp/B004W6K
REC
○ Better lighting / green screens@azadux azadux.com/mixed-reality
@peopleinVR_

13. HOW DO I DO IT?
What you need:
● Thuper-Duper Advanced
○ Splitting the computing load
■ 1 Computer for VR
■ 1 Computer for compositing
● Tricaster
○ Crew
■ Director, cameraman, actor/host, audio engineer, commentator
@azadux azadux.com/mixed-reality
@peopleinVR_

14. HOW DO I DO IT?
What you need:
● AUDIO
○ Hardest part of the game
■
@azadux azadux.com/mixed-reality
@peopleinVR_

15. New Tricks and Tips
● Syncing the controllers
○ Mixed reality configurator: http://tribalinstincts.com/mixedrealityconfigurator/
● Controller assignment
○ Open steamvr menu, quit game using the wrongly assigned controller
● Fixing OBS alpha foreground
○ https://obsproject.com/forum/resources/mixed-reality-alpha-mask-filter.462/
@azadux azadux.com/mixed-reality
@peopleinVR_

16. New Tricks and Tips
● Toggle for controller renders/ avatars
● Rotating the world controls
● Quad view mode / companion mode
● Live update the external cam config
●
@azadux azadux.com/mixed-reality
@peopleinVR_

17. Questions?
Contact me: az@uploadvr.com
Find my work:
https://www.youtube.com/playlist?list=PLDXBKX3q25Uzk1_8pbNRM2lCrtYEGRt6
-
Livestreams: Facebook.com/uploadvr
Persicope.tv/uploadvr
@azadux azadux.com/mixed-reality
@peopleinVR_