РИТ++ 2017, AppsConf Зал Касабланка, 6 июня, 18:00 Тезисы: http://appsconf.ru/2017/abstracts/2635.html Поговорим о Virtual/Augment/Mixed/Merged Reality - что это такое и как работает. Более подробно рассмотрим Mobile VR: - Samsung Gear VR Powered by Oculus Rift; - Google DayDream и Cardboard; и обсудим, как и с помощью какого инструментария можно разрабатывать приложения.

1. Mobile Virtual Reality - what is that and
how it works?
Alexey Rybakov,
Senior Engineer,
Technical Evangelist at DataArt
alexey.rybakov@dataart.com

2. Agenda
• 1. AR/MR/MR/VR/MVR?
• 2. Mobile Hardware
• 3. SDK/Tools/Development

3. AR is for Augmented Reality: What is that?

4. AR is for Augmented Reality: Devices,
Tools
AR Tools / SDK
• Vuforia
• EasyAR
• Wikitude
• ARToolKit
• Kudan
• Maxst
• Xzimg
• NyARToolkit

5. AR is for Augmented Reality New Player: Apple ARKit

6. MR is for Mixed Reality: What is That?

7. MR is for Mixed Reality Devices: Hololens
• CPU: Intel 32-bit (1GHz)
• OS: Microsoft Holographics
• Memory:
• 2 GB RAM
• 1 GB HPU RAM
• Storage: 64 GB (flash memory)
• Display: 2.3 megapixel
widescreen stereoscopic head-
mounted display
• Sound: Spatial sound technology

8. MR is for Mixed Reality Devices: Google Project
Tango
Lenovo Phab Pro
• SoC: Qualcomm® Snapdragon™
652 processor built for Tango
• OS: Android™ 6.0, Marshmallow
• Memory: 4 GB RAM memory, 64
GB
• Display: 6..4" Quad HD (2560 x
1440) 2K IPS assertive display with
2.5D curved glass

9. MR is for Mixed Reality
Tools
Mixed Reality Tools / SDK
• Microsoft Hololens dev programm
• Unity Hololens
• Google Tango SDK ( android /
native)
• Tango SDK for Unity

10. MR is for Merged Reality: What is That?

11. MR is for Merged Reality Devices: Intel Project
Alloy
• vision processor
• 7th core processor
• ultra wide-angle fisheye lenses,
• 2 RealSense cameras,
sensors, and battery.

12. MR is for Merged Reality Devices: Google Standalone VR

13. Merged Reality Tools ?

14. VR is for Virtual Reality: Basic Graphics Characteristics
• FOV ( Field of View)
• Refresh rate
• Display Resolution
• PPI ( Pixel per inch)
• Lens type
• Sensors

15. VR is for Virtual Reality: FOV

16. VR is for Virtual Reality: Oculus
• FOV: 110x113
• Refresh Rate: 90Hz
• Resolution: 1200x1080
• PPI: 447
• Sensors: Accelerometer,
gyroscope, magnetometer

17. VR is for Virtual Reality: HTC
Vive
FOV: 94Hx93V
Refresh Rate: 90Hz
Resolution: 1200x1080
PPI: 456PPi
Sensors: Accelerometer,
gyroscope, magnetometer

18. VR is for Virtual Reality: PS VR
FOV: 100
Refresh Rate: 90/120Hz
Resolution: 960x1080
Sensors: Accelerometer,
gyroscope, magnetometer

19. VR is for Virtual Reality: Oculus Screen vs HTC Vive

20. VR is for Virtual Reality: PSVR Screen

21. Mobile VR - ?

22. Mobile VR - ?

23. Mobile VR - ?

24. Mobile VR - ?

25. Google cardboards world
FOV: 90-120
Refresh Rate: depends on device
Resolution: depends on phone
Sensors: Accelerometer,
gyroscope, magnetometer
Devices: Any Mobile Phone
SDK
• iOS
• Android

26. Google cardboards world

27. MVR: Google Cardboard Setup

28. VR Render

29. VR Render

30. VR Render: Lens correction data

31. VR Render: Lens correction data

32. VR Render: Lens distortion data

33. VR Render

34. Mobile VR - Controls

35. MVR is: Google Daydream View
FOV: 101
Refresh Rate: 60
Resolution:250x1440 /
FullHD (Both)
Sensors: Accelerometer,
gyroscope, magnetometer
Joystick
SDK
• Android

36. Daydream
Google Pixel / XL
Moto Z
Mate 9 Pro
ZTE Axon 7

37. Daydream: Coming Soon

38. Daydream: Controller

39. Google Daydream Tools: Unreal ( Branch )

40. Google Daydream Tools: Unity

41. Google Daydream

42. MVR is: Samsung Gear VR powered by Oculus Rift
FOV: 90-101
Refresh Rate: 50 - 60
Resolution: 2500x1440 (Both)
Sensors: Accelerometer,
gyroscope, magnetometer
Touch Panel
Devices: Top Samsung Phones
SDK
• Android

43. MVR is: Samsung Gear VR for Note
FOV: 101
Refresh Rate: depends on
device
Resolution: depends on phone
Sensors: Accelerometer,
gyroscope, magnetometer
Touch Panel
Devices: Samsung Notes
SDK
• Android

44. MVR is: Samsung Gear VR 2017
FOV: 101
Refresh Rate: depends on
device
Resolution: depends on
phone
Sensors: Accelerometer,
gyroscope, magnetometer
Joystick
SDK
• Android

45. Samsung Gear VR Pre-request

46. Samsung Gear VR: Controller
3-axis freedom of motion No depth movement
Sensors:Gyro+Accelerometer+Magnetometer,
SamplingRate @208Hz
Indicator: 3-colorLED
Battery:2xAAABattery(1000mAh,upto40dayswh
en used on average for 2 hours a day)
BT: 4.2 Blutooth Low Energy
Touchpad/Trigger/Back & Home Keys/Volume
Rocker

47. Samsung Gear VR: Sample

48. Samsung Gear VR: Tools
• Unreal Engine
• Unreal Engine Oculus
Branch
• Unity + Oculus Tools
• Native Android Support
• Samsung Platfrom SDK
• Samsung Avatar SDK

49. Samsung Gear VR: Unity Integration

50. Samsung Gear VR: Unity Integration

51. Samsung Gear VR: Unity Integration

52. Mobile VR Conclusion: It’s Cool

53. Mobile VR Conclusion: But
• You need performance!
• Performance on premium mobile is limited by capacity to
dissipate heat
• Phones are not getting bigger
• Segmentation ( Gear VR vs DayDream vs Cardboard
phones)

54. Q&A ?
Thank you!
al.rybakov@gmail.com