Introduction to Holographic Development Matteo Valoriani Clemente Giorio Marco Dal Pino

1. Introduction to
Holographic Development
Clemente Giorio
Matteo Valoriani
Marco Dal Pino

2. Agenda
How develop HoloGraphic App
Setup and SDK
My first App
HoloToolKit Unity
Input: Gaze / Tap / Voice
Spatial Mapping
Performances
Q&A?

5. How develop
HoloGraphic App

6. Different Devices

7. Checklist
5.4.0f3-HTP
Build 10.0.14393.0

8. Unity 3D
Cross Platform
HoloLens Support
WYSIWYG Editor
Quick Interaction Times
Powerful Asset Pipeline
Easy to lean API’s
Programming Language: C#
Wrapper and dlls support: C++

9. Web Portal / Microsoft HoloLens App

10. Demo
My first App

11. HoloLens Toolkit-Unity
https://github.com/Microsoft/HoloToolkit-Unity
https://github.com/Microsoft/HoloToolkit-
Unity/blob/master/GettingStarted.md
Input
Sharing
Spatial Mapping
Spatial Sound
Utilities
Build

12. Demo
Input: Gaze / Tap / Voice

13. Spatial Mapping

14. Demo
Spatial Mapping - Planetarium

15. Shaders
Programs that run on the GPU
Written in C like language (CG, HLSL, GLSL)
Used for lighting, effects, computation, etc
DX11 Rendering Pipeline

16. Structure of a Shader
Shader “Name”{}
Properties {}
SubShader {}
Pass {}
CDPROGRAMM … ENDCG
Defining Variables
Structs
Vertex Program

17. Black.shader & Color.shader
Shader “DTC-HoloLens/Black”{
SubShader
{
Pass {}
}
}
Shader “DTC-HoloLens/Color”{
Properties
{
_Color (“Color”, Color) = (1,0,0)
}
SubShader
{
Color [_Color]
Pass {}
}
}

18. Shadertoy
https://www.shadertoy.com/view/4tlXWs
https://www.shadertoy.com/view/MlfXzN
https://www.shadertoy.com/view/lsXSDn
https://www.shadertoy.com/view/XdcGzr#

19. Performances
Profiler

20. Fild Of View

21. Remember HW Limits
Goals
• Frame Rate 60 fps
• Memory < 900 MB Total Commit
The the biggest factors for CPU performance are:
• Too many objects being rendered (try to keep this under 100 unique Renderers or UI
elements)
• Expensive updates or too many object updates
• Hitches due to garbage collection
• Expensive graphics settings and shaders (shadows, reflection probes, etc.)
https://developer.microsoft.com/en-us/windows/holographic/performance_recommendations_for_unity

22. Optimize Player
Go to the player settings by navigating to "Edit >
Project Settings > Player" page, click on the
"Windows Store“
Use Shader preloading, preloading means you won't
see any hitches due to runtime shader compilation.
Make sure "Rendering > Rendering Path" is set to
Forward (this is the default).
The "Use 16-bit Depth Buffers" setting allows you to
enable 16-bit depth buffers, which drastically reduces
the bandwidth (and thus power) associated with
depth buffer traffic.

23. Introduction to Mixed
Reality with HoloLens
Clemente Giorio
Matteo Valoriani
Marco Dal Pino

24. @HoloLensDevelop HoloLens Developers Group
https://www.linkedin.com/groups/8243800
Hololens Developers
https://www.facebook.com/groups/6285882
10601469
HoloLens Developers
https://plus.google.com/b/109053767376103420461/