Second tutorial about Snap Lens Studio taught as part of the COMP 4010 class on AR/VR. Taught by Mark Billinghurst on Tuesday August 3rd, 2021.

1. SNAP LENS STUDIO
Tutorial 2
Mark Billinghurst
mark.billinghurst@auckland.ac.nz

2. ADDING SCRIPTS

3. Using Existing Scripts
• Goal: Play a sound when mouth opens
• Can use existing script for this

4. Method
1. Load Visual Scripting template
2. Find ideal script
3. Export script
4. Load into project
5. Set parameters
6. Done

6. Select Desired Visual Script
• Select Tap to Play Sound Visual Script

7. Export Script
• Right click on Visual Script
• Select Export
• Save to desired location
• Creates a .lsscript file

8. Load Into Project
• Open Project
• Drag script into resources
• Drag in other resources needed
• Add script to Manager Object
• Add resource to input form

9. Add MouthOpenInput Event
• Open Tap to Play Script
• Add MouthOpenEvent node
• Wire it to NullCheck node

10. Demo
• Open mouth to play sound..

11. AR OVERLAY

12. Snap AR Overlay
• Several methods for AR overlay
• Face tracking
• Body tracking
• Marker tracking
• World tracking

13. Example: Simple Marker Tracking
•Key Steps
• 1. Select image markers
• 2. Add marker tracking
• 3. Add lights to markers
• 4. Add objects to markers
• 5. Add behaviours (optional)
• 6. Done

14. 1. Image Tracking Markers
• Find images that have good contrast, clarity (e.g. Vuforia markers)

15. Add Images to Project
• Create Marker folder
• Drag images into resource folder
• Rename images (if needed)

16. 2. Add marker tracking
• Add image tracking object to scene
• Select image tracking option
• Rename marker

17. Add second tracking marker
• Add second marker
• Attach to second image
• Rename marker

18. 3. Add Lights
• Move the existing lights under marker
• Attaches to marker
• Do for both markers

19. 4. Add Objects to Markers
• Add sphere and box objects
• Drag under marker object
• Attaching to the marker
• Create material properties
• Add materials to objects

20. 6. Done

21. Snap Lens Templates

22. Marker Overlay Template
• Click video and guide for
more information

24. Example: Surface Tracking
•Key Steps
1. Attach surface tracker to camera
2. Create scene object
3. Add shadows
4. Done

25. Attach Surface Tracker to Camera
• Select camera
• Hit + on inspector
• Select tracking
• Add device tracking
• Set Tracking Mode to Surface
• Select Use Native AR

26. Create Scene Object
• Add new scene object to scene
• Add new sphere to scene
• Drag under scene object
• Add PBR material to resource
• Set colour, add to sphere
• Position sphere above ground

27. Add Shadows
• Select sphere
• Set Shadow mode to Caster
• Set Shadow colour
• Add shadow plane to scene
• Place under sphere
• Set Shadow mode to Receiver
• Move plane to under sphere in 3D scene
• Select Light
• Check Shadows box
• Select Shadow colour

28. Test
• Tap to place sphere on plane
• Move around to see shadows

29. Look Around – World Tracking
Set camera to Rotation tracking
- Add Device Tracking to Camera

31. Setting up the Camera
• Select camera
• Add device tracking
• Set Tracking Mode to rotation

32. Demo
• Rotate phone to see models

33. Surface Fixed Portal
• Use Portal Template
• Place object in real world
• Walk into space when close

34. https://www.youtube.com/watch?v=KxTXiFrzSjw

35. Demo

37. Questions?

38. www.empathiccomputing.org
@marknb00
mark.billinghurst@auckland.ac.nz