Sauli Kiviranta, Co-Founder, CTO, Delta Cygni Labs Fundamentals of Augmented Reality - Past, Present and Future Mindtrek 2016

1. 1
Fundamentals of Augmented Reality
Past, Present and Future
SAULI KIVIRANTA
CO-FOUNDER, CTO, DELTA CYGNI LABS

2. SAULI KIVIRANTA
2
MY JOURNEYTO AR
@sksauli

3. 3
2008

4. 4

5. 5

6. 6

7. 7

8. 8

9. 9

10. 10

11. WE KNOW WHAT IT IS…
BUT WHY IS IT?

12. Why AR exists?
Modality 2Modality 1 Modality 3
???

13. 13
▪ Sight (visual)
▪ Hearing (aural)
▪ Touch (somatosensory)
▪ Smell (olfactory)
▪ Taste (gustatory)
For human, visual information is dominant for
perceiving and understanding this world...
Do not forget other senses!
5senses
FIRST PRINCIPLES:
HUMAN PERCEPTION

14. 500M years of evolution:
Concrete Reasoning
Vision starts to develop
Audition starts to develop
Proto language starts to develop
Visual acuity of modern eye
Human Evolution

15. Concrete Mental Models
Perception
▪ Visual
▪ Auditory
▪ Touch
▪ Olfactory
▪ Gustatory
Sense of relations, location,
motion, distance, proximity,
color, taste, smell…
e.g. Spatial Reasoning

16. Why AR exists?
Modality 2Modality 1 Modality 3
Concrete
Reasoning
??

17. Counting of items invented
Numbers for collections of items
Proto writing for storytelling emerged
Mathematics & written language emerge
Aural language emerges
Vision starts to develop
Audition starts to develop
Proto language starts to develop
Visual acuity of modern eye
Human Evolution
100k years of evolution:
Abstract Reasoning

18. Reference
▪ Visual
▪ Auditory
▪ Touch
▪ Olfactory
▪ Gustatory
References, Properties,
Syntax, Grammar, Denotation,
Abstracting abstractions...
Abstract Mental Models

19. Why AR exists?
Modality 2Modality 1 Modality 3
Concrete
Reasoning
Abstract
Reasoning
?

20. Linear perspective invented by Filippo Brunelleschi
Counting of items invented
Numbers for collections of items
Proto writing for storytelling emerged
Mathematics & written language emerge
Aural language emerges
Vision starts to develop
Audition starts to develop
Proto language starts to develop
Visual acuity of modern eye
Human Evolution
Key insight from
Prof. Dr. Giuseppe
Di Gironimo

21. Filippo Brunelleschi
Brunelleschi needed his perspective
realism to be proven against Euclidean
laws of geometric optics…

22. Looks familiar?
Augmenting factory under
construction in 2010
Augmenting baptistery under
construction in 1413

23. Brunelleschi demonstration was
equivalent to modern Augmented Reality
Filippo Brunelleschi

24. Brunelleschi impact on
visual simulation...

25. Parallax free view of graphics content
Optical principles for contextualised graphics
Linear perspective invented by Filippo Brunelleschi
Counting of items invented
Numbers for collections of items
Proto writing for storytelling emerged
Mathematics & written language emerge
Aural language emerges
Vision starts to develop
Audition starts to develop
Proto language starts to develop
Visual acuity of modern eye
Human Evolution
Ivan Sutherland1968
The Sword of Damocles

26. Augmented Reality – Thomas Caudell, Boeing 1990
Abstract and Concrete reasoning combined
Parallax free view of graphics content
Linear perspective invented by Filippo Brunelleschi
Counting of items invented
Numbers for collections of items
Proto writing for storytelling emerged
Mathematics & written language emerge
Aural language emerges
Vision starts to develop
Audition starts to develop
Proto language starts to develop
Visual acuity of modern eye
Dr.Thomas P. Caudell
Human Evolution
Terminator 1984

27. What did we learn?
Perspective drawing technology invented by Brunelleschi
• Spatial reasoning unleashed for art and engineering
What is called Augmented Reality started to take shape
• Technology to combine Concrete & Abstract reasoning

28. Why AR exists?
Modality 2Modality 1 Modality 3
Concrete
Reasoning
Abstract
Reasoning
?

29. ▪ Sight (visual)
▪ Hearing (aural)
▪ Touch (somatosensory)*
▪ Smell (olfactory)
▪ Taste (gustatory)
Human Sensors: Machine Sensors:
Gyroscope, Accelerometer, Magnetometer , Geophone,
Hydrophone, Microphone, Seismometer, Hall effect sensor,
MAP sensor, Mass flow sensor, Oxygen sensor, Speed
sensor, Breathalyzer, Carbon dioxide sensor, Carbon
monoxide detector, Electrochemical gas sensor,
Fluorescent chloride sensors, Hydrogen sulfide sensor,
Olfactometer, Smoke detector, Magnetometer, Geiger
counter, Altimeter, Variometer, Capacitive sensing, Free
fall sensor, Rotary encoder…
Human-Machine Systems
Unity of Human and Machine

30. Human Augmentation with
Transformational Reasoning

31. Modality 2Modality 1 Modality 3
Concrete
Reasoning
Abstract
Reasoning
Transformational
Reasoning
Why AR exists?

32. LETS REVIEWTHE 5 SENSES
Augmented Reality with Concrete & Abstract reasoning

33. Augmenting Vision
Concrete Abstract
HoloLens
Google Glass

34. Augmenting Audio
Concrete Abstract

35. Augmenting Touch
Concrete Abstract

36. Augmenting Smell
Ethanethiol
Propane
Concrete Abstract
Nosulus Rift

37. Augmenting Taste
Concrete Abstract

38. HUMAN AUGMENTATION
Concrete, Abstract & Transformational reasoning

39. From sensors to sensations...
Yuta Takeuchi et al.

40. From sensors to sensations...

41. From sensors to sensations...
3D Studio Blomberg - www.3dstudio.fi

42. Lance Corporal Craig Lundberg
From sensors to sensations...

43. What did we learn?
• Concrete Reasoning & Abstract Reasoning
• Transformational Reasoning for “new” senses
• Brain is very plastic and it will adapt to AR!
• Human-Machine Systems

44. We have not even started to properly
leverage the human potential...
Augmented Reality will change that!

45. 45
Augmented Reality
Business Foundation
LIBERATE TACIT (SILENT) KNOWLEDGE

46. 46

47. 47
When customer needs help…
Time is priceless!

48. 48
48
Customer:
System is not working,
can you support us?
You:
First release the CMP
piping next to the
DLC pump…
Customer:
Where is the DLC
pump located?
You:
It is square looking
box and 5cm of it
there are 4 bolts…
Customer:
Uhmmmm… Can you
come visit us???
You:
OK, we will send
someone next week!
Communication is the problem…
Phone support:
Old way…

49. 49
Augmented Reality is the solution…
Customer:
System is not working,
can you Pointr us?
You:
For safety, do not
remove the cables
marked with red
Customer:
Ok, understood!
You:
Release CMP piping
by opening bolts
marked with green
Customer:
Great, that was easy!
You:
Happy to help!
Pointr support:
New way…

50. Pointr is
communication beyond
voice and video
POINTR
COMMUNICATION ATTHE NEXT LEVEL
Pointr is the best
way to solve technical
problems remotely

51. 51
POINTR EASY REMOTE SUPPORT
WWW.POINTR.IT

52. 52

53. COMMUNICATE SPATIAL REASONING
53
LEVERAGE 500M YEARS OF HUMAN EVOLUTION

54. AUGMENTED REALITY IN INDUSTRY
• Repair & off-nominal maintenance
• Ramp-up & commissioning
• Upgrades & retrofit
• On-the-job training
• Quality assurance
• Warranty period support
PRODUCTIVITY BOOST TODAY…
TOMORROW AUGMENTED REALITY
WILL EMPOWER ALL OF MANKIND

55. 55
www.deltacygnilabs.com
@sksauli
THANKYOU!
BORIS
KRASSI, CEO
FOUNDER
SAULI
KIVIRANTA, CTO
FOUNDER
JOHANNA
ANIA
SALES
MARKUS
MYHRBERG
BOARD MEMBER
TEEMU
KUMPUMÄKI
DEVELOPMENT
NIRDHARSH
SHETTY
DEVELOPMENT
IGOR
LEVOCHKIN
DEVELOPMENT
HARRI
HYKKÖ
SALES