1. Ramesh Raskar Mitsubishi Electric Research Labs (MERL), Cambridge, MA, USA New Directions in Augmented Reality
2.
3.
4.
5.
6. Spatially Augmented Reality (SAR) HMD-VR Spatially Immersive-VR AR using HMD Spatially Augmented Reality e.g. CAVE Video or Optical see-through SAR, Shaderlamps
32. Radiance Adjustment Virtual L(x, ) = F(x, , i ) L i (x, i ) d i I d Desired radiance BRDF Incident radiance
33. Radiance Adjustment k(x) cos( p ) d(x) 2 Real L(x, ) = F(x, , i ) L i (x, i ) d i L’(x, ) = I d I p (x, p ) Virtual Resultant radiance Pixel intensity
34. Radiance Adjustment d ( x ) 2 k ( x ) cos( p ) I p (x, p ) = I d , k ( x ) > 0 L ( x, ) Virtual Real Intensity correction Desired radiance Pixel intensity Reflectance
35.
36. Feathering in Overlap A B Projectors i d Traditional Solution A + B Projected Surface Weights A B
37. Feathering A B’ Projectors i d Traditional Solution A+B Projected Surface Weights B A+B A B
38. Feathering A B’ Projectors i d Traditional Solution A+B Projected Surface Weights A+B
49. Apparent Motion Ramesh Raskar, Remo Ziegler, Thomas Willwacher, “Cartoon Dioramas in Motion,” Proc. ACM Symposium on Nonphotorealistic Animation and Rendering (NPAR 2002)
63. Keystone Correction 1 . Compute screen to image homography 2 . Pre-warp input image Screen Projected image R Raskar
64. Automatic Keystone Correction with Camera and Tilt Sensor 1 . Camera and tilt sensor to find projector pose 2 . Compute screen to image homography 3 . Pre-warp input image Screen Projected image R Raskar [Raskar and Beardsley01]
65. Planar display surface Use homography ( A 3x3 ) User Single Projection Matrix ! V M i j A j = A i i = P T V ~ ~ P T j = [ A P T ] V ~
66. Ad-hoc Planar Cluster (Video) Self-contained Units, No centralized control No markers or cameras in environment Beyond the range of single camera
67.
68. Quardic curved shape Displays Planetarium Sim/Viz Center Raskar, vanBaar, Willwacher, Rao ‘Quadric Transfer for Immersive Curved Displays’, EuroGraphics 2004
69. Curved projective transfer Quadric classification Projectively equivalent to sphere: hyperboloid of two sheets paraboloid sphere ellipsoid Ruled quadrics: hyperboloids of one sheet Degenerate ruled quadrics: cone two planes
84. Ramesh Raskar, Paul Beardsley, Jeroen van Baar, Yao Wang, Paul Dietz, Johnny Lee, Darren Leigh, Thomas Willwacher Mitsubishi Electric Research Labs (MERL), Cambridge, MA R F I G Lamps : Interacting with a Self-describing World via Photosensing Wireless Tags and Projectors
92. Find tag location using handheld Projector Photosensing Wireless Tags Many geometric ops R F I R F I D Interactive stabilized projection (Radio Frequency Id & Geometry ) G Siggraph 2004
94. RFID (Radio Frequency Identification) RFI G (Radio Frequency Id and Geometry )
95.
96.
97.
98.
99.
100.
101.
102.
103.
104. Change Detection without fixed camera, in any lighting condition Compare with new coordinates from a different view Record coordinates of tags from one view Before After
![Parent Organization: MELCO ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)