Ramesh Raskar MIT Media Lab Ramesh Raskar is an Associate Professor at MIT Media Lab. Ramesh Raskar joined the Media Lab from Mitsubishi Electric Research Laboratories in 2008 as head of the Lab’s Camera Culture research group. His research interests span the fields of computational photography, inverse problems in imaging and human-computer interaction. Recent projects and inventions include transient imaging to look around a corner, a next generation CAT-Scan machine, imperceptible markers for motion capture (Prakash), long distance barcodes (Bokode), touch+hover 3D interaction displays (BiDi screen), low-cost eye care devices (Netra,Catra), new theoretical models to augment light fields (ALF) to represent wave phenomena and algebraic rank constraints for 3D displays(HR3D). In 2004, Raskar received the TR100 Award from Technology Review, which recognizes top young innovators under the age of 35, and in 2003, the Global Indus Technovator Award, instituted at MIT to recognize the top 20 Indian technology innovators worldwide. In 2009, he was awarded a Sloan Research Fellowship. In 2010, he received the Darpa Young Faculty award. Other awards include Marr Prize honorable mention 2009, LAUNCH Health Innovation Award, presented by NASA, USAID, US State Dept and NIKE, 2010, Vodafone Wireless Innovation Project Award (first place), 2011. He holds over 50 US patents and has received four Mitsubishi Electric Invention Awards. He is currently co-authoring a book on Computational Photography.

1. Raskar, Camera Culture, MIT Media Lab
Camera Culture
Ramesh Raskar
Innovating for Billions
Ramesh Raskar
Associate Professor
MIT Media Lab

3. Slit Lamp for
Cataracts

4. 4
Slit Lamp Exam Retinal Scan
Retinal
Scan

5. Phoropter

6. Next 5 Billion
Emerging Interfaces
Emerging Worlds

7. Pamplona, Mohan, Oliveira, Raskar SIGGRAPH 2010
eyeNETRA:
Glasses and Cataract

8. Shack-Hartmann WS
Wavefront aberrometer
Refraction Map using Wavefront Sensor

9. 300+ DPI LCDs

10. Shack-Hartmann Wavefront Sensor
Lase
r
Sensor
10
Microlen
s Array
Planar
Wavefront
Shack & Platt 1971
Liang et al 1994
David Williams et al, Rochester
Spot Diagram

11. Lase
r
Sensor
Displacement =
Local Slope
of the Wavefront
Spot Diagram
Shack-Hartmann Wavefront Sensor
Shack & Platt 1971
Liang et al 1994
David Williams et al, Rochester

12. NETRA = Inverse of Shack-Hartmann
12
Spot Diagram on LCD
Cell
Phone
Displa
y
Eye
Piece
Shack-Hartmann ~ Augmented Lightfields
Oh, Raskar, Barbastathis 2009: Augmented Light Field

13. NETRA = Inverse of Shack-Hartmann
13
Eye
Piece
Shack-Hartmann ~ Augmented Lightfields
Oh, Raskar, Barbastathis 2009: Augmented Light Field
Spot Diagram
on LCD
CellPhone
LCD

14. 14
Spot Diagram
on LCD
NETRA = Inverse of Shack-Hartmann wavefront
sensor
User interactively creates the Spot Diagram
1. Displace 25
spots with
smart UI
CellPhone
LCD
EyePiece
2. Displace spots
till single dot
perceived

15. 15
Spot Diagram
on LCD
NETRA = Inverse of Shack-Hartmann wavefront sensor
User interactively creates the Spot Diagram
1. Displace 25
spots with
smart UI
CellPhone
LCD
EyePiece
2. Displace spots
till single dot
perceived

16. 16
Spot Diagram
on LCD
NETRA = Inverse of Shack-Hartmann wavefront sensor
User interactively creates the Spot Diagram
1. Displace 25
spots with
smart UI
CellPhone
LCD
EyePiece
2. Displace spots
till single dot
perceived

17. 17
Kenya
Thermometer for Eye

18. India

19. Brazil

21. EyeSelfie,
Swedish et al
SIGGRAPH 2015

23. MIT Media Lab

24. Next 5 Billion

25. Rethinking Engineering Design Execution

26. LVPEI@ Hyderabad

40. Doctor Instrument Patient

41. IA > AI
Intelligence
Amplification
Artificial
Intelligence

42. Health and Wellness Interfaces

44. Saving
Lives
Markets Partners

45. Kadambi, Gupta et al

47. F. Huang, G. Wetzstein, B. Barsky, R. Raskar, Siggraph 2014

48. Pre-corrected
Images on
Lightfield Display Siggraph 2012
Siggraph 2014

49. Read a book without opening pages using THz

51. Read a book without opening pages using THz

52. Sanchez, Heshmat, Reza, Romberg, Raskar 2015

53. Zensei: Bio Impendance
Casual Indentification
Sato, Puri, Ivan

54. ?

55. Receiver/
Transmitte
r
TX
RX1
RX2
RX3
RX4
Chervat, McCullum, Feignin, Raskar 2015, NATURE SciRep 2015

56. See Through Walls, NATURE SciRep 2015

57. Demo: Rflow, Bedri et al

58. FLIM
Satat et al. Nature Comm 2015
Bhandari et al. 2015

59. Pratik Shah, Hyunsung Park

60. Hospitals Schools
Food Transactions

61. Here There Together

62. Kumbh Mela: 30M Visitors 30 Days

64. Health
Food Transport
Housing Payments
Civic

67. Next: Jan 24-30, 2016

68. Crowds from Cell Tower Data

69. Data
Things
Citizens
Emerging Worlds

70. RameshRaskar
Alex(Sandy)Pentland
KentLarson
EthanZuckerman
IyadRahwan
CesarHidalgo

71. uist@
Emerging Interfaces
Emerging Worlds

72. Publish Demo Deploy

73. Pencil + Cassettes

74. Photo of women and weighing scale
Entrepreneur

75. Raskar, Camera Culture, MIT Media Lab
Camera Culture
Ramesh Raskar
Innovating for Billions
IA > AI

76. END

77. neXt

78. • What will a camera/display look like in 20 years?
• How will the next billion cameras change the social culture?
• How can we augment the camera to support best ‘image search’?
• How will portable health diagnostics impact healthcare?
• Will we live mostly in virtual/augmented reality, telepresent?
– TiVo for life?
• How will ultra-high-speed/resolution imaging change us?
• How can we improve ‘trust’ in imaging?
• Can we print anything .. Cars, food, .. babies ..
– (what will make Amazon obsolete)
• What are the opportunities in pervasive recording?
– e.g. GoogleEarth Live
• What will be in Photoshop2030?
• What is the future of movie-making, news reporting, sports viewing?

80. Camera in
20 years
Photoshop
2032
Pervasive
Recording
Movies and
News
Trust and
Social Stability
Health
Diagnostics
Augmented
Reality
3D
Displays
Print
Anything

82. Saving
Lives
Markets Partners

83. DOPS, DAPS and DIPS
Digital Opportunities for Physical Systems
Digital Applications for Physical Systems
Digital Interfaces for Physical Systems

84. Jesse Schell
Comfort
Excitement

85. Solo
Multi-year
Team
Swift

86. Raskar, Camera Culture, MIT Media Lab
Camera Culture
Ramesh Raskar
Ramesh Raskar
Asso. Professor
MIT Media Lab
What is
Siggraph NEXT

87. Geometry Rendering Animation
CAD
Imaging
Movies Games Photography
???

88. G R A I
Games/Movies

89. ML
SP
Optics
Audio
Graph
Cuts
…
G R A I
Games/Movies
'Does this work contribute TO Siggraph techniques’

90. ML
SP
Optics
Audio
Graph
Cuts
…
G R A I
Games/Movies
?
'Does this work contribute Siggraph techniques TO ..’

91. New
Fabrication, VR, Displays, Cameras, Perception, …
Emerging
Health, Drones, Transport, Materials, Food, Energy, …
NEXT
Speakers’ key challenges + visual computing can solve