SlideShare une entreprise Scribd logo
1  sur  25
Light Field Acquisition

    Douglas Lanman
    NVIDIA Research
Introduction to Light Fields
The 5D Plenoptic Function




                           P(q, f, l, t)
Q: What is the set of all things that one can ever see?
A: The Plenoptic Function [Adelson and Bergen 1991]
   (from plenus, complete or full, and optic)
The 5D Plenoptic Function




                           P(q, f, l, t)
Q: What is the set of all things that one can ever see?
A: The Plenoptic Function [Adelson and Bergen 1991]
   (from plenus, complete or full, and optic)
The 5D Plenoptic Function




                       P(q, f, l, t, px, py, pz )
P(q, f, l, t, px, py, pz ) defines the intensity of light:
• as a function of viewpoint
• as a function of time
• as a function of wavelength
The 5D Plenoptic Function




                       P(q, f, l, t, px, py, pz )
P(q, f, l, t, px, py, pz ) defines the intensity of light:
• as a function of viewpoint
• as a function of time
• as a function of wavelength
The 5D Plenoptic Function
Let’s ignore color and time (i.e., these are attributes of rays)…




                                          P(q, f, px, py, pz)
The plenoptic function is 5D:
• 3D position
• 2D direction

Require 5D to represent attributes across occlusions
The 4D Light Field
 Consider a region free of occluding objects…




                                                 P(q, f, px, py, pz)
 The plenoptic function (light field) is 4D
 • 2D position
 • 2D direction

 The space of all lines in a 3D space is 4D



[Levoy and Hanrahan 1996; Gortler et al. 1996]
Position-Angle Parameterization

2D position
2D direction




                                  s
                            q
Two-Plane Parameterization

2D position
2D position


                                 u
                             s
Alternative Parameterizations




   Left: Points on a plane or curved surface and directions leaving each point

   Center: Pairs of points on the surface of a sphere

   Right: Pair of points on two different (typically parallel) planes
Image-Based Rendering




 [Levoy and Hanrahan 1996]                            [Gortler et al. 1996]




                             [Carranza et al. 2003]
Digital Image Refocusing




      Kodak 16-megapixel sensor




    125μ square-sided microlenses

[Ng 2005]
3D Displays




Parallax Panoramagram   3DTV with Integral Imaging       MERL 3DTV
      [Kanolt 1918]        [Okano et al. 1999]     [Matusik and Pfister 2004]
Multiple Sensors
Static Camera Arrays




      Stanford Multi-Camera Array                Distributed Light Field Camera
   125 cameras using custom hardware           64 cameras with distributed rendering
 [Wilburn et al. 2002, Wilburn et al. 2005]   [Yang et al. 2002]
Temporal Multiplexing
Controlled Camera or Object Motion




  Stanford Spherical Gantry   Relighting with 4D Incident Light Fields
  [Levoy and Hanrahan 1996]   [Masselus et al. 2003]
Uncontrolled Camera or Object Motion




    Unstructured Lumigraph Rendering
   [Gortler et al. 1996; Buehler et al. 2001]
Spatial Multiplexing
Parallax Barriers (Pinhole Arrays)




 barrier




sensor


Spatially-multiplexed light field capture using masks (i.e., barriers):
• Cause severe attenuation  long exposures or lower SNR
• Impose fixed trade-off between spatial and angular resolution
  (unless implemented with programmable masks, e.g. LCDs)


[Ives 1903]
Light Field Photograph (Sensor)
Light Field Photograph (Decoded)
             looking to the right
looking up




                                           Sample Image




[The (New) Stanford Light Field Archive]
Integral Imaging (“Fly’s Eye” Lenslets)




lenslet


                                  f

sensor

Spatially-multiplexed light field capture using lenslets:
• Impose fixed trade-off between spatial and angular resolution




[Lippmann 1908]
Modern, Digital Implementations




Digital Light Field Photography
• Hand-held plenoptic camera [Ng et al. 2005]
• Heterodyne light field camera [Veeraraghavan et al. 2007]

Contenu connexe

Tendances

Compressive Light Field Projection @ SIGGRAPH 2014
Compressive Light Field Projection @ SIGGRAPH 2014Compressive Light Field Projection @ SIGGRAPH 2014
Compressive Light Field Projection @ SIGGRAPH 2014StanfordComputationalImaging
 
Accommodation-invariant Computational Near-eye Displays - SIGGRAPH 2017
Accommodation-invariant Computational Near-eye Displays - SIGGRAPH 2017Accommodation-invariant Computational Near-eye Displays - SIGGRAPH 2017
Accommodation-invariant Computational Near-eye Displays - SIGGRAPH 2017StanfordComputationalImaging
 
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016StanfordComputationalImaging
 
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley PosterRIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley PosterKevin Nouri
 
HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast Barco
 
Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport
Temporal Frequency Probing for 5D Transient Analysis of Global Light TransportTemporal Frequency Probing for 5D Transient Analysis of Global Light Transport
Temporal Frequency Probing for 5D Transient Analysis of Global Light TransportMatthew O'Toole
 
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...Barco
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)Matthew O'Toole
 
study Coded Aperture
study Coded Aperturestudy Coded Aperture
study Coded ApertureChiamin Hsu
 
Multi Aperture Photography
Multi Aperture PhotographyMulti Aperture Photography
Multi Aperture Photographymakrofajj
 
Astrophotography with a side of Raspberry Pi
Astrophotography with a side of Raspberry PiAstrophotography with a side of Raspberry Pi
Astrophotography with a side of Raspberry PiRob Pettengill
 

Tendances (20)

Raskar Banff
Raskar BanffRaskar Banff
Raskar Banff
 
Compressive Light Field Projection @ SIGGRAPH 2014
Compressive Light Field Projection @ SIGGRAPH 2014Compressive Light Field Projection @ SIGGRAPH 2014
Compressive Light Field Projection @ SIGGRAPH 2014
 
Accommodation-invariant Computational Near-eye Displays - SIGGRAPH 2017
Accommodation-invariant Computational Near-eye Displays - SIGGRAPH 2017Accommodation-invariant Computational Near-eye Displays - SIGGRAPH 2017
Accommodation-invariant Computational Near-eye Displays - SIGGRAPH 2017
 
Compressive DIsplays: SID Keynote by Ramesh Raskar
Compressive DIsplays: SID Keynote by Ramesh RaskarCompressive DIsplays: SID Keynote by Ramesh Raskar
Compressive DIsplays: SID Keynote by Ramesh Raskar
 
Compressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta KadambiCompressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta Kadambi
 
Raskar Keynote at Stereoscopic Display Jan 2011
Raskar Keynote at Stereoscopic Display Jan 2011Raskar Keynote at Stereoscopic Display Jan 2011
Raskar Keynote at Stereoscopic Display Jan 2011
 
CORNAR: Looking Around Corners using Trillion FPS Imaging
CORNAR: Looking Around Corners using Trillion FPS ImagingCORNAR: Looking Around Corners using Trillion FPS Imaging
CORNAR: Looking Around Corners using Trillion FPS Imaging
 
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
 
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley PosterRIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
 
Raskar COSI invited talk Oct 2009
Raskar COSI invited talk Oct 2009Raskar COSI invited talk Oct 2009
Raskar COSI invited talk Oct 2009
 
HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast
 
Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport
Temporal Frequency Probing for 5D Transient Analysis of Global Light TransportTemporal Frequency Probing for 5D Transient Analysis of Global Light Transport
Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport
 
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
 
prueba
pruebaprueba
prueba
 
Dual photography
Dual photographyDual photography
Dual photography
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)
 
study Coded Aperture
study Coded Aperturestudy Coded Aperture
study Coded Aperture
 
Multi Aperture Photography
Multi Aperture PhotographyMulti Aperture Photography
Multi Aperture Photography
 
Astrophotography with a side of Raspberry Pi
Astrophotography with a side of Raspberry PiAstrophotography with a side of Raspberry Pi
Astrophotography with a side of Raspberry Pi
 
Raskar Ilp Oct08 Web
Raskar Ilp Oct08 WebRaskar Ilp Oct08 Web
Raskar Ilp Oct08 Web
 

En vedette

SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 IntroductionSIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 IntroductionGordon Wetzstein
 
SIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational DisplaysSIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational DisplaysMatt Hirsch - MIT Media Lab
 
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...Matt Hirsch - MIT Media Lab
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren ImagingSIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren ImagingGordon Wetzstein
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...Gordon Wetzstein
 
SIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introductionSIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introductionMatt Hirsch - MIT Media Lab
 
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...Matt Hirsch - MIT Media Lab
 

En vedette (7)

SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 IntroductionSIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
 
SIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational DisplaysSIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational Displays
 
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren ImagingSIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
 
SIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introductionSIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introduction
 
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
 

Similaire à SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields

Geometry of Aerial Photographs.pdf
Geometry of Aerial Photographs.pdfGeometry of Aerial Photographs.pdf
Geometry of Aerial Photographs.pdfkunedzimwefrancisca
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)Matthew O'Toole
 
Optical Computing for Fast Light Transport Analysis
Optical Computing for Fast Light Transport AnalysisOptical Computing for Fast Light Transport Analysis
Optical Computing for Fast Light Transport AnalysisMatthew O'Toole
 
Aerial photography- Concept and Terminologies
Aerial photography- Concept and Terminologies Aerial photography- Concept and Terminologies
Aerial photography- Concept and Terminologies UTTIYACHATTOPADHYAY2
 
One day short course on Green Building Assessment Methods - Daylight Simulation
One day short course on Green Building Assessment Methods - Daylight SimulationOne day short course on Green Building Assessment Methods - Daylight Simulation
One day short course on Green Building Assessment Methods - Daylight Simulationekwtsang
 
stduy Edge-Based Image Coarsening
stduy Edge-Based Image Coarseningstduy Edge-Based Image Coarsening
stduy Edge-Based Image CoarseningChiamin Hsu
 
Definition significance measurement_modelling_BRDF
Definition significance measurement_modelling_BRDFDefinition significance measurement_modelling_BRDF
Definition significance measurement_modelling_BRDFLinyuan Li
 
Lecture 02 yasutaka furukawa - 3 d reconstruction with priors
Lecture 02   yasutaka furukawa - 3 d reconstruction with priorsLecture 02   yasutaka furukawa - 3 d reconstruction with priors
Lecture 02 yasutaka furukawa - 3 d reconstruction with priorsmustafa sarac
 
Incident light field 1
Incident light field 1Incident light field 1
Incident light field 1Debmalya Sinha
 
Incident light field 1
Incident light field 1Incident light field 1
Incident light field 1Debmalya Sinha
 
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019StanfordComputationalImaging
 
Fisheye Omnidirectional View in Autonomous Driving
Fisheye Omnidirectional View in Autonomous DrivingFisheye Omnidirectional View in Autonomous Driving
Fisheye Omnidirectional View in Autonomous DrivingYu Huang
 
The CCD detector.ppt
The CCD detector.pptThe CCD detector.ppt
The CCD detector.pptStefan Oprea
 
Build Your Own 3D Scanner: Conclusion
Build Your Own 3D Scanner: ConclusionBuild Your Own 3D Scanner: Conclusion
Build Your Own 3D Scanner: ConclusionDouglas Lanman
 

Similaire à SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields (20)

Geometry of Aerial Photographs.pdf
Geometry of Aerial Photographs.pdfGeometry of Aerial Photographs.pdf
Geometry of Aerial Photographs.pdf
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
 
Mit Museum Talk
Mit Museum TalkMit Museum Talk
Mit Museum Talk
 
Optical Computing for Fast Light Transport Analysis
Optical Computing for Fast Light Transport AnalysisOptical Computing for Fast Light Transport Analysis
Optical Computing for Fast Light Transport Analysis
 
Aerial photography- Concept and Terminologies
Aerial photography- Concept and Terminologies Aerial photography- Concept and Terminologies
Aerial photography- Concept and Terminologies
 
Lec03 light
Lec03 lightLec03 light
Lec03 light
 
One day short course on Green Building Assessment Methods - Daylight Simulation
One day short course on Green Building Assessment Methods - Daylight SimulationOne day short course on Green Building Assessment Methods - Daylight Simulation
One day short course on Green Building Assessment Methods - Daylight Simulation
 
HR3D: Content Adaptive Parallax Barriers
HR3D: Content Adaptive Parallax BarriersHR3D: Content Adaptive Parallax Barriers
HR3D: Content Adaptive Parallax Barriers
 
stduy Edge-Based Image Coarsening
stduy Edge-Based Image Coarseningstduy Edge-Based Image Coarsening
stduy Edge-Based Image Coarsening
 
Representation
RepresentationRepresentation
Representation
 
Definition significance measurement_modelling_BRDF
Definition significance measurement_modelling_BRDFDefinition significance measurement_modelling_BRDF
Definition significance measurement_modelling_BRDF
 
Svr Raskar
Svr RaskarSvr Raskar
Svr Raskar
 
Lecture 02 yasutaka furukawa - 3 d reconstruction with priors
Lecture 02   yasutaka furukawa - 3 d reconstruction with priorsLecture 02   yasutaka furukawa - 3 d reconstruction with priors
Lecture 02 yasutaka furukawa - 3 d reconstruction with priors
 
Incident light field 1
Incident light field 1Incident light field 1
Incident light field 1
 
Incident light field 1
Incident light field 1Incident light field 1
Incident light field 1
 
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
 
Fisheye Omnidirectional View in Autonomous Driving
Fisheye Omnidirectional View in Autonomous DrivingFisheye Omnidirectional View in Autonomous Driving
Fisheye Omnidirectional View in Autonomous Driving
 
Cgp lecture1 introduction
Cgp lecture1 introductionCgp lecture1 introduction
Cgp lecture1 introduction
 
The CCD detector.ppt
The CCD detector.pptThe CCD detector.ppt
The CCD detector.ppt
 
Build Your Own 3D Scanner: Conclusion
Build Your Own 3D Scanner: ConclusionBuild Your Own 3D Scanner: Conclusion
Build Your Own 3D Scanner: Conclusion
 

Dernier

Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfagholdier
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...fonyou31
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room servicediscovermytutordmt
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfAdmir Softic
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfchloefrazer622
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 

Dernier (20)

Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 

SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields

  • 1. Light Field Acquisition Douglas Lanman NVIDIA Research
  • 3. The 5D Plenoptic Function P(q, f, l, t) Q: What is the set of all things that one can ever see? A: The Plenoptic Function [Adelson and Bergen 1991] (from plenus, complete or full, and optic)
  • 4. The 5D Plenoptic Function P(q, f, l, t) Q: What is the set of all things that one can ever see? A: The Plenoptic Function [Adelson and Bergen 1991] (from plenus, complete or full, and optic)
  • 5. The 5D Plenoptic Function P(q, f, l, t, px, py, pz ) P(q, f, l, t, px, py, pz ) defines the intensity of light: • as a function of viewpoint • as a function of time • as a function of wavelength
  • 6. The 5D Plenoptic Function P(q, f, l, t, px, py, pz ) P(q, f, l, t, px, py, pz ) defines the intensity of light: • as a function of viewpoint • as a function of time • as a function of wavelength
  • 7. The 5D Plenoptic Function Let’s ignore color and time (i.e., these are attributes of rays)… P(q, f, px, py, pz) The plenoptic function is 5D: • 3D position • 2D direction Require 5D to represent attributes across occlusions
  • 8. The 4D Light Field Consider a region free of occluding objects… P(q, f, px, py, pz) The plenoptic function (light field) is 4D • 2D position • 2D direction The space of all lines in a 3D space is 4D [Levoy and Hanrahan 1996; Gortler et al. 1996]
  • 11. Alternative Parameterizations Left: Points on a plane or curved surface and directions leaving each point Center: Pairs of points on the surface of a sphere Right: Pair of points on two different (typically parallel) planes
  • 12. Image-Based Rendering [Levoy and Hanrahan 1996] [Gortler et al. 1996] [Carranza et al. 2003]
  • 13. Digital Image Refocusing Kodak 16-megapixel sensor 125μ square-sided microlenses [Ng 2005]
  • 14. 3D Displays Parallax Panoramagram 3DTV with Integral Imaging MERL 3DTV [Kanolt 1918] [Okano et al. 1999] [Matusik and Pfister 2004]
  • 16. Static Camera Arrays Stanford Multi-Camera Array Distributed Light Field Camera 125 cameras using custom hardware 64 cameras with distributed rendering [Wilburn et al. 2002, Wilburn et al. 2005] [Yang et al. 2002]
  • 18. Controlled Camera or Object Motion Stanford Spherical Gantry Relighting with 4D Incident Light Fields [Levoy and Hanrahan 1996] [Masselus et al. 2003]
  • 19. Uncontrolled Camera or Object Motion Unstructured Lumigraph Rendering [Gortler et al. 1996; Buehler et al. 2001]
  • 21. Parallax Barriers (Pinhole Arrays) barrier sensor Spatially-multiplexed light field capture using masks (i.e., barriers): • Cause severe attenuation  long exposures or lower SNR • Impose fixed trade-off between spatial and angular resolution (unless implemented with programmable masks, e.g. LCDs) [Ives 1903]
  • 23. Light Field Photograph (Decoded) looking to the right looking up Sample Image [The (New) Stanford Light Field Archive]
  • 24. Integral Imaging (“Fly’s Eye” Lenslets) lenslet f sensor Spatially-multiplexed light field capture using lenslets: • Impose fixed trade-off between spatial and angular resolution [Lippmann 1908]
  • 25. Modern, Digital Implementations Digital Light Field Photography • Hand-held plenoptic camera [Ng et al. 2005] • Heterodyne light field camera [Veeraraghavan et al. 2007]