SlideShare a Scribd company logo
1 of 22
Incident Light Field
The distribution of light in a static scene with a fixed illumination
Dr. Kurt Debattista
Prof. Alan Chalmers
Debmalya Sinha
Courtesy: J. Unger / Linköping University
Synthetic objects on a physical table with real life lighting
Acquisition
Dynamic or Static
Large Camera Array, Mirror
sphere, Plane Mirror, HDR
video, SfM (structure from
motion)
Physical
Scene
Representation
2PP
PDP
2SP
DPP
Rendering
Storage
Virtual
Scene
1. Image Based Lighting
2. Light Field
Incident Light Field
We require an Environment Map
A Panoramic image of the
environment that envelops the object
space we’re about to Render.
1. Image Based Lighting
2. Light Field
Incident Light Field
Courtesy: nVidia
1. Image Based Lighting
2. Light Field
Incident Light Field
We take several pictures from spatially
varying points on the camera plane.
Each of the pictures differ a little by angle
Courtesy: Pat Hanrahan / Stanford University
1. Image Based Lighting
2. Light Field
Incident Light Field
1. Image Based Lighting
2. Light Field
Incident Light Field
1. Image Based Lighting
2. Light Field
Incident Light Field
The distribution of light in a static scene with a
fixed illumination
We take separate environment map of each
little segments of the space to record the
incident light rays on the entire object space
we are about to render.
Courtesy: J. Unger / Linköping University
Acquisition
Dynamic or Static
Large Camera Array, Mirror
sphere, Plane Mirror, HDR
video, SfM (structure from
motion)
Physical
Scene
Representation
2PP
PDP
2SP
DPP
Rendering
Storage
Virtual
Scene
Representation
Represented by 7 dimension Plenoptic function on a point P
θ,φ -> direction of light ray from P,
λ -> wavelength of incident light,
t -> time
Vx,Vy,Vz -> Cartesian coordinate of P.
P = P(θ,φ,λ,t,Vx,Vy,Vz)
Which can be reduced to a 4D function
P = P(θ,φ,u,v)
Assuming, the incident light only comes from the
upper hemisphere of the surface [Vx,Vy] ([u,v]).
0 ≤ φ ≤ π/2 and -π ≤ θ ≤ π
Plenoptic parameterization
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Representation
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
2PP
PDP
2SP
DPP
Line Space parameterization
Two Points on Two Planes
A Point and a Direction
Two Points on a Sphere
A Direction and a Point
2PP
2SP
PDP
DPP
Courtesy: Camahort et al.
Acquisition
Dynamic or Static
Large Camera Array, Mirror
sphere, Plane Mirror, HDR
video, SfM (structure from
motion)
Physical
Scene
Representation
2PP
PDP
2SP
DPP
Rendering
Storage
Virtual
Scene
Acquisition
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Light Probes
A Light Probe is an omni-directional (360° panoramic) high-dynamic range image. (Debevec et al.)
• Typically a highly reflective silvered ball is used.
• An HDR Image is taken of the ball.
Problems:
• The image has the reflection of the camera itself.
• Has to take two images from different direction to get rid
of the reflection of camera.
• The edges are stretched badly and needs efficient warping.
Acquisition
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Light Probes for ILF
Techniques
• Single HDR image of Light probe
• HDR video of a moving Light Probe
• HDR video from fisheye lens
• Light Probe Array
• Plain Mirror (edge coded)
Edge coded plain mirror - Courtesy: Ihrke et al. / INRIA Labs
Mirror Sphere array - Courtesy: Dr. J. Unger
HDR video with fisheye lens - Courtesy: Dr. J. Unger
Acquisition
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Light Probes for ILF
Problems of mirror sphere array
• Reflection from other Mirrors
• Camera reflection
Problems of HDR Video setup
• Impractical for big space
AcquisitionProposals
1. Bowls are better than Balls:
Concave light probes to eliminate mutual reflection
2. 3D space coverage:
45* angle concave probe plane to capture uneven
surface such as race tracks
Far fetched idea:
probe fitted in a Quadraptor!
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Blocked for obvious reasons !
AcquisitionProposals
1. Bowls are better than Balls:
Concave light probes to eliminate mutual reflection
2. 3D space coverage:
45* angle concave probe plane to capture uneven
surface such as race tracks
Far fetched idea:
probe fitted in a Quadraptor!
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
1 2 3 4 5 6 7
Move Direction
Blocked for obvious reasons !
AcquisitionProposals
1. Bowls are better than Balls:
Concave light probes to eliminate mutual reflection
2. 3D space coverage:
45* angle concave probe plane to capture uneven surface such as
race tracks
Far fetched idea:
probe with a gimbal fitted in a Quadraptor!
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Little inefficient for
covering large space
provides much more mobility
than a fixed camera setup
Blocked for obvious reasons !
Acquisition
Physical
Scene
Representation
Rendering
Storage
Virtual
Scene
ToDoin the next months
• Re-creating the ILF acquisition with spherical probe.
• Implementing it into PARC
• Comparing to original results in terms of Rendering
Artifacts
• Seam
• Hair
• Pixelation
• Ghosting
• Disparity problem
Questions?

More Related Content

What's hot

Ultimate astronomicalimaging
Ultimate astronomicalimagingUltimate astronomicalimaging
Ultimate astronomicalimaging
Clifford Stone
 
Prathipati_Ravi_Poster15-16
Prathipati_Ravi_Poster15-16Prathipati_Ravi_Poster15-16
Prathipati_Ravi_Poster15-16
Ravi Prathipati
 
20120328 Technical Seminar on Daylighting Environment in Hong Kong
20120328 Technical Seminar on Daylighting Environment in Hong Kong20120328 Technical Seminar on Daylighting Environment in Hong Kong
20120328 Technical Seminar on Daylighting Environment in Hong Kong
ekwtsang
 
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
ekwtsang
 
Diffoot fayful
Diffoot fayfulDiffoot fayful
Diffoot fayful
NASAPMC
 

What's hot (20)

SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)
 
Ultimate astronomicalimaging
Ultimate astronomicalimagingUltimate astronomicalimaging
Ultimate astronomicalimaging
 
Introduction to Remote Sensing_2014
Introduction to Remote Sensing_2014Introduction to Remote Sensing_2014
Introduction to Remote Sensing_2014
 
Noise from stray light in interferometric GWs detectors
Noise from stray light in interferometric GWs detectorsNoise from stray light in interferometric GWs detectors
Noise from stray light in interferometric GWs detectors
 
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
 
Prathipati_Ravi_Poster15-16
Prathipati_Ravi_Poster15-16Prathipati_Ravi_Poster15-16
Prathipati_Ravi_Poster15-16
 
1316 ditto[1]
1316 ditto[1]1316 ditto[1]
1316 ditto[1]
 
Solar resource measurements and sattelite data
Solar resource measurements and sattelite dataSolar resource measurements and sattelite data
Solar resource measurements and sattelite data
 
Nikon system configuration & application
Nikon system configuration & applicationNikon system configuration & application
Nikon system configuration & application
 
Telescopes
TelescopesTelescopes
Telescopes
 
FDL 2017 3D Shape Modeling
FDL 2017 3D Shape ModelingFDL 2017 3D Shape Modeling
FDL 2017 3D Shape Modeling
 
20120328 Technical Seminar on Daylighting Environment in Hong Kong
20120328 Technical Seminar on Daylighting Environment in Hong Kong20120328 Technical Seminar on Daylighting Environment in Hong Kong
20120328 Technical Seminar on Daylighting Environment in Hong Kong
 
Large telescope
Large telescopeLarge telescope
Large telescope
 
FDL 2017 Long Period Comets Final Presentation
FDL 2017 Long Period Comets Final PresentationFDL 2017 Long Period Comets Final Presentation
FDL 2017 Long Period Comets Final Presentation
 
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
 
Semi-Analytic Modeling: Creation of the Far-IR Populations
Semi-Analytic Modeling: Creation of the Far-IR PopulationsSemi-Analytic Modeling: Creation of the Far-IR Populations
Semi-Analytic Modeling: Creation of the Far-IR Populations
 
FDL 2017 Solar Storm Prediction Presentation
FDL 2017 Solar Storm Prediction PresentationFDL 2017 Solar Storm Prediction Presentation
FDL 2017 Solar Storm Prediction Presentation
 
FDL 2017 Solar Terrestrial Interactions
FDL 2017 Solar Terrestrial InteractionsFDL 2017 Solar Terrestrial Interactions
FDL 2017 Solar Terrestrial Interactions
 
20th. Single Molecule Workshop Picoquant 2014
20th. Single Molecule Workshop Picoquant 201420th. Single Molecule Workshop Picoquant 2014
20th. Single Molecule Workshop Picoquant 2014
 
Diffoot fayful
Diffoot fayfulDiffoot fayful
Diffoot fayful
 

Viewers also liked

Viewers also liked (10)

HaiXiu: Emotion Recognition from Movements
HaiXiu: Emotion Recognition from MovementsHaiXiu: Emotion Recognition from Movements
HaiXiu: Emotion Recognition from Movements
 
Whither Software Engineering Research? (keynote talk at APSEC 2012)
Whither Software Engineering Research? (keynote talk at APSEC 2012)Whither Software Engineering Research? (keynote talk at APSEC 2012)
Whither Software Engineering Research? (keynote talk at APSEC 2012)
 
Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...
Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...
Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...
 
Street photogrpahy workshop
Street photogrpahy workshopStreet photogrpahy workshop
Street photogrpahy workshop
 
The Power of Probabilistic Thinking (keynote talk at ASE 2016)
The Power of Probabilistic Thinking (keynote talk at ASE 2016)The Power of Probabilistic Thinking (keynote talk at ASE 2016)
The Power of Probabilistic Thinking (keynote talk at ASE 2016)
 
Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)
Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)
Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)
 
Jogging While Driving, and Other Software Engineering Research Problems (invi...
Jogging While Driving, and Other Software Engineering Research Problems (invi...Jogging While Driving, and Other Software Engineering Research Problems (invi...
Jogging While Driving, and Other Software Engineering Research Problems (invi...
 
Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...
Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...
Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...
 
Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...
Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...
Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...
 
Career Management (invited talk at ICSE 2014 NFRS)
Career Management (invited talk at ICSE 2014 NFRS)Career Management (invited talk at ICSE 2014 NFRS)
Career Management (invited talk at ICSE 2014 NFRS)
 

Similar to Incident light field 1

Night vision technology
Night vision technologyNight vision technology
Night vision technology
gy_manish
 
637125main strekalov presentation
637125main strekalov presentation637125main strekalov presentation
637125main strekalov presentation
Clifford Stone
 
Measurement of corneal curvature
Measurement of corneal curvatureMeasurement of corneal curvature
Measurement of corneal curvature
GauriSShrestha
 

Similar to Incident light field 1 (20)

Optics group research overview
Optics group research overviewOptics group research overview
Optics group research overview
 
study Dappled Photography
study Dappled Photographystudy Dappled Photography
study Dappled Photography
 
Raskar COSI invited talk Oct 2009
Raskar COSI invited talk Oct 2009Raskar COSI invited talk Oct 2009
Raskar COSI invited talk Oct 2009
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
 
Goddard 2015: Mark Clampin, NASA
Goddard 2015: Mark Clampin, NASAGoddard 2015: Mark Clampin, NASA
Goddard 2015: Mark Clampin, NASA
 
Night vision technology by shudhanshu agarwal
Night vision technology by shudhanshu agarwalNight vision technology by shudhanshu agarwal
Night vision technology by shudhanshu agarwal
 
U tokyo 2019
U tokyo 2019U tokyo 2019
U tokyo 2019
 
ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21
ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21
ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21
 
Night vision technology
Night vision technologyNight vision technology
Night vision technology
 
637125main strekalov presentation
637125main strekalov presentation637125main strekalov presentation
637125main strekalov presentation
 
Night vision
Night visionNight vision
Night vision
 
Optical Instruments.ppt
Optical Instruments.pptOptical Instruments.ppt
Optical Instruments.ppt
 
UC Berkeley 4.19
UC Berkeley 4.19UC Berkeley 4.19
UC Berkeley 4.19
 
Mit Museum Talk
Mit Museum TalkMit Museum Talk
Mit Museum Talk
 
Measurement of corneal curvature
Measurement of corneal curvatureMeasurement of corneal curvature
Measurement of corneal curvature
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light FieldsSIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
 
CR (Computed Radiography) System
CR (Computed Radiography) SystemCR (Computed Radiography) System
CR (Computed Radiography) System
 
Svr Raskar
Svr RaskarSvr Raskar
Svr Raskar
 
Types of scanners
Types of scannersTypes of scanners
Types of scanners
 
Tv transmitters & receiver
Tv transmitters & receiverTv transmitters & receiver
Tv transmitters & receiver
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Recently uploaded (20)

Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 

Incident light field 1

  • 1. Incident Light Field The distribution of light in a static scene with a fixed illumination Dr. Kurt Debattista Prof. Alan Chalmers Debmalya Sinha
  • 2. Courtesy: J. Unger / Linköping University Synthetic objects on a physical table with real life lighting
  • 3. Acquisition Dynamic or Static Large Camera Array, Mirror sphere, Plane Mirror, HDR video, SfM (structure from motion) Physical Scene Representation 2PP PDP 2SP DPP Rendering Storage Virtual Scene
  • 4. 1. Image Based Lighting 2. Light Field Incident Light Field We require an Environment Map A Panoramic image of the environment that envelops the object space we’re about to Render.
  • 5. 1. Image Based Lighting 2. Light Field Incident Light Field Courtesy: nVidia
  • 6. 1. Image Based Lighting 2. Light Field Incident Light Field We take several pictures from spatially varying points on the camera plane. Each of the pictures differ a little by angle Courtesy: Pat Hanrahan / Stanford University
  • 7. 1. Image Based Lighting 2. Light Field Incident Light Field
  • 8. 1. Image Based Lighting 2. Light Field Incident Light Field
  • 9. 1. Image Based Lighting 2. Light Field Incident Light Field The distribution of light in a static scene with a fixed illumination We take separate environment map of each little segments of the space to record the incident light rays on the entire object space we are about to render.
  • 10. Courtesy: J. Unger / Linköping University
  • 11. Acquisition Dynamic or Static Large Camera Array, Mirror sphere, Plane Mirror, HDR video, SfM (structure from motion) Physical Scene Representation 2PP PDP 2SP DPP Rendering Storage Virtual Scene
  • 12. Representation Represented by 7 dimension Plenoptic function on a point P θ,φ -> direction of light ray from P, λ -> wavelength of incident light, t -> time Vx,Vy,Vz -> Cartesian coordinate of P. P = P(θ,φ,λ,t,Vx,Vy,Vz) Which can be reduced to a 4D function P = P(θ,φ,u,v) Assuming, the incident light only comes from the upper hemisphere of the surface [Vx,Vy] ([u,v]). 0 ≤ φ ≤ π/2 and -π ≤ θ ≤ π Plenoptic parameterization Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene
  • 13. Representation Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene 2PP PDP 2SP DPP Line Space parameterization Two Points on Two Planes A Point and a Direction Two Points on a Sphere A Direction and a Point 2PP 2SP PDP DPP Courtesy: Camahort et al.
  • 14. Acquisition Dynamic or Static Large Camera Array, Mirror sphere, Plane Mirror, HDR video, SfM (structure from motion) Physical Scene Representation 2PP PDP 2SP DPP Rendering Storage Virtual Scene
  • 15. Acquisition Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene Light Probes A Light Probe is an omni-directional (360° panoramic) high-dynamic range image. (Debevec et al.) • Typically a highly reflective silvered ball is used. • An HDR Image is taken of the ball. Problems: • The image has the reflection of the camera itself. • Has to take two images from different direction to get rid of the reflection of camera. • The edges are stretched badly and needs efficient warping.
  • 16. Acquisition Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene Light Probes for ILF Techniques • Single HDR image of Light probe • HDR video of a moving Light Probe • HDR video from fisheye lens • Light Probe Array • Plain Mirror (edge coded) Edge coded plain mirror - Courtesy: Ihrke et al. / INRIA Labs Mirror Sphere array - Courtesy: Dr. J. Unger HDR video with fisheye lens - Courtesy: Dr. J. Unger
  • 17. Acquisition Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene Light Probes for ILF Problems of mirror sphere array • Reflection from other Mirrors • Camera reflection Problems of HDR Video setup • Impractical for big space
  • 18. AcquisitionProposals 1. Bowls are better than Balls: Concave light probes to eliminate mutual reflection 2. 3D space coverage: 45* angle concave probe plane to capture uneven surface such as race tracks Far fetched idea: probe fitted in a Quadraptor! Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene Blocked for obvious reasons !
  • 19. AcquisitionProposals 1. Bowls are better than Balls: Concave light probes to eliminate mutual reflection 2. 3D space coverage: 45* angle concave probe plane to capture uneven surface such as race tracks Far fetched idea: probe fitted in a Quadraptor! Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene 1 2 3 4 5 6 7 Move Direction Blocked for obvious reasons !
  • 20. AcquisitionProposals 1. Bowls are better than Balls: Concave light probes to eliminate mutual reflection 2. 3D space coverage: 45* angle concave probe plane to capture uneven surface such as race tracks Far fetched idea: probe with a gimbal fitted in a Quadraptor! Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene Little inefficient for covering large space provides much more mobility than a fixed camera setup Blocked for obvious reasons !
  • 21. Acquisition Physical Scene Representation Rendering Storage Virtual Scene ToDoin the next months • Re-creating the ILF acquisition with spherical probe. • Implementing it into PARC • Comparing to original results in terms of Rendering Artifacts • Seam • Hair • Pixelation • Ghosting • Disparity problem