1. User-Assisted Disparity Maps
Hsin-I Chen Yi-Shan Lin I-Chao Shen
National Taiwan University National Taiwan University Academia Sinica
Sheng-Jie Luo Wen-Huang Cheng Bing-Yu Chen
National Taiwan University Academia Sinica National Taiwan University
1

2. Motivation
Wang et al. 2008 Luo et al. 2012
Stereoscopic Inpainting Stereoscopic Copy & Paste
Price et al. 2011
StereoCut: Object Selection
Essential : Disparity Map !
2

3. Motivation
Middlebury dataset
3

4. Challenges
1 1
2 2
1. Texture-less area or repetitive patterns
2. Occlusion
4

5. Challenges
3 3
4 4
3. Reflection
4. Color discrepancy
5

6. Work Flow
Disparity
Generation
Disparity Map
Painting & Editing
Iterative
Refinement
6

7. User Interface
Original View Rotated View
User-selected Defective Regions Corrected Result
7

8. Idea
Local Matching Plane Extension Manual Matching
Ex
8

9. Correction by Local Matching
Segmented Regions
Sparse Feature Matching
9

10. Correction by Plane Extension
Reference Plane
10

11. Correction by Manual Matching
User-specified
Corresponding Points
11

12. Evaluation (I)
Good Pixel
Half-occluded Pixel
Bad Pixel
Input Stereo Image Pair
Corrected by
Local Matching
Mei et al. 2011 Corrected
12

13. Evaluation (II)
Good Pixel
Half-occluded Pixel
Bad Pixel
Input Stereo Image Pair
Corrected by
Plane Extension
Mei et al. 2011 Corrected
13

14. Evaluation (III)
Good Pixel
Half-occluded Pixel
Bad Pixel
Input Stereo Image Pair
Corrected by
Manual Matching
Mei et al. 2011 Corrected
14

15. Conclusion & Future Work
• Our framework can correct artifacts and noise
caused of the disparity map
• Interactive selection and instant visual
feedback in 3D view
• Develop more operations with different scene
condition -- Future Work
15

16. Q &A
Thank you for your listening
16