Evaluation of bandwidth performance for interactive spherical video

Evaluation of Bandwidth Performance for Interactive Spherical Video Patrice Rondao Alface, Jean-François Macq, Nico Verzijp Bell Labs, Alcatel-Lucent ICME’s WoMAN’11, Barcelona, July 2011

Acknowledgment FP7 FascinatE project

AGENDA ,[object Object],[object Object],[object Object],[object Object],[object Object]

Introduction Interactive Spherical Video ,[object Object],[object Object],[object Object],Heymann et al., “Representation, Coding & Interactive Rendering of High-Resolution Panoramic Images and Video using MPEG-4”, in Proc. Panoramic Photogrammetry Workshop (PPW) , Berlin, Germany, Feb. 2005.

Introduction Interactive Spherical Video - Applications ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Image source: www.immersivemedia.com

Interactive Spherical Video Transmission State of the Art ,[object Object],[object Object],[object Object],[object Object],A. Smolic et al.,”Efficient Representation & Coding of Omni-directional Video using MPEG-4”, Proc. WIAMIS 2003, 4th European Workshop on Image Analysis for Multimedia Interactive Services, London, UK, April 9.-11. 2003.

Interactive Spherical Video Transmission ,[object Object],[object Object],[object Object],[object Object],[object Object],A. Mavlankar, B. Girod, Background extraction and long-term memory motion-compensated prediction for spatial-random-access-enabled video coding, Picture Coding Symposium 2009, pp.1-4, 6-8 May 2009

Interactive Spherical Video Transmission Spherical Video Random Access ,[object Object],[object Object],[object Object]

Interactive Spherical Video Transmission Tiling ,[object Object],[object Object],[object Object],[object Object],Whole panorama Visible tiles only (RoI) Possible impairment (interaction delay)

Transmission Optimization Tile-Based Quality Adaptation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Transmission Optimization Proposed probability-based approach ,[object Object],[object Object],Tile marginal utility Tile at position i, quality q Tile bitrate Tile MSE Tile marginal cost Tile inserted at quality ≥ q Probability of tile visibility ,

Transmission Optimization Proposed probability-based approach ,[object Object]

Transmission Optimization Proposed probabilistic Model of the Tile Visibility ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Results (case 1: no delay) Tiling: client viewport quality vs. bandwidth

Transmission Optimization Probabilistic Model of the Tile Visibility ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Low delay: 40ms Quality is higher close to the estimated viewport High delay: 1280ms Low probability for any viewport position; quality tends to be constant on the whole panorama 15dB better than constant bitrate 7dB better than constant bitrate Results (case 2: user interaction delay) 75kB for 4Kx2K panorama

Results (case 2: user interaction delay) PSNR vs. Delay for a fixed bandwidth 75KBs

Results (case 2: user interaction delay) Discrepancy at the client side - delay of 1280ms

Conclusions ,[object Object],[object Object],[object Object],[object Object]

http://belllabs.be/internships

Transmission Optimization Experimental Setting ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Interactive Spherical Video Transmission State of the Art ,[object Object],Chi-Wing Fu et al., "The Rhombic Dodecahedron Map: An Efficient Scheme for Encoding Panoramic Video," Multimedia, IEEE Transactions on , vol.11, no.4, pp.634-644, June 2009

Interactive Spherical Video Transmission 2D Random Access ,[object Object],[object Object],[object Object],Content-based Arbitrary

Results (case 2: user interaction delay) Temporal analysis

Results (case 2: user interaction delay) Delay 1280ms Delay 40ms

Evaluation of bandwidth performance for interactive spherical video

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

Similaire à Evaluation of bandwidth performance for interactive spherical video

Similaire à Evaluation of bandwidth performance for interactive spherical video (20)

Plus de Alpen-Adria-Universität

Plus de Alpen-Adria-Universität (20)

Dernier

Dernier (20)

Evaluation of bandwidth performance for interactive spherical video