SlideShare une entreprise Scribd logo
1  sur  16
Adaptive Video Playback
Mohammed Sinky
Background

 Proposed concept falls under the general category of
  “Adaptive Media Playback or (AMP)”



            l




       2l


AMP:
                l ×s
                  /f
Historical Perspective

Adaptive Media Playout
        (AMP)                            Content Adaptive
                                                            Optimal frame
               VDoP [Laoutaris]                               selection




                         Laoutaris and
                                                                            Yet another AMP
                         buffer design
                                                                                algorithm
 Video Smoothing                                    First HD video
                                                        used for
                                                      evaluation
                               Motion based AMP
Video Smoother -1996

                                  Playout buffer (size N)


                Video frames                                 playout of frames

                                Threshold
                                   (TH)
                                                   Playout rate         Time
                                                    controller


 If number of frames in playout buffer exceeds
  TH, maximum playout rate (m) is employed.

 Otherwise smoother uses proportionally reduced rates to
  eliminate playout pauses due to empty buffer.
[1]   M. C. Yuang, S. T. Liang, Y. G. Chen, and C. L. Shen, “Dynamic video playout smoothing method for
multimedia applications,” in IEEE International Conference on Communications, 1996, vol. 3, pp. 1365–1369.
Video Smoother

 Metrics as TH increases (l: mean frame arrival rate)




 p0: probability of empty buffer   pL: frame loss probability
Video Smoother
Video Smoother

 hh
Adaptive Media Playout (AMP) - 2001

 Adaptive Media Playout: the adjustment of the playout
  speed of the media packets depending on the condition
  of the channel and the current client buffer fullness.

 Video playout based on channel conditions:
      Bad conditions: slow down playout, virtual increase in buffer
      Good conditions: following recovery of bad
       conditions, playout is done faster than normal



[2]   E. Steinbach, N. Farber, and B. Girod, “Adaptive playout for low latency video streaming,” in Image
Processing, 2001. Proceedings. 2001 International Conference on, 2001, vol. 1, pp. 962–965.
AMP

 Assumptions: Audio+Video frame fit into one packet

                                         Lost packets:
                                         retransmission requests are
                                         sent from client to server
                                         (application layer)
AMP

 Packet burst error and the arrival of retransmissions




 If a packet burst loss exceeds the maximum playout time,
  we get buffer underflow: freeze video
AMP

 Two main criteria for evaluation
   Probability of buffer underflow


                                      Average value of max burst length:



   Average end-to-end delay introduced by adaptive playout
AMP

 Metric: Mean Time Between Buffer Underflow (MTBBU)

                                        s: slowdown factor
                                                (s≥1)

                                        f: speed-up factor
                                               (f≤1)
Variance of Distortion of Playout
(VDoP) - 2001

 New metric to gage interruptions in video playback

 Extension of 1996 work done by Yuang which suffered
  from an undesirable fast forward effect




[3]  N. Laoutaris and I. Stavrakakis, “Adaptive playout strategies for packet video receivers with finite buffer
capacity,” in Communications, 2001. ICC 2001. IEEE International Conference on, 2001, vol. 3, pp. 969–973.
VDoP

 Some Results
Recent

 Take into consideration motion characteristics of frames

 Choosing specific frames (frame selection)

 Most work revolves around finding the optimum buffer
  size, threshold and corresponding frame rate adjustment
  in the context of AMP
 Many of the works consider the network to be a cloud
  (possibly internet, LAN, etc.)
   We consider specific home network, ad hoc, 802.11 based

 Most deal with frames as a whole, and don’t get into details
  of packetization
   We are relying on frames split across packets

 Assumptions are made on frame arrival rates
   In our scenario a more accurate estimation of frame arrival
    rates can be considered

 HD video is not considered
   Our work is centralized around HD video

Contenu connexe

Tendances

Technical comments research_sheet[1]
Technical comments research_sheet[1]Technical comments research_sheet[1]
Technical comments research_sheet[1]k_ishii_
 
Analog Digital Video
Analog Digital Video Analog Digital Video
Analog Digital Video Yoss Cohen
 
Analysis sheet ident
Analysis sheet identAnalysis sheet ident
Analysis sheet identJoe Hayes
 
Analysis sheet interactive menu
Analysis sheet interactive menuAnalysis sheet interactive menu
Analysis sheet interactive menuJoe Hayes
 
Chapter 6 : VIDEO
Chapter 6 : VIDEOChapter 6 : VIDEO
Chapter 6 : VIDEOazira96
 
Multimedia Building Blocks by Daniyal Khan
Multimedia Building Blocks by Daniyal KhanMultimedia Building Blocks by Daniyal Khan
Multimedia Building Blocks by Daniyal KhanDaniyal Khan
 
Motion graphics and_compositing_video_analysis_worksheet- interactive menu
Motion graphics and_compositing_video_analysis_worksheet- interactive menuMotion graphics and_compositing_video_analysis_worksheet- interactive menu
Motion graphics and_compositing_video_analysis_worksheet- interactive menuBethMelia
 
Op Sy 03 Ch 71
Op Sy 03 Ch 71Op Sy 03 Ch 71
Op Sy 03 Ch 71 Google
 
Anika IST Graphic Flashcards
Anika IST Graphic Flashcards Anika IST Graphic Flashcards
Anika IST Graphic Flashcards anika-24
 

Tendances (18)

Technical comments research_sheet[1]
Technical comments research_sheet[1]Technical comments research_sheet[1]
Technical comments research_sheet[1]
 
H261
H261H261
H261
 
Video Meets Documentation
Video Meets DocumentationVideo Meets Documentation
Video Meets Documentation
 
H263.ppt
H263.pptH263.ppt
H263.ppt
 
Analog Digital Video
Analog Digital Video Analog Digital Video
Analog Digital Video
 
Analysis sheet ident
Analysis sheet identAnalysis sheet ident
Analysis sheet ident
 
Analysis sheet interactive menu
Analysis sheet interactive menuAnalysis sheet interactive menu
Analysis sheet interactive menu
 
Chapter 6 : VIDEO
Chapter 6 : VIDEOChapter 6 : VIDEO
Chapter 6 : VIDEO
 
Multimedia:Multimedia compression
Multimedia:Multimedia compression Multimedia:Multimedia compression
Multimedia:Multimedia compression
 
Video
VideoVideo
Video
 
Technical ep
Technical epTechnical ep
Technical ep
 
Digital video
Digital videoDigital video
Digital video
 
Compression
CompressionCompression
Compression
 
Multimedia Building Blocks by Daniyal Khan
Multimedia Building Blocks by Daniyal KhanMultimedia Building Blocks by Daniyal Khan
Multimedia Building Blocks by Daniyal Khan
 
Motion graphics and_compositing_video_analysis_worksheet- interactive menu
Motion graphics and_compositing_video_analysis_worksheet- interactive menuMotion graphics and_compositing_video_analysis_worksheet- interactive menu
Motion graphics and_compositing_video_analysis_worksheet- interactive menu
 
Video
VideoVideo
Video
 
Op Sy 03 Ch 71
Op Sy 03 Ch 71Op Sy 03 Ch 71
Op Sy 03 Ch 71
 
Anika IST Graphic Flashcards
Anika IST Graphic Flashcards Anika IST Graphic Flashcards
Anika IST Graphic Flashcards
 

En vedette

En vedette (8)

ALEGRÍA SIN FRONTERAS - ALEGRÍA CON GAMBO
ALEGRÍA SIN FRONTERAS - ALEGRÍA CON GAMBOALEGRÍA SIN FRONTERAS - ALEGRÍA CON GAMBO
ALEGRÍA SIN FRONTERAS - ALEGRÍA CON GAMBO
 
Acari RN
Acari RNAcari RN
Acari RN
 
.Ujian BM PEMAHAMANtahun 4 KSSR 2015
.Ujian BM PEMAHAMANtahun 4 KSSR 2015.Ujian BM PEMAHAMANtahun 4 KSSR 2015
.Ujian BM PEMAHAMANtahun 4 KSSR 2015
 
безпечний інтернет1
безпечний інтернет1безпечний інтернет1
безпечний інтернет1
 
Evaluation for media 2013
Evaluation for media 2013Evaluation for media 2013
Evaluation for media 2013
 
Escalada
EscaladaEscalada
Escalada
 
"Безпечний Інтернет"
"Безпечний Інтернет" "Безпечний Інтернет"
"Безпечний Інтернет"
 
Actividades de lectoescritura
Actividades de lectoescrituraActividades de lectoescritura
Actividades de lectoescritura
 

Similaire à Adaptive video playback optimization for HD video over 802.11 networks

Preserving Audiovisual Materials (LIS 198-Digital Preservation)
Preserving Audiovisual Materials (LIS 198-Digital Preservation)Preserving Audiovisual Materials (LIS 198-Digital Preservation)
Preserving Audiovisual Materials (LIS 198-Digital Preservation)Roy Santos Necesario
 
simple video compression
simple video compression simple video compression
simple video compression LaLit DuBey
 
Encoding stored video for stremming applications ieee paper ppt
Encoding stored video for stremming applications ieee paper pptEncoding stored video for stremming applications ieee paper ppt
Encoding stored video for stremming applications ieee paper pptNavin Kumar
 
Mpeg4copy 120428133000-phpapp01
Mpeg4copy 120428133000-phpapp01Mpeg4copy 120428133000-phpapp01
Mpeg4copy 120428133000-phpapp01netzwelt12345
 
Chapter 07
Chapter 07Chapter 07
Chapter 07 Google
 
Introduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag JainIntroduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag JainVideoguy
 
[Nov./2010] Adaptive Video Streaming over Wireless LAN with ns-2
[Nov./2010] Adaptive Video Streaming over Wireless LAN with ns-2 [Nov./2010] Adaptive Video Streaming over Wireless LAN with ns-2
[Nov./2010] Adaptive Video Streaming over Wireless LAN with ns-2 Hayoung Yoon
 
Multimedia
MultimediaMultimedia
MultimediaBUDNET
 
Video Compression Basics - MPEG2
Video Compression Basics - MPEG2Video Compression Basics - MPEG2
Video Compression Basics - MPEG2VijayKumarArya
 
An Empirical Evaluation of VoIP Playout Buffer Dimensioning in Skype, Google ...
An Empirical Evaluation of VoIP Playout Buffer Dimensioning in Skype, Google ...An Empirical Evaluation of VoIP Playout Buffer Dimensioning in Skype, Google ...
An Empirical Evaluation of VoIP Playout Buffer Dimensioning in Skype, Google ...Academia Sinica
 
Applying Media Content Analysis to the Production of Musical Videos as Summar...
Applying Media Content Analysis to the Production of Musical Videos as Summar...Applying Media Content Analysis to the Production of Musical Videos as Summar...
Applying Media Content Analysis to the Production of Musical Videos as Summar...Chris Huang
 
Video compression
Video compressionVideo compression
Video compressionnnmaurya
 

Similaire à Adaptive video playback optimization for HD video over 802.11 networks (20)

Lecture 8 Video
Lecture 8 VideoLecture 8 Video
Lecture 8 Video
 
Preserving Audiovisual Materials (LIS 198-Digital Preservation)
Preserving Audiovisual Materials (LIS 198-Digital Preservation)Preserving Audiovisual Materials (LIS 198-Digital Preservation)
Preserving Audiovisual Materials (LIS 198-Digital Preservation)
 
simple video compression
simple video compression simple video compression
simple video compression
 
Encoding stored video for stremming applications ieee paper ppt
Encoding stored video for stremming applications ieee paper pptEncoding stored video for stremming applications ieee paper ppt
Encoding stored video for stremming applications ieee paper ppt
 
Video00.ppt
Video00.pptVideo00.ppt
Video00.ppt
 
Sound mm
Sound mmSound mm
Sound mm
 
Mpeg4copy 120428133000-phpapp01
Mpeg4copy 120428133000-phpapp01Mpeg4copy 120428133000-phpapp01
Mpeg4copy 120428133000-phpapp01
 
Chapter 07
Chapter 07Chapter 07
Chapter 07
 
Introduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag JainIntroduction to Video Compression Techniques - Anurag Jain
Introduction to Video Compression Techniques - Anurag Jain
 
[Nov./2010] Adaptive Video Streaming over Wireless LAN with ns-2
[Nov./2010] Adaptive Video Streaming over Wireless LAN with ns-2 [Nov./2010] Adaptive Video Streaming over Wireless LAN with ns-2
[Nov./2010] Adaptive Video Streaming over Wireless LAN with ns-2
 
Multimedia
MultimediaMultimedia
Multimedia
 
video comparison
video comparison video comparison
video comparison
 
85 videocompress
85 videocompress85 videocompress
85 videocompress
 
Video Compression Basics - MPEG2
Video Compression Basics - MPEG2Video Compression Basics - MPEG2
Video Compression Basics - MPEG2
 
An Empirical Evaluation of VoIP Playout Buffer Dimensioning in Skype, Google ...
An Empirical Evaluation of VoIP Playout Buffer Dimensioning in Skype, Google ...An Empirical Evaluation of VoIP Playout Buffer Dimensioning in Skype, Google ...
An Empirical Evaluation of VoIP Playout Buffer Dimensioning in Skype, Google ...
 
Ppt1140802001
Ppt1140802001Ppt1140802001
Ppt1140802001
 
MPEG4 vs H.264
MPEG4 vs H.264MPEG4 vs H.264
MPEG4 vs H.264
 
Applying Media Content Analysis to the Production of Musical Videos as Summar...
Applying Media Content Analysis to the Production of Musical Videos as Summar...Applying Media Content Analysis to the Production of Musical Videos as Summar...
Applying Media Content Analysis to the Production of Musical Videos as Summar...
 
Video compression
Video compressionVideo compression
Video compression
 
Chap62
Chap62Chap62
Chap62
 

Adaptive video playback optimization for HD video over 802.11 networks

  • 2. Background  Proposed concept falls under the general category of “Adaptive Media Playback or (AMP)” l 2l AMP: l ×s /f
  • 3. Historical Perspective Adaptive Media Playout (AMP) Content Adaptive Optimal frame VDoP [Laoutaris] selection Laoutaris and Yet another AMP buffer design algorithm Video Smoothing First HD video used for evaluation Motion based AMP
  • 4. Video Smoother -1996 Playout buffer (size N) Video frames playout of frames Threshold (TH) Playout rate Time controller  If number of frames in playout buffer exceeds TH, maximum playout rate (m) is employed.  Otherwise smoother uses proportionally reduced rates to eliminate playout pauses due to empty buffer. [1] M. C. Yuang, S. T. Liang, Y. G. Chen, and C. L. Shen, “Dynamic video playout smoothing method for multimedia applications,” in IEEE International Conference on Communications, 1996, vol. 3, pp. 1365–1369.
  • 5. Video Smoother  Metrics as TH increases (l: mean frame arrival rate) p0: probability of empty buffer pL: frame loss probability
  • 8. Adaptive Media Playout (AMP) - 2001  Adaptive Media Playout: the adjustment of the playout speed of the media packets depending on the condition of the channel and the current client buffer fullness.  Video playout based on channel conditions:  Bad conditions: slow down playout, virtual increase in buffer  Good conditions: following recovery of bad conditions, playout is done faster than normal [2] E. Steinbach, N. Farber, and B. Girod, “Adaptive playout for low latency video streaming,” in Image Processing, 2001. Proceedings. 2001 International Conference on, 2001, vol. 1, pp. 962–965.
  • 9. AMP  Assumptions: Audio+Video frame fit into one packet Lost packets: retransmission requests are sent from client to server (application layer)
  • 10. AMP  Packet burst error and the arrival of retransmissions  If a packet burst loss exceeds the maximum playout time, we get buffer underflow: freeze video
  • 11. AMP  Two main criteria for evaluation  Probability of buffer underflow Average value of max burst length:  Average end-to-end delay introduced by adaptive playout
  • 12. AMP  Metric: Mean Time Between Buffer Underflow (MTBBU) s: slowdown factor (s≥1) f: speed-up factor (f≤1)
  • 13. Variance of Distortion of Playout (VDoP) - 2001  New metric to gage interruptions in video playback  Extension of 1996 work done by Yuang which suffered from an undesirable fast forward effect [3] N. Laoutaris and I. Stavrakakis, “Adaptive playout strategies for packet video receivers with finite buffer capacity,” in Communications, 2001. ICC 2001. IEEE International Conference on, 2001, vol. 3, pp. 969–973.
  • 15. Recent  Take into consideration motion characteristics of frames  Choosing specific frames (frame selection)  Most work revolves around finding the optimum buffer size, threshold and corresponding frame rate adjustment in the context of AMP
  • 16.  Many of the works consider the network to be a cloud (possibly internet, LAN, etc.)  We consider specific home network, ad hoc, 802.11 based  Most deal with frames as a whole, and don’t get into details of packetization  We are relying on frames split across packets  Assumptions are made on frame arrival rates  In our scenario a more accurate estimation of frame arrival rates can be considered  HD video is not considered  Our work is centralized around HD video

Notes de l'éditeur

  1. Selection of TH is critical. Overestimation: playout rate declines giving bad playout performance. Underestimation: higher probability of having an empty buffer = playout discontinuityOptimal TH  trade off rise in probability of empty buffer against increase in playout rateQueue analysis is performed and the frame arrival processes is modeled by a Poisson process. This is to simulate random networking delays, etc.Authors solve for optimal probabilities of empty buffer and frame loss probability, which is the metric for this study. Seems to be either fast or slow!!!!
  2. Stanford University
  3. When target buffer size has been reached (similar to TH in previous work) playout begins
  4. For B_target from 50 to 200 packets in increments of 10. Higher MTBBU is good! Channel model is a two-state Markov (good or bad) . Packet loss probability is 0.05No video is used…. Everything is based on packet assumptions
  5. Again Poisson arrival process of frames (they admit the poor choice of modelling the frame arrival rate)Makes use of variance of discontinuity (VoD)
  6. MPR: Mean Playout RateSmall TH allows buffer overflow to take place thus losing frames