SlideShare une entreprise Scribd logo
1  sur  22
ACM NOSSDAV – June 2019
Bandwidth Prediction in Low-Latency Chunked Streaming
Abdelhak Bentaleb, Christian Timmerer, Ali C. Begen, and Roger Zimmermann
• Video encoding pipeline
• Ingest and packaging operations
• Network propagation
• Server I/O, CDN buffering
• Media segment duration
• Player behavior
– Buffering
– Playhead positioning
– Resilience
Contributors to the Latency
2ACM NOSSDAV 2019
3
Low Latency is Always a Trade-Off against Playback Robustness
Stream Start Time ≠ Latency
Time
Live encoder
producing 2-second
segments
iOS (3 segments)
Last fully available
segment
Lowest latency
1 2 3 4
Start Now
2 3 4
4
5
Latency: 7 s
Latency: 3 s
Latency: 2 s
6 seconds of buffer
~0 seconds of startup*
2 seconds of buffer
~0 seconds of startup*
2 seconds of buffer
1 second of startup*
* Segment fetching time is assumed to be negligible in this example
5
ACM NOSSDAV 2019
CMAF Chunks are One or More Frames
Refresher on CMAF
RAP …
RAP
…
RAP
…
RAP
…
Fragment Fragment Fragment Fragment
Segment Segment
Track File
…
…
…
Encoding
Packaging
Encryption
CMAF
Header
Seamless switching can only happen
at fragment boundaries
4ACM NOSSDAV 2019
Live Twitch Data* (Nov. 2018)
Bandwidth Measurement is Tricky
0
1
2
3
4
5
0 100 200 300 400 500 600
Bitrate(Mbps)
Time (s)
tc Bandwdith Measured Bandwidth Selected Bitrate
* Encoded at {0.18, 0.73, 1.83, 2.5, 3.1, 8.8} Mbps with three resolutions of {540p, 720p, 1080p}, and packaged with CMAF
ACM NOSSDAV 2019 5
No upshifting despite
the available bandwidth
ABR for Chunked Transfer Encoding (ACTE)
Bandwidth
Measurement
• Sliding
window based
moving average
method
Bandwidth
Prediction
• Online
linear adaptive
filter based RLS
algorithm
ABR
Controller
• Throughp
ut-based bitrate
selection logic
ACM NOSSDAV 2019 7
ACM NOSSDAV 2019 8
New/Modified Blocks in dash.js (in Red)
ABR Controller
Throughput-based
Buffer-based
Hybrid
ABR
Decision
Bandwidth Measurement
Bandwidth Prediction
Buffer
Display
Segment RequestsResponses (in chunks)
Logger
Sliding Window
Filter Taps
Update
C(i)
W(i)
𝜖(i)
Ĉi+1
Ci
+Ĉi -
Identifying the “Good” Chunks
ACM NOSSDAV 2019 9
Bandwidth Measurement
• Compute the download rate for the chunks where the transmission is network limited
– If there is a negligible idle period after a chunk download, use that chunk, otherwise disregard it
Media
timeline
Chunk4
Size:Q4
Chunk5
Size:Q5
Chunk6
Size:Q6
Chunk7
Size:Q7
b4e4e5 b5e6 b6
e7 b7
……
Chunk download
beginning time (unknown)
Chunk download
end time
Chunk download end time is
known from HTTP Fetch API
Chunk size is determined
from the received data
Identifying the “Good” Chunks without the bn Values
ACM NOSSDAV 2019 10
Bandwidth Measurement
• Reasonable assumption: Idle periods cannot happen within a chunk, happen only
between the chunks
– Since the server pushes the chunks at full network speed
• For each chunk, compute its download rate, which equals its size divided by this
chunk’s end time minus previous chunk’s end time
– If this download rate is close (+/- 20%) to the average segment download rate, there must be
significant idle time between these two chunks
• Transmission is source limited
• Disregard the current chunk
– Else, the idle time is negligible
• Transmission is network limited
• The current chunk’s download rate is a good approximation of the available bandwidth
• Use a sliding window based moving average method over the last three successful
chunk downloads
Online Linear Adaptive Filter Using Recursive Least Squares (RLS)
ACM NOSSDAV 2019 11
(Future) Bandwidth Prediction
Bandwidth prediction for
the next step
Measured
bw
Measured
bw
Measured
bw
Throughput-Based Bitrate Selection Logic
ACM NOSSDAV 2019 12
ABR Controller
• Find the best bitrate to pick to
– Minimize the estimated error
– Maximize QoE
• While respecting
– Target latency
– Network capacity
– Buffer occupancy level
Experimental Setup
ACM NOSSDAV 2019 13
Setup for Performance Evaluation
• Two machines, one running the modified dash.js player, one acting as a bandwidth
shaping proxy
– tc-NetEm to shape the network capacity according to DASH-IF’s bandwidth variation profiles
– iPerf to generate random TCP-based cross traffic ranging from 0.5 to 2 Mbps
• Origin and edge servers from Cloudflare with CMAF packaging and delivery enabled
• Content and Player Settings
– Tears of Steel: https://mango.blender.org/download/
– Segments of six seconds, chunks of 0.5 second
– Video bitrate levels of {0.7, 1.3 and 2.0} Mbps
– Min and max (target latency) buffer thresholds of 0.5 and 3.2 seconds, respectively
Schemes Implemented
ACM NOSSDAV 2019 14
Setup for Performance Evaluation
Bandwidth
Measurement
ABR Schemes
Throughput-based Buffer-based Hybrid
SLBW THsl - -
EWMA THew - -
SWMA THsw BOLAsw Dynamicsw
WSSL THwss - -
SLBW: Segment-based last bandwidth
EWMA: Chunk-based exponentially weighted moving average
SWMA: Chunk-based sliding window moving average
WSSL: Will’s simple slide-load
15
Performance Metrics
• Live latency
– dash.js’ live latency function (not including the encoding time)
• QoE models:
– Yin QoE
– ITU-T Rec. P.1203 QoE (Mode 0): bitrate, stall duration, frame rate, and resolution.
• Bandwidth prediction accuracy
– Root Mean Square Error (RMSE) to compute the differences between the measured and
predicted bandwidth values
ACM NOSSDAV 2019
Average Bitrate Bitrate Switches Stall Duration Startup Delay
28.6% Improvement by ACTE over Other Schemes
ACM NOSSDAV 2019 16
Average Selected Bitrate
0
0.5
1
1.5
2
2.5
ACTE THsl THew THsw THwss BOLAsw Dynamic-sw
AverageBitrate(Mbps)
96.6% Prediction Accuracy by ACTE
ACM NOSSDAV 2019 17
Average Measured Bandwidth
0
1
2
3
4
ACTE THsl THew THsw THwss BOLAsw Dynamic-sw Profiles-Avg
AverageMeasuredBandwidth
(Mbps)
36.2% Improvement by ACTE over Other Schemes
ACM NOSSDAV 2019 18
Average Live Latency
0
1
2
3
4
5
6
ACTE THsl THew THsw THwss BOLAsw Dynamic-sw
AverageLatency(s)
49.3% Improvement by ACTE over Other Schemes
ACM NOSSDAV 2019 19
Average Normalized QoE
0
0.2
0.4
0.6
0.8
1
ACTE THsl THew THsw THwss BOLAsw Dynamic-sw
AverageNormalizedQoE
Yin Model P.1203
ACM NOSSDAV 2019 20
Overall Results
Avg. Buffer
Occupancy
Avg. # of
Switches
Avg. # of Stalls
and Duration (s)
Avg. Startup
Delay (s)
ACTE 2.1 to 3.0 (2.5) 17 3 & 0.76 0.71
THsl 3.6 to 5.0 (4.3) 0 2 & 0.86 1.46
THew 1.9 to 3.9 (2.9) 18 21 & 66 1.06
THsw 1.9 to 3.5 (2.8) 24 27 & 33 1.03
THwss 2.0 to 3.1 (2.5) 23 16 & 9 0.88
BOLAsw 1.6 to 3.0 (2.3) 20 58 & 119 1.66
Dynamicsw 1.6 to 3.0 (2.4) 30 53 & 68 0.92
ACM NOSSDAV 2019 21
ACTE Outperforms the Existing ABR Schemes
• Consecutive numbers represent the results
– Summary of the average results. Percentage improvements of ACTE’s over the other scheme
Questions?
Thanks

Contenu connexe

Tendances (7)

Micro channel architecture
Micro channel architectureMicro channel architecture
Micro channel architecture
 
Video Streaming
Video StreamingVideo Streaming
Video Streaming
 
Adaptive Media Streaming: The Role of Standards
Adaptive Media Streaming: The Role of StandardsAdaptive Media Streaming: The Role of Standards
Adaptive Media Streaming: The Role of Standards
 
Hybrid Memory Cube: Developing Scalable and Resilient Memory Systems
Hybrid Memory Cube: Developing Scalable and Resilient Memory SystemsHybrid Memory Cube: Developing Scalable and Resilient Memory Systems
Hybrid Memory Cube: Developing Scalable and Resilient Memory Systems
 
Video Streaming - 4.ppt
Video Streaming - 4.pptVideo Streaming - 4.ppt
Video Streaming - 4.ppt
 
Multimedia Application Development
Multimedia Application DevelopmentMultimedia Application Development
Multimedia Application Development
 
El epm01 en
El epm01 enEl epm01 en
El epm01 en
 

Similaire à Bandwidth Prediction in Low-Latency Chunked Streaming

ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERSROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
Deepak Shankar
 
Insights on the Performance and Configuration of AVB and TSN in Automotive Ap...
Insights on the Performance and Configuration of AVB and TSN in Automotive Ap...Insights on the Performance and Configuration of AVB and TSN in Automotive Ap...
Insights on the Performance and Configuration of AVB and TSN in Automotive Ap...
RealTime-at-Work (RTaW)
 
LLL-CAdViSE: Live Low-Latency Cloud-based Adaptive Video Streaming Evaluation...
LLL-CAdViSE: Live Low-Latency Cloud-based Adaptive Video Streaming Evaluation...LLL-CAdViSE: Live Low-Latency Cloud-based Adaptive Video Streaming Evaluation...
LLL-CAdViSE: Live Low-Latency Cloud-based Adaptive Video Streaming Evaluation...
Alpen-Adria-Universität
 
口試投影片(詹智傑) Final
口試投影片(詹智傑) Final口試投影片(詹智傑) Final
口試投影片(詹智傑) Final
詹智傑
 
ES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video Streaming
ES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video StreamingES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video Streaming
ES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video Streaming
Alpen-Adria-Universität
 
On the feasibility of 40 Gbps network data capture and retention with general...
On the feasibility of 40 Gbps network data capture and retention with general...On the feasibility of 40 Gbps network data capture and retention with general...
On the feasibility of 40 Gbps network data capture and retention with general...
Jorge E. López de Vergara Méndez
 
A Two-Tiered On-Line Server-Side Bandwidth Reservation Framework for the Real...
A Two-Tiered On-Line Server-Side Bandwidth Reservation Framework for the Real...A Two-Tiered On-Line Server-Side Bandwidth Reservation Framework for the Real...
A Two-Tiered On-Line Server-Side Bandwidth Reservation Framework for the Real...
white paper
 
Audio video ethernet (avb cobra net dante)
Audio video ethernet (avb cobra net dante)Audio video ethernet (avb cobra net dante)
Audio video ethernet (avb cobra net dante)
Jeff Green
 

Similaire à Bandwidth Prediction in Low-Latency Chunked Streaming (20)

Automotive network and gateway simulation
Automotive network and gateway simulationAutomotive network and gateway simulation
Automotive network and gateway simulation
 
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERSROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
 
Insights on the Performance and Configuration of AVB and TSN in Automotive Ap...
Insights on the Performance and Configuration of AVB and TSN in Automotive Ap...Insights on the Performance and Configuration of AVB and TSN in Automotive Ap...
Insights on the Performance and Configuration of AVB and TSN in Automotive Ap...
 
Globecom 2015: Adaptive Raptor Carousel for 802.11
Globecom 2015: Adaptive Raptor Carousel for 802.11Globecom 2015: Adaptive Raptor Carousel for 802.11
Globecom 2015: Adaptive Raptor Carousel for 802.11
 
LLL-CAdViSE: Live Low-Latency Cloud-based Adaptive Video Streaming Evaluation...
LLL-CAdViSE: Live Low-Latency Cloud-based Adaptive Video Streaming Evaluation...LLL-CAdViSE: Live Low-Latency Cloud-based Adaptive Video Streaming Evaluation...
LLL-CAdViSE: Live Low-Latency Cloud-based Adaptive Video Streaming Evaluation...
 
口試投影片(詹智傑) Final
口試投影片(詹智傑) Final口試投影片(詹智傑) Final
口試投影片(詹智傑) Final
 
ES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video Streaming
ES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video StreamingES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video Streaming
ES-HAS: An Edge- and SDN-Assisted Framework for HTTP Adaptive Video Streaming
 
Server-based and Network-assisted Solutions for Adaptive Video Streaming
Server-based and Network-assisted Solutions for Adaptive Video StreamingServer-based and Network-assisted Solutions for Adaptive Video Streaming
Server-based and Network-assisted Solutions for Adaptive Video Streaming
 
chap2.ppt
chap2.pptchap2.ppt
chap2.ppt
 
ACM NOSSDAV'21-ES-HAS_ An Edge- and SDN-Assisted Framework for HTTP Adaptive ...
ACM NOSSDAV'21-ES-HAS_ An Edge- and SDN-Assisted Framework for HTTP Adaptive ...ACM NOSSDAV'21-ES-HAS_ An Edge- and SDN-Assisted Framework for HTTP Adaptive ...
ACM NOSSDAV'21-ES-HAS_ An Edge- and SDN-Assisted Framework for HTTP Adaptive ...
 
VMworld 2013: PCoIP: Sizing For Success
VMworld 2013: PCoIP: Sizing For SuccessVMworld 2013: PCoIP: Sizing For Success
VMworld 2013: PCoIP: Sizing For Success
 
Lec 2.pptx
Lec 2.pptxLec 2.pptx
Lec 2.pptx
 
On the feasibility of 40 Gbps network data capture and retention with general...
On the feasibility of 40 Gbps network data capture and retention with general...On the feasibility of 40 Gbps network data capture and retention with general...
On the feasibility of 40 Gbps network data capture and retention with general...
 
Bitmovin Low Latency CMAF Presentation_Streaming Media East by Paul MacDougall
Bitmovin Low Latency CMAF Presentation_Streaming Media East by Paul MacDougallBitmovin Low Latency CMAF Presentation_Streaming Media East by Paul MacDougall
Bitmovin Low Latency CMAF Presentation_Streaming Media East by Paul MacDougall
 
A Two-Tiered On-Line Server-Side Bandwidth Reservation Framework for the Real...
A Two-Tiered On-Line Server-Side Bandwidth Reservation Framework for the Real...A Two-Tiered On-Line Server-Side Bandwidth Reservation Framework for the Real...
A Two-Tiered On-Line Server-Side Bandwidth Reservation Framework for the Real...
 
Early-stage topological and technological choices for TSN-based communication...
Early-stage topological and technological choices for TSN-based communication...Early-stage topological and technological choices for TSN-based communication...
Early-stage topological and technological choices for TSN-based communication...
 
Dataplane networking acceleration with OpenDataplane / Максим Уваров (Linaro)
Dataplane networking acceleration with OpenDataplane / Максим Уваров (Linaro)Dataplane networking acceleration with OpenDataplane / Максим Уваров (Linaro)
Dataplane networking acceleration with OpenDataplane / Максим Уваров (Linaro)
 
CPN302 your-linux-ami-optimization-and-performance
CPN302 your-linux-ami-optimization-and-performanceCPN302 your-linux-ami-optimization-and-performance
CPN302 your-linux-ami-optimization-and-performance
 
Audio video ethernet (avb cobra net dante)
Audio video ethernet (avb cobra net dante)Audio video ethernet (avb cobra net dante)
Audio video ethernet (avb cobra net dante)
 
CDMA BSC 6600
CDMA BSC 6600CDMA BSC 6600
CDMA BSC 6600
 

Plus de Alpen-Adria-Universität

Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
Alpen-Adria-Universität
 
Content-adaptive Video Coding for HTTP Adaptive Streaming
Content-adaptive Video Coding for HTTP Adaptive StreamingContent-adaptive Video Coding for HTTP Adaptive Streaming
Content-adaptive Video Coding for HTTP Adaptive Streaming
Alpen-Adria-Universität
 
Evaluation of Quality of Experience of ABR Schemes in Gaming Stream
Evaluation of Quality of Experience of ABR Schemes in Gaming StreamEvaluation of Quality of Experience of ABR Schemes in Gaming Stream
Evaluation of Quality of Experience of ABR Schemes in Gaming Stream
Alpen-Adria-Universität
 
Policy-Driven Dynamic HTTP Adaptive Streaming Player Environment
Policy-Driven Dynamic HTTP Adaptive Streaming Player EnvironmentPolicy-Driven Dynamic HTTP Adaptive Streaming Player Environment
Policy-Driven Dynamic HTTP Adaptive Streaming Player Environment
Alpen-Adria-Universität
 
Energy Consumption in Video Streaming: Components, Measurements, and Strategies
Energy Consumption in Video Streaming: Components, Measurements, and StrategiesEnergy Consumption in Video Streaming: Components, Measurements, and Strategies
Energy Consumption in Video Streaming: Components, Measurements, and Strategies
Alpen-Adria-Universität
 
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
Alpen-Adria-Universität
 
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming ApplicationsSARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
Alpen-Adria-Universität
 

Plus de Alpen-Adria-Universität (20)

VEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instances
VEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instancesVEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instances
VEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instances
 
GREEM: An Open-Source Energy Measurement Tool for Video Processing
GREEM: An Open-Source Energy Measurement Tool for Video ProcessingGREEM: An Open-Source Energy Measurement Tool for Video Processing
GREEM: An Open-Source Energy Measurement Tool for Video Processing
 
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...
 
VEEP: Video Encoding Energy and CO₂ Emission Prediction
VEEP: Video Encoding Energy and CO₂ Emission PredictionVEEP: Video Encoding Energy and CO₂ Emission Prediction
VEEP: Video Encoding Energy and CO₂ Emission Prediction
 
Content-adaptive Video Coding for HTTP Adaptive Streaming
Content-adaptive Video Coding for HTTP Adaptive StreamingContent-adaptive Video Coding for HTTP Adaptive Streaming
Content-adaptive Video Coding for HTTP Adaptive Streaming
 
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...
 
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Vid...
Empowerment of Atypical Viewers  via Low-Effort Personalized Modeling  of Vid...Empowerment of Atypical Viewers  via Low-Effort Personalized Modeling  of Vid...
Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Vid...
 
Optimizing Video Streaming for Sustainability and Quality: The Role of Prese...
Optimizing Video Streaming  for Sustainability and Quality: The Role of Prese...Optimizing Video Streaming  for Sustainability and Quality: The Role of Prese...
Optimizing Video Streaming for Sustainability and Quality: The Role of Prese...
 
Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...
Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...
Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...
 
Machine Learning Based Resource Utilization Prediction in the Computing Conti...
Machine Learning Based Resource Utilization Prediction in the Computing Conti...Machine Learning Based Resource Utilization Prediction in the Computing Conti...
Machine Learning Based Resource Utilization Prediction in the Computing Conti...
 
Evaluation of Quality of Experience of ABR Schemes in Gaming Stream
Evaluation of Quality of Experience of ABR Schemes in Gaming StreamEvaluation of Quality of Experience of ABR Schemes in Gaming Stream
Evaluation of Quality of Experience of ABR Schemes in Gaming Stream
 
Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, S...
Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, S...Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, S...
Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, S...
 
Multi-access Edge Computing for Adaptive Video Streaming
Multi-access Edge Computing for Adaptive Video StreamingMulti-access Edge Computing for Adaptive Video Streaming
Multi-access Edge Computing for Adaptive Video Streaming
 
Policy-Driven Dynamic HTTP Adaptive Streaming Player Environment
Policy-Driven Dynamic HTTP Adaptive Streaming Player EnvironmentPolicy-Driven Dynamic HTTP Adaptive Streaming Player Environment
Policy-Driven Dynamic HTTP Adaptive Streaming Player Environment
 
VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...
VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...
VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...
 
Energy Consumption in Video Streaming: Components, Measurements, and Strategies
Energy Consumption in Video Streaming: Components, Measurements, and StrategiesEnergy Consumption in Video Streaming: Components, Measurements, and Strategies
Energy Consumption in Video Streaming: Components, Measurements, and Strategies
 
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...
 
Video Coding Enhancements for HTTP Adaptive Streaming Using Machine Learning
Video Coding Enhancements for HTTP Adaptive Streaming Using Machine LearningVideo Coding Enhancements for HTTP Adaptive Streaming Using Machine Learning
Video Coding Enhancements for HTTP Adaptive Streaming Using Machine Learning
 
Optimizing QoE and Latency of Live Video Streaming Using Edge Computing a...
Optimizing  QoE and Latency of  Live Video Streaming Using  Edge Computing  a...Optimizing  QoE and Latency of  Live Video Streaming Using  Edge Computing  a...
Optimizing QoE and Latency of Live Video Streaming Using Edge Computing a...
 
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming ApplicationsSARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
SARENA: SFC-Enabled Architecture for Adaptive Video Streaming Applications
 

Dernier

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Dernier (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 

Bandwidth Prediction in Low-Latency Chunked Streaming

  • 1. ACM NOSSDAV – June 2019 Bandwidth Prediction in Low-Latency Chunked Streaming Abdelhak Bentaleb, Christian Timmerer, Ali C. Begen, and Roger Zimmermann
  • 2. • Video encoding pipeline • Ingest and packaging operations • Network propagation • Server I/O, CDN buffering • Media segment duration • Player behavior – Buffering – Playhead positioning – Resilience Contributors to the Latency 2ACM NOSSDAV 2019
  • 3. 3 Low Latency is Always a Trade-Off against Playback Robustness Stream Start Time ≠ Latency Time Live encoder producing 2-second segments iOS (3 segments) Last fully available segment Lowest latency 1 2 3 4 Start Now 2 3 4 4 5 Latency: 7 s Latency: 3 s Latency: 2 s 6 seconds of buffer ~0 seconds of startup* 2 seconds of buffer ~0 seconds of startup* 2 seconds of buffer 1 second of startup* * Segment fetching time is assumed to be negligible in this example 5 ACM NOSSDAV 2019
  • 4. CMAF Chunks are One or More Frames Refresher on CMAF RAP … RAP … RAP … RAP … Fragment Fragment Fragment Fragment Segment Segment Track File … … … Encoding Packaging Encryption CMAF Header Seamless switching can only happen at fragment boundaries 4ACM NOSSDAV 2019
  • 5. Live Twitch Data* (Nov. 2018) Bandwidth Measurement is Tricky 0 1 2 3 4 5 0 100 200 300 400 500 600 Bitrate(Mbps) Time (s) tc Bandwdith Measured Bandwidth Selected Bitrate * Encoded at {0.18, 0.73, 1.83, 2.5, 3.1, 8.8} Mbps with three resolutions of {540p, 720p, 1080p}, and packaged with CMAF ACM NOSSDAV 2019 5 No upshifting despite the available bandwidth
  • 6.
  • 7. ABR for Chunked Transfer Encoding (ACTE) Bandwidth Measurement • Sliding window based moving average method Bandwidth Prediction • Online linear adaptive filter based RLS algorithm ABR Controller • Throughp ut-based bitrate selection logic ACM NOSSDAV 2019 7
  • 8. ACM NOSSDAV 2019 8 New/Modified Blocks in dash.js (in Red) ABR Controller Throughput-based Buffer-based Hybrid ABR Decision Bandwidth Measurement Bandwidth Prediction Buffer Display Segment RequestsResponses (in chunks) Logger Sliding Window Filter Taps Update C(i) W(i) 𝜖(i) Ĉi+1 Ci +Ĉi -
  • 9. Identifying the “Good” Chunks ACM NOSSDAV 2019 9 Bandwidth Measurement • Compute the download rate for the chunks where the transmission is network limited – If there is a negligible idle period after a chunk download, use that chunk, otherwise disregard it Media timeline Chunk4 Size:Q4 Chunk5 Size:Q5 Chunk6 Size:Q6 Chunk7 Size:Q7 b4e4e5 b5e6 b6 e7 b7 …… Chunk download beginning time (unknown) Chunk download end time Chunk download end time is known from HTTP Fetch API Chunk size is determined from the received data
  • 10. Identifying the “Good” Chunks without the bn Values ACM NOSSDAV 2019 10 Bandwidth Measurement • Reasonable assumption: Idle periods cannot happen within a chunk, happen only between the chunks – Since the server pushes the chunks at full network speed • For each chunk, compute its download rate, which equals its size divided by this chunk’s end time minus previous chunk’s end time – If this download rate is close (+/- 20%) to the average segment download rate, there must be significant idle time between these two chunks • Transmission is source limited • Disregard the current chunk – Else, the idle time is negligible • Transmission is network limited • The current chunk’s download rate is a good approximation of the available bandwidth • Use a sliding window based moving average method over the last three successful chunk downloads
  • 11. Online Linear Adaptive Filter Using Recursive Least Squares (RLS) ACM NOSSDAV 2019 11 (Future) Bandwidth Prediction Bandwidth prediction for the next step Measured bw Measured bw Measured bw
  • 12. Throughput-Based Bitrate Selection Logic ACM NOSSDAV 2019 12 ABR Controller • Find the best bitrate to pick to – Minimize the estimated error – Maximize QoE • While respecting – Target latency – Network capacity – Buffer occupancy level
  • 13. Experimental Setup ACM NOSSDAV 2019 13 Setup for Performance Evaluation • Two machines, one running the modified dash.js player, one acting as a bandwidth shaping proxy – tc-NetEm to shape the network capacity according to DASH-IF’s bandwidth variation profiles – iPerf to generate random TCP-based cross traffic ranging from 0.5 to 2 Mbps • Origin and edge servers from Cloudflare with CMAF packaging and delivery enabled • Content and Player Settings – Tears of Steel: https://mango.blender.org/download/ – Segments of six seconds, chunks of 0.5 second – Video bitrate levels of {0.7, 1.3 and 2.0} Mbps – Min and max (target latency) buffer thresholds of 0.5 and 3.2 seconds, respectively
  • 14. Schemes Implemented ACM NOSSDAV 2019 14 Setup for Performance Evaluation Bandwidth Measurement ABR Schemes Throughput-based Buffer-based Hybrid SLBW THsl - - EWMA THew - - SWMA THsw BOLAsw Dynamicsw WSSL THwss - - SLBW: Segment-based last bandwidth EWMA: Chunk-based exponentially weighted moving average SWMA: Chunk-based sliding window moving average WSSL: Will’s simple slide-load
  • 15. 15 Performance Metrics • Live latency – dash.js’ live latency function (not including the encoding time) • QoE models: – Yin QoE – ITU-T Rec. P.1203 QoE (Mode 0): bitrate, stall duration, frame rate, and resolution. • Bandwidth prediction accuracy – Root Mean Square Error (RMSE) to compute the differences between the measured and predicted bandwidth values ACM NOSSDAV 2019 Average Bitrate Bitrate Switches Stall Duration Startup Delay
  • 16. 28.6% Improvement by ACTE over Other Schemes ACM NOSSDAV 2019 16 Average Selected Bitrate 0 0.5 1 1.5 2 2.5 ACTE THsl THew THsw THwss BOLAsw Dynamic-sw AverageBitrate(Mbps)
  • 17. 96.6% Prediction Accuracy by ACTE ACM NOSSDAV 2019 17 Average Measured Bandwidth 0 1 2 3 4 ACTE THsl THew THsw THwss BOLAsw Dynamic-sw Profiles-Avg AverageMeasuredBandwidth (Mbps)
  • 18. 36.2% Improvement by ACTE over Other Schemes ACM NOSSDAV 2019 18 Average Live Latency 0 1 2 3 4 5 6 ACTE THsl THew THsw THwss BOLAsw Dynamic-sw AverageLatency(s)
  • 19. 49.3% Improvement by ACTE over Other Schemes ACM NOSSDAV 2019 19 Average Normalized QoE 0 0.2 0.4 0.6 0.8 1 ACTE THsl THew THsw THwss BOLAsw Dynamic-sw AverageNormalizedQoE Yin Model P.1203
  • 20. ACM NOSSDAV 2019 20 Overall Results Avg. Buffer Occupancy Avg. # of Switches Avg. # of Stalls and Duration (s) Avg. Startup Delay (s) ACTE 2.1 to 3.0 (2.5) 17 3 & 0.76 0.71 THsl 3.6 to 5.0 (4.3) 0 2 & 0.86 1.46 THew 1.9 to 3.9 (2.9) 18 21 & 66 1.06 THsw 1.9 to 3.5 (2.8) 24 27 & 33 1.03 THwss 2.0 to 3.1 (2.5) 23 16 & 9 0.88 BOLAsw 1.6 to 3.0 (2.3) 20 58 & 119 1.66 Dynamicsw 1.6 to 3.0 (2.4) 30 53 & 68 0.92
  • 21. ACM NOSSDAV 2019 21 ACTE Outperforms the Existing ABR Schemes • Consecutive numbers represent the results – Summary of the average results. Percentage improvements of ACTE’s over the other scheme