SlideShare une entreprise Scribd logo
1  sur  21
Télécharger pour lire hors ligne
.

.

P2P Streaming Basics (1)
…
Share

Content
Provider
(origin)

P2P Network
01 R.Buyya+3 -M.Zhanikeev -- maratishe@gmail.com "Content Delivery Networks" Springer LNEE, vol.9 (2008) Substream Design -- http://tinyurl.com/kyutech131114 --Social Utility of P2P Streaming with VBR

2 /18
2/18
.

.

P2P Streaming Basics (2)
not a tree

• P2P delivery network is
02
◦ officially: multiple complimentary trees
• each peer is normally at most

Scale

Traffic
flow

3-4 hops

away from the content server 05

realtime 03

• P2P streaming is always
◦ other content can be converted
realtime via scheduled sessions

to

…
…
…
…

02 myself+0 "...Extremely Scalable and Low Demand ... P2P Streaming ...Variable Bitrate" CANDAR (2013)
03 myself+0 "Multi-Source Stream Aggegation in the Cloud" Wiley Book on Advanced Content Delivery ... Clouds (2013)
05 P.Baccichet+3 "Low-delay Peer-to-Peer Streaming using Scalable Video Coding" Packet Video (2007)
M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

3 /18
3/18
.

.

P2P Streaming: Push vs Pull
• a well known argument 03 10
Client

Server

Client

Server

Pull

many remote peers
Push

……

pull: +RTT for every piece
• pull: high throughput requires many
•

•

push: connect once, use for a
long time

……

03 myself+0 "Multi-Source Stream Aggegation in the Cloud" Wiley Book on Advanced Content Delivery ... Clouds (2013)
10 Z.Li+4 "Towards Low-Redundancy Push-Pull P2P Live Streaming" QShine (2008)
M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

4 /18
4/18
.

.

Push/Pull = BitTorrent/Substream
pull = BitTorrent, many existing methods 11
• push = substream method
•

◦ many services like Coolstreaming 07, Afreeca 08,
◦ also referred to as sliced or layered streaming

Uusee 09, etc...

11 C.Stais+1 "Realistic Media Streaming over BitTorrent" Future Network and Mobile Summit (2012)
07 B.Li+5 "Inside the New Coolstreaming: Principles, Measurements and Performance Implications" IEEE INFOCOM (2008)
08 K.Park+4 "An Analysis of User Dynamics in P2P Live Streaming Services" ICC (2010)
09 C.Wu+2 "Diagnosing Network-wide P2P Live Streaming Inefficiencies" IEEE INFOCOM (2009)
M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

5 /18
5/18
.

.

The Variable World
Scale

Traffic
flow

distributions of
throughput across peers

• you normally get wide

• some method are trying to cope by applying

variable load to peers

◦ variable-size pieces in BitTorrent 06, etc.

…
…
…
…

06 C.Gurler+2 "Variable chunk size ... and ... window for P2P streaming of scalable video" ICIP (2012)
M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

6 /18
6/18
.

.

CBR, VBR, SVC
CBR and VBR are self-explanatory, the best VBR is H.264 12
• SVC: recently introduced into H.264 and well studied 13
• SVC: think of it as configurable load distribution across frames
•

GOP

CBR
Time

Block

GOP
Frame size

Block
Frame size

Frame size

GOP

VBR
Time

Block

SVC
Time

12 "Advanced video coding for generic audiovisual services" ITU-T Recommendation H.264 (2012)
13 R.Kusching+2 "An Evaluation of TCP-based Rate-Control ... Streaming of H.264/SVC" ACM SIGMM MMsys) (2010)
M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

7 /18
7/18
.

.

VBR and SVC in Practice
real trace from 15
temporal, spatial, single-layer, etc.

• H.264 in VBR versus SVC single layer --

SVC

12

12

Frame size (kb)

Frame size (kb)

• H.264 has several modes:

8
4
0
0

20
40
60
80
Time sequence

100

VBR

8
4
0
0

20
40
60
80 100
Distribution sequence

15 P.Seeling+2 "Network Performance Evaluation with Frame Size and Quality Traces ..." IEEE Comm. Surveys... (2004)
M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

8 /18
8/18
.

.

Methods: Formally...
parameters: block size, video format
• input: peers with variable e2e throughput
• output: mapping between blocks and peers
•

• many possible patterns:
◦ VBR with same size blocks, CBR with variable size blocks, etc.

.
data grain
.

adaptive versus fixed
.
M.Zhanikeev -- maratishe@gmail.com --

.
peer load
.

regular of irregular
.

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

9 /18
9/18
.

.

Methods: Specifically
Content
BLOCK
GOP
FRAME

BLOCK

FRE

Fixed
Regular

M.Zhanikeev -- maratishe@gmail.com --

GOP

FIR

Fixed
Irregular

FRAME

Adaptive
Irregular
AIR

This
method

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

10 /18
10/18
.

.

Raw Tests: Simple AIR
•

Parent A
Bigger frames
(GOP pos x)

•

traditional
dynamics: re-elect

Client
Periodic
check/update
Re -order
parents
Close
connection
Pick a
better
candidate

Parent B
Bigger frames
(GOP pos x)
Smaller frames
(GOP pos y)

GOP per peer 02

slowest parent/child
•
Only for changed
frames/parents/GOP pos

Connection
close detected

Failed to
receive

AIR: frame position in

AIR dynamics:
re-assign
on failure

•

GOP positions

features: only 1-2
parents with large throughput,
others are small

02 myself+0 "...Extremely Scalable and Low Demand ... P2P Streaming ...Variable Bitrate" CANDAR (2013)
M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

11 /18
11/18
.

.

Raw Tests: AIR Methods Work!
Lower drop probability:

0.05:0.1

0.005:0.01

0.01:0.05

0.8

0.8

0.001:0.005

1
0.8

0.6
0.4
0.2
0

CBR freeze probability

1

SVC freeze probability

VBR freeze probability

1

0.6
0.4
0.2
0

0.1 0.15 0.2 0.25 0.3 0.35
VBR shape

0.6
0.4
0.2
0

0

0.12

0.24

0.36

0

SVC shape

0.5

1

02 myself+0 "...Extremely Scalable and Low Demand ... P2P Streaming ...Variable Bitrate" CANDAR (2013)
M.Zhanikeev -- maratishe@gmail.com --

1.5

CBR Level

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

12 /18
12/18
.

.

Utility: Formally..

{ }
distribution across }
substreams p S , with your downstream capacity C
{
{ }k
throughput/rate p R k and lag p L k prob. distributions across k peers
with F() meaning function of, the quality if your substream design for any

• load
•
•

method is:
with the obvious

rate

(C { } { } )
Q = F , p R k, p L k ,
S
ceiling of
∑
Ri ≤ S ≤ C.

(1)

(2)

i=1..k

social utility in this context is the response of your design to churn
• in practice: two
situations A and B for which utility is:
•

(evaluable scalarly)

U=
M.Zhanikeev -- maratishe@gmail.com --

QB − QA
.
B−A

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

(3)

13 /18
13/18
.

.

Utility: Optimization
• obvious subject to

optimization
∑

maximize

∑

Ui,j

(4)

Ri ≤ S ≤ C,

(5)

i∈people j∈time

subject to

∑

i∈people

∑

∑

Li,j ≤ 0.

(6)

i∈people j∈time

M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

14 /18
14/18
.

.

Utility: Simulation Models
•

crowd distributions p

{ }
{
}
R k (throughputs) y = (eax )−1 k

◦ setup: a ∈ (0.03, 0.05, 0.07, 0.1, 0.2, 0.3, 0.5, 0.9) and x ∈ (1..100), same to
frame size in VBR/SVC
• each

self has 10 peers, churn is emulated by dropping up to 5 peers randomly

(replaced with new)
• methods:
1.
2.

{ }
AIR: responds to churn by changing frame size distribution to mimic p R k
FIR.VBR: reassigns frames to substreams in descending order (both in rates and
frame sizes) 02

3.
4.

FIR.GOP: responds to churn by repacking blocks as multiples of GOP
{ }
06 to mimic p R
k
FRE: S is split into equal substreams, conventional parent re-election
02 myself+0 "...Extremely Scalable and Low Demand ... P2P Streaming ...Variable Bitrate" CANDAR (2013)
06 C.Gurler+2 "Variable chunk size ... and ... window for P2P streaming of scalable video" ICIP (2012)

M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

15 /18
15/18
.

.

Utility: Results
3

4

Crowd: 0.03..0.05
Utility

Utility

0
-1.5

FRE

0
-2

-3
-2

0
Change

2

4

-4

Crowd: 0.2..0.3

4

2

Utility

Utility

FIR.GOP

2

1.5

4

AIR
FIR.VBR
Crowd: 0.07..0.1

0
-2

-2

0
Change

2

4

0
Change

2

4

Crowd: 0.5..0.9

2
0
-2
-4

-4
-4

-2

M.Zhanikeev -- maratishe@gmail.com --

0
Change

2

4

-4

-2

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

16 /18
16/18
.

.

Wrapup
VBR is fit for real peer crowds
• SVC is even better because transponding is easy
•
•

social utility in the AIR method shows good response both in improving and
deteriorating conditions

M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

17 /18
17/18
.

.

That’s all, thank you ...

M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

18 /18
18/18
.

.

[01] R.Buyya+3 (2008)
Content Delivery Networks
Springer LNEE, vol.9
[02] myself+0 (2013)
...Extremely Scalable and Low Demand ... P2P Streaming ...Variable Bitrate
CANDAR
[03] myself+0 (2013)
Multi-Source Stream Aggegation in the Cloud
Wiley Book on Advanced Content Delivery ... Clouds
[04] N.Capovilla+4 (2010)
...Distributing Scalable Content over P2P Networks
MMEDIA
[05] P.Baccichet+3 (2007)
Low-delay Peer-to-Peer Streaming using Scalable Video Coding
Packet Video
M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

18 /18
18/18
.

.

[06] C.Gurler+2 (2012)
Variable chunk size ... and ... window for P2P streaming of scalable video
ICIP
[07] B.Li+5 (2008)
Inside the New Coolstreaming: Principles, Measurements and Performance
Implications
IEEE INFOCOM
[08] K.Park+4 (2010)
An Analysis of User Dynamics in P2P Live Streaming Services
ICC
[09] C.Wu+2 (2009)
Diagnosing Network-wide P2P Live Streaming Inefficiencies
IEEE INFOCOM
[10] Z.Li+4 (2008)
Towards Low-Redundancy Push-Pull P2P Live Streaming
QShine
M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

18 /18
18/18
.

.

[11] C.Stais+1 (2012)
Realistic Media Streaming over BitTorrent
Future Network and Mobile Summit
[12]

(2012)
Advanced video coding for generic audiovisual services
ITU-T Recommendation H.264

[13] R.Kusching+2 (2010)
An Evaluation of TCP-based Rate-Control ... Streaming of H.264/SVC
ACM SIGMM MMsys)
[14] M.Fidler+3 (2007)
Efficient Smoothing of Robust VBR Video Traffic ... Slice-Based...
CCNC
[15] P.Seeling+2 (2004)
Network Performance Evaluation with Frame Size and Quality Traces ...
IEEE Comm. Surveys...
M.Zhanikeev -- maratishe@gmail.com --

Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 ---

18 /18
18/18

Contenu connexe

Similaire à Improved Social Utility of P2P Streaming with a VBR-Based Substream Design

Colt sdn-strategy-telesemana-diciembre-2013-javier-benitez-colt-final
Colt sdn-strategy-telesemana-diciembre-2013-javier-benitez-colt-finalColt sdn-strategy-telesemana-diciembre-2013-javier-benitez-colt-final
Colt sdn-strategy-telesemana-diciembre-2013-javier-benitez-colt-final
Rafael Junquera
 
PacketCloud: an Open Platform for Elastic In-network Services.
PacketCloud: an Open Platform for Elastic In-network Services. PacketCloud: an Open Platform for Elastic In-network Services.
PacketCloud: an Open Platform for Elastic In-network Services.
yeung2000
 
On the Impact of Mobile Hosts in Peer-to-Peer Data Networks
On the Impact of Mobile Hosts in Peer-to-Peer Data NetworksOn the Impact of Mobile Hosts in Peer-to-Peer Data Networks
On the Impact of Mobile Hosts in Peer-to-Peer Data Networks
Zhenyun Zhuang
 

Similaire à Improved Social Utility of P2P Streaming with a VBR-Based Substream Design (20)

Final Project Report - Real-Time Media Apps
Final Project Report - Real-Time Media AppsFinal Project Report - Real-Time Media Apps
Final Project Report - Real-Time Media Apps
 
Mobile Hosts Participating in Peer-to-Peer Data Networks: Challenges and Solu...
Mobile Hosts Participating in Peer-to-Peer Data Networks: Challenges and Solu...Mobile Hosts Participating in Peer-to-Peer Data Networks: Challenges and Solu...
Mobile Hosts Participating in Peer-to-Peer Data Networks: Challenges and Solu...
 
Colt SDN Strategy - Telesemana December 2013
Colt SDN Strategy - Telesemana December 2013Colt SDN Strategy - Telesemana December 2013
Colt SDN Strategy - Telesemana December 2013
 
Colt sdn-strategy-telesemana-diciembre-2013-javier-benitez-colt-final
Colt sdn-strategy-telesemana-diciembre-2013-javier-benitez-colt-finalColt sdn-strategy-telesemana-diciembre-2013-javier-benitez-colt-final
Colt sdn-strategy-telesemana-diciembre-2013-javier-benitez-colt-final
 
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal Pilots
 
05999528
0599952805999528
05999528
 
TR14-05_Martindell.pdf
TR14-05_Martindell.pdfTR14-05_Martindell.pdf
TR14-05_Martindell.pdf
 
3-Way Scripts as a Base Unit for Flexible Scale-Out Code
3-Way Scripts as a Base Unit for Flexible Scale-Out Code3-Way Scripts as a Base Unit for Flexible Scale-Out Code
3-Way Scripts as a Base Unit for Flexible Scale-Out Code
 
Virtual Wireless User: A Practical Design for Parallel MultiConnect Using WiF...
Virtual Wireless User: A Practical Design for Parallel MultiConnect Using WiF...Virtual Wireless User: A Practical Design for Parallel MultiConnect Using WiF...
Virtual Wireless User: A Practical Design for Parallel MultiConnect Using WiF...
 
Abitcool - A vast array of small-scale service providers with gigabit access,...
Abitcool - A vast array of small-scale service providers with gigabit access,...Abitcool - A vast array of small-scale service providers with gigabit access,...
Abitcool - A vast array of small-scale service providers with gigabit access,...
 
Netsoft19 Keynote: Fluid Network Planes
Netsoft19 Keynote: Fluid Network PlanesNetsoft19 Keynote: Fluid Network Planes
Netsoft19 Keynote: Fluid Network Planes
 
PacketCloud: an Open Platform for Elastic In-network Services.
PacketCloud: an Open Platform for Elastic In-network Services. PacketCloud: an Open Platform for Elastic In-network Services.
PacketCloud: an Open Platform for Elastic In-network Services.
 
IRATI @ RINA Workshop 2014, Dublin
IRATI @ RINA Workshop 2014, DublinIRATI @ RINA Workshop 2014, Dublin
IRATI @ RINA Workshop 2014, Dublin
 
WebRTC: A front-end perspective
WebRTC: A front-end perspectiveWebRTC: A front-end perspective
WebRTC: A front-end perspective
 
Developing rich multimedia applications with Kurento: a tutorial for JavaScri...
Developing rich multimedia applications with Kurento: a tutorial for JavaScri...Developing rich multimedia applications with Kurento: a tutorial for JavaScri...
Developing rich multimedia applications with Kurento: a tutorial for JavaScri...
 
E2E Services using Cloud Visitation Platforms
E2E Services using Cloud Visitation PlatformsE2E Services using Cloud Visitation Platforms
E2E Services using Cloud Visitation Platforms
 
Genomic Computation at Scale with Serverless, StackStorm and Docker Swarm
Genomic Computation at Scale with Serverless, StackStorm and Docker SwarmGenomic Computation at Scale with Serverless, StackStorm and Docker Swarm
Genomic Computation at Scale with Serverless, StackStorm and Docker Swarm
 
Kurento - FI-WARE Bootcamp
Kurento - FI-WARE BootcampKurento - FI-WARE Bootcamp
Kurento - FI-WARE Bootcamp
 
On the Impact of Mobile Hosts in Peer-to-Peer Data Networks
On the Impact of Mobile Hosts in Peer-to-Peer Data NetworksOn the Impact of Mobile Hosts in Peer-to-Peer Data Networks
On the Impact of Mobile Hosts in Peer-to-Peer Data Networks
 
Top 10 Web and HTML5 Predictions for 2013
Top 10 Web and HTML5 Predictions for 2013Top 10 Web and HTML5 Predictions for 2013
Top 10 Web and HTML5 Predictions for 2013
 

Plus de Tokyo University of Science

Population Management in Clouds is a Do-It-Yourself Technology
Population Management in Clouds is a Do-It-Yourself TechnologyPopulation Management in Clouds is a Do-It-Yourself Technology
Population Management in Clouds is a Do-It-Yourself Technology
Tokyo University of Science
 

Plus de Tokyo University of Science (20)

A Method for Cloud-Assisted Secure Wireless Grouping of Client Devices at Net...
A Method for Cloud-Assisted Secure Wireless Grouping of Client Devices at Net...A Method for Cloud-Assisted Secure Wireless Grouping of Client Devices at Net...
A Method for Cloud-Assisted Secure Wireless Grouping of Client Devices at Net...
 
Ultrasound Relative Positioning for IoT Devices in Dense Wireless Spaces
Ultrasound Relative Positioning for IoT Devices in Dense Wireless SpacesUltrasound Relative Positioning for IoT Devices in Dense Wireless Spaces
Ultrasound Relative Positioning for IoT Devices in Dense Wireless Spaces
 
Towards a Packet Traffic Genome Project as a Method for Realtime Sub-Flow Tra...
Towards a Packet Traffic Genome Project as a Method for Realtime Sub-Flow Tra...Towards a Packet Traffic Genome Project as a Method for Realtime Sub-Flow Tra...
Towards a Packet Traffic Genome Project as a Method for Realtime Sub-Flow Tra...
 
What if We Atomize Student Data and Apps and Put Them on Docker Containers?
What if We Atomize Student Data and Apps and Put Them on Docker Containers?What if We Atomize Student Data and Apps and Put Them on Docker Containers?
What if We Atomize Student Data and Apps and Put Them on Docker Containers?
 
Large-Scale Crowdsourcing by Vehicular Data Packets in a Sparse Roadside Infr...
Large-Scale Crowdsourcing by Vehicular Data Packets in a Sparse Roadside Infr...Large-Scale Crowdsourcing by Vehicular Data Packets in a Sparse Roadside Infr...
Large-Scale Crowdsourcing by Vehicular Data Packets in a Sparse Roadside Infr...
 
On Performance Under Hotspots in Hadoop versus Bigdata Replay Platforms
On Performance Under Hotspots in Hadoop versus Bigdata Replay PlatformsOn Performance Under Hotspots in Hadoop versus Bigdata Replay Platforms
On Performance Under Hotspots in Hadoop versus Bigdata Replay Platforms
 
Taking the Step from Software to Product Development \\ when teaching PBL at ...
Taking the Step from Software to Product Development \\ when teaching PBL at ...Taking the Step from Software to Product Development \\ when teaching PBL at ...
Taking the Step from Software to Product Development \\ when teaching PBL at ...
 
Design and Implementation of a 3-Party Cloud-Backed Handshake for Secure Grou...
Design and Implementation of a 3-Party Cloud-Backed Handshake for Secure Grou...Design and Implementation of a 3-Party Cloud-Backed Handshake for Secure Grou...
Design and Implementation of a 3-Party Cloud-Backed Handshake for Secure Grou...
 
The Switchboard Optimization Problem and Heuristics for Cut-Through Networking
The Switchboard Optimization Problem and Heuristics for Cut-Through NetworkingThe Switchboard Optimization Problem and Heuristics for Cut-Through Networking
The Switchboard Optimization Problem and Heuristics for Cut-Through Networking
 
The Switchboard Traffic Engineering Problem for Mixed Contention/Cut-Through ...
The Switchboard Traffic Engineering Problem for Mixed Contention/Cut-Through ...The Switchboard Traffic Engineering Problem for Mixed Contention/Cut-Through ...
The Switchboard Traffic Engineering Problem for Mixed Contention/Cut-Through ...
 
Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces
Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless SpacesBulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces
Bulk-n-Pick Method for One-to-Many Data Transfer in Dense Wireless Spaces
 
Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces
Fog Cloud Caching at Network Edge via Local Hardware Awareness SpacesFog Cloud Caching at Network Edge via Local Hardware Awareness Spaces
Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces
 
On a Hybrid Packets-and-Circuits Switching Logic
On a Hybrid Packets-and-Circuits Switching LogicOn a Hybrid Packets-and-Circuits Switching Logic
On a Hybrid Packets-and-Circuits Switching Logic
 
Complexity Resolution Control for Context Based on Metromaps
Complexity Resolution Control for Context Based on MetromapsComplexity Resolution Control for Context Based on Metromaps
Complexity Resolution Control for Context Based on Metromaps
 
The Declarative-Coordinated Model for Self-Optimization of Service Networks
The Declarative-Coordinated Model for Self-Optimization of Service NetworksThe Declarative-Coordinated Model for Self-Optimization of Service Networks
The Declarative-Coordinated Model for Self-Optimization of Service Networks
 
3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds
3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds
3-Way Scripts as a Practical Platform for Secure Distributed Code in Clouds
 
Towards Social Robotics on Smartphones with Simple XYZV Sensor Feedback
Towards Social Robotics on Smartphones with Simple XYZV Sensor FeedbackTowards Social Robotics on Smartphones with Simple XYZV Sensor Feedback
Towards Social Robotics on Smartphones with Simple XYZV Sensor Feedback
 
Back to Rings but not Tokens: Physical and Logical Designs for Distributed Fi...
Back to Rings but not Tokens: Physical and Logical Designs for Distributed Fi...Back to Rings but not Tokens: Physical and Logical Designs for Distributed Fi...
Back to Rings but not Tokens: Physical and Logical Designs for Distributed Fi...
 
Browser Visualization using PNGs Generated by HTML5 Workers on Multicore
Browser Visualization using PNGs Generated by HTML5 Workers on MulticoreBrowser Visualization using PNGs Generated by HTML5 Workers on Multicore
Browser Visualization using PNGs Generated by HTML5 Workers on Multicore
 
Population Management in Clouds is a Do-It-Yourself Technology
Population Management in Clouds is a Do-It-Yourself TechnologyPopulation Management in Clouds is a Do-It-Yourself Technology
Population Management in Clouds is a Do-It-Yourself Technology
 

Dernier

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Dernier (20)

Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 

Improved Social Utility of P2P Streaming with a VBR-Based Substream Design

  • 1.
  • 2. . . P2P Streaming Basics (1) … Share Content Provider (origin) P2P Network 01 R.Buyya+3 -M.Zhanikeev -- maratishe@gmail.com "Content Delivery Networks" Springer LNEE, vol.9 (2008) Substream Design -- http://tinyurl.com/kyutech131114 --Social Utility of P2P Streaming with VBR 2 /18 2/18
  • 3. . . P2P Streaming Basics (2) not a tree • P2P delivery network is 02 ◦ officially: multiple complimentary trees • each peer is normally at most Scale Traffic flow 3-4 hops away from the content server 05 realtime 03 • P2P streaming is always ◦ other content can be converted realtime via scheduled sessions to … … … … 02 myself+0 "...Extremely Scalable and Low Demand ... P2P Streaming ...Variable Bitrate" CANDAR (2013) 03 myself+0 "Multi-Source Stream Aggegation in the Cloud" Wiley Book on Advanced Content Delivery ... Clouds (2013) 05 P.Baccichet+3 "Low-delay Peer-to-Peer Streaming using Scalable Video Coding" Packet Video (2007) M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 3 /18 3/18
  • 4. . . P2P Streaming: Push vs Pull • a well known argument 03 10 Client Server Client Server Pull many remote peers Push …… pull: +RTT for every piece • pull: high throughput requires many • • push: connect once, use for a long time …… 03 myself+0 "Multi-Source Stream Aggegation in the Cloud" Wiley Book on Advanced Content Delivery ... Clouds (2013) 10 Z.Li+4 "Towards Low-Redundancy Push-Pull P2P Live Streaming" QShine (2008) M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 4 /18 4/18
  • 5. . . Push/Pull = BitTorrent/Substream pull = BitTorrent, many existing methods 11 • push = substream method • ◦ many services like Coolstreaming 07, Afreeca 08, ◦ also referred to as sliced or layered streaming Uusee 09, etc... 11 C.Stais+1 "Realistic Media Streaming over BitTorrent" Future Network and Mobile Summit (2012) 07 B.Li+5 "Inside the New Coolstreaming: Principles, Measurements and Performance Implications" IEEE INFOCOM (2008) 08 K.Park+4 "An Analysis of User Dynamics in P2P Live Streaming Services" ICC (2010) 09 C.Wu+2 "Diagnosing Network-wide P2P Live Streaming Inefficiencies" IEEE INFOCOM (2009) M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 5 /18 5/18
  • 6. . . The Variable World Scale Traffic flow distributions of throughput across peers • you normally get wide • some method are trying to cope by applying variable load to peers ◦ variable-size pieces in BitTorrent 06, etc. … … … … 06 C.Gurler+2 "Variable chunk size ... and ... window for P2P streaming of scalable video" ICIP (2012) M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 6 /18 6/18
  • 7. . . CBR, VBR, SVC CBR and VBR are self-explanatory, the best VBR is H.264 12 • SVC: recently introduced into H.264 and well studied 13 • SVC: think of it as configurable load distribution across frames • GOP CBR Time Block GOP Frame size Block Frame size Frame size GOP VBR Time Block SVC Time 12 "Advanced video coding for generic audiovisual services" ITU-T Recommendation H.264 (2012) 13 R.Kusching+2 "An Evaluation of TCP-based Rate-Control ... Streaming of H.264/SVC" ACM SIGMM MMsys) (2010) M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 7 /18 7/18
  • 8. . . VBR and SVC in Practice real trace from 15 temporal, spatial, single-layer, etc. • H.264 in VBR versus SVC single layer -- SVC 12 12 Frame size (kb) Frame size (kb) • H.264 has several modes: 8 4 0 0 20 40 60 80 Time sequence 100 VBR 8 4 0 0 20 40 60 80 100 Distribution sequence 15 P.Seeling+2 "Network Performance Evaluation with Frame Size and Quality Traces ..." IEEE Comm. Surveys... (2004) M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 8 /18 8/18
  • 9. . . Methods: Formally... parameters: block size, video format • input: peers with variable e2e throughput • output: mapping between blocks and peers • • many possible patterns: ◦ VBR with same size blocks, CBR with variable size blocks, etc. . data grain . adaptive versus fixed . M.Zhanikeev -- maratishe@gmail.com -- . peer load . regular of irregular . Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 9 /18 9/18
  • 10. . . Methods: Specifically Content BLOCK GOP FRAME BLOCK FRE Fixed Regular M.Zhanikeev -- maratishe@gmail.com -- GOP FIR Fixed Irregular FRAME Adaptive Irregular AIR This method Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 10 /18 10/18
  • 11. . . Raw Tests: Simple AIR • Parent A Bigger frames (GOP pos x) • traditional dynamics: re-elect Client Periodic check/update Re -order parents Close connection Pick a better candidate Parent B Bigger frames (GOP pos x) Smaller frames (GOP pos y) GOP per peer 02 slowest parent/child • Only for changed frames/parents/GOP pos Connection close detected Failed to receive AIR: frame position in AIR dynamics: re-assign on failure • GOP positions features: only 1-2 parents with large throughput, others are small 02 myself+0 "...Extremely Scalable and Low Demand ... P2P Streaming ...Variable Bitrate" CANDAR (2013) M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 11 /18 11/18
  • 12. . . Raw Tests: AIR Methods Work! Lower drop probability: 0.05:0.1 0.005:0.01 0.01:0.05 0.8 0.8 0.001:0.005 1 0.8 0.6 0.4 0.2 0 CBR freeze probability 1 SVC freeze probability VBR freeze probability 1 0.6 0.4 0.2 0 0.1 0.15 0.2 0.25 0.3 0.35 VBR shape 0.6 0.4 0.2 0 0 0.12 0.24 0.36 0 SVC shape 0.5 1 02 myself+0 "...Extremely Scalable and Low Demand ... P2P Streaming ...Variable Bitrate" CANDAR (2013) M.Zhanikeev -- maratishe@gmail.com -- 1.5 CBR Level Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 12 /18 12/18
  • 13. . . Utility: Formally.. { } distribution across } substreams p S , with your downstream capacity C { { }k throughput/rate p R k and lag p L k prob. distributions across k peers with F() meaning function of, the quality if your substream design for any • load • • method is: with the obvious rate (C { } { } ) Q = F , p R k, p L k , S ceiling of ∑ Ri ≤ S ≤ C. (1) (2) i=1..k social utility in this context is the response of your design to churn • in practice: two situations A and B for which utility is: • (evaluable scalarly) U= M.Zhanikeev -- maratishe@gmail.com -- QB − QA . B−A Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- (3) 13 /18 13/18
  • 14. . . Utility: Optimization • obvious subject to optimization ∑ maximize ∑ Ui,j (4) Ri ≤ S ≤ C, (5) i∈people j∈time subject to ∑ i∈people ∑ ∑ Li,j ≤ 0. (6) i∈people j∈time M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 14 /18 14/18
  • 15. . . Utility: Simulation Models • crowd distributions p { } { } R k (throughputs) y = (eax )−1 k ◦ setup: a ∈ (0.03, 0.05, 0.07, 0.1, 0.2, 0.3, 0.5, 0.9) and x ∈ (1..100), same to frame size in VBR/SVC • each self has 10 peers, churn is emulated by dropping up to 5 peers randomly (replaced with new) • methods: 1. 2. { } AIR: responds to churn by changing frame size distribution to mimic p R k FIR.VBR: reassigns frames to substreams in descending order (both in rates and frame sizes) 02 3. 4. FIR.GOP: responds to churn by repacking blocks as multiples of GOP { } 06 to mimic p R k FRE: S is split into equal substreams, conventional parent re-election 02 myself+0 "...Extremely Scalable and Low Demand ... P2P Streaming ...Variable Bitrate" CANDAR (2013) 06 C.Gurler+2 "Variable chunk size ... and ... window for P2P streaming of scalable video" ICIP (2012) M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 15 /18 15/18
  • 16. . . Utility: Results 3 4 Crowd: 0.03..0.05 Utility Utility 0 -1.5 FRE 0 -2 -3 -2 0 Change 2 4 -4 Crowd: 0.2..0.3 4 2 Utility Utility FIR.GOP 2 1.5 4 AIR FIR.VBR Crowd: 0.07..0.1 0 -2 -2 0 Change 2 4 0 Change 2 4 Crowd: 0.5..0.9 2 0 -2 -4 -4 -4 -2 M.Zhanikeev -- maratishe@gmail.com -- 0 Change 2 4 -4 -2 Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 16 /18 16/18
  • 17. . . Wrapup VBR is fit for real peer crowds • SVC is even better because transponding is easy • • social utility in the AIR method shows good response both in improving and deteriorating conditions M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 17 /18 17/18
  • 18. . . That’s all, thank you ... M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 18 /18 18/18
  • 19. . . [01] R.Buyya+3 (2008) Content Delivery Networks Springer LNEE, vol.9 [02] myself+0 (2013) ...Extremely Scalable and Low Demand ... P2P Streaming ...Variable Bitrate CANDAR [03] myself+0 (2013) Multi-Source Stream Aggegation in the Cloud Wiley Book on Advanced Content Delivery ... Clouds [04] N.Capovilla+4 (2010) ...Distributing Scalable Content over P2P Networks MMEDIA [05] P.Baccichet+3 (2007) Low-delay Peer-to-Peer Streaming using Scalable Video Coding Packet Video M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 18 /18 18/18
  • 20. . . [06] C.Gurler+2 (2012) Variable chunk size ... and ... window for P2P streaming of scalable video ICIP [07] B.Li+5 (2008) Inside the New Coolstreaming: Principles, Measurements and Performance Implications IEEE INFOCOM [08] K.Park+4 (2010) An Analysis of User Dynamics in P2P Live Streaming Services ICC [09] C.Wu+2 (2009) Diagnosing Network-wide P2P Live Streaming Inefficiencies IEEE INFOCOM [10] Z.Li+4 (2008) Towards Low-Redundancy Push-Pull P2P Live Streaming QShine M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 18 /18 18/18
  • 21. . . [11] C.Stais+1 (2012) Realistic Media Streaming over BitTorrent Future Network and Mobile Summit [12] (2012) Advanced video coding for generic audiovisual services ITU-T Recommendation H.264 [13] R.Kusching+2 (2010) An Evaluation of TCP-based Rate-Control ... Streaming of H.264/SVC ACM SIGMM MMsys) [14] M.Fidler+3 (2007) Efficient Smoothing of Robust VBR Video Traffic ... Slice-Based... CCNC [15] P.Seeling+2 (2004) Network Performance Evaluation with Frame Size and Quality Traces ... IEEE Comm. Surveys... M.Zhanikeev -- maratishe@gmail.com -- Social Utility of P2P Streaming with VBR Substream Design -- http://tinyurl.com/kyutech131114 --- 18 /18 18/18