DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
Lect7 MC2013 UET K55CA
1. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
1
Multimedia CommunicationMultimedia Communication
2. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
2
BackgroundBackground
The story so far….
Video Coding–MPEG-4 …
Audio Coding– u-Law, AMR …
Packetization and Transport of media– RTP
Transprot Control / QoS Feedback -RTCP
Next
SDP – Description
RTSP – Signaling
SIP
3. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
3
BackgroundBackground
SDP (Session Description Protocol)
How to describe a multimedia session?
RTSP – Internet VCR controls
Stop, Pause, Play, Fast Forward over the
internet
4. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
4
SDPSDP
Example : An existing live multicast session
Video and Audio streams
Transport - RTP/UDP/IP, Control – RTCP/UDP/IP
A new client wanting to join the multicast session
Needs to know
– multicast IP address and port
– Media streams in a session (e.g. video only or audio + video)
Payload format (e.g. MPEG-4 video, AMR audio)
– Initialization data for video and audio decoders
– Transport protocol used
– Other information ....
Need a way to describe a multimedia session
– To enable new clients to easily join the session
5. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
5
SDPSDP
Session Description Protocol (SDP)
– IETF –RFC2327: www.ietf.org/rfc/rfc2327.txt
For describing multimedia sessions
– To communicate the existence of a session
– To convey sufficient information to join a session
Simple text format
Defined to be general purpose
– Can be used for a wide range of network environment
– And applications
6. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
6
SDPSDP
SDP includes:
Session name and purpose
Time the session is active
The media comprising the session
Information to receive media (addresses, ports, formats)
Information about bandwidth to be used
Contact information of a person responsible for the
session
SDP is used by other signaling / initiation protocols
SIP : Session Initiation Protocol
RTSP : Real-time Streaming Protocol
9. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
9
SDPSDP
Example – Using SDP to join a multicast session
Request SDP file via HTTP
Retrieve information from downloaded SDP file
Receive RTP streams on SDP specifed address & port
Decode and display specified media
10. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
10
RTSPRTSP
Now we can describe and transport media streams
But how to control these streams
Start, Stop, Pause, Fast Forward, Rewind
“Internet VCR”
Solution- RTSP
Real Time Streaming Protocol
Establishes and controls one or more countinuous media streams – such as audio and
video
Similar in syntax and operation to HTTP/1.1
– Client–Server protocol
– Text based
IETF RFC 2326
www.ietf.org/rfc/rfc2326.txt
www.rtsp.org
12. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
12
RTSPRTSP
Protocol Properties
Media Transport Indepedent
– RTSP does not depend on the transport machanism used to carry
the continuous media
– Media transport can be via RTP or some other mechanism
Transport-independent:
– RTSP may use UDP or TCP
Control of recording devices:
– Can control both recording only and playback only devices,
– Or devices that can alternate between the two modes
13. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
13
RTSPRTSP
Protocol Properties:
Extendable:
– New methods and parameters can be easily added to RTSP.
Easy to parse
Multi-server capable:
– Each media stream within a presentation can reside on a different
server.
HTTP- friendly:
– RTSP reuses HTTP concepts, so that the existing infrastruture
can be reused.
14. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
14
RTSPRTSP
Protocol Operation
– Text based messages between client and
server
– Messages can be:
Requests
Responses
17. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
17
RTSP – Decribe MethodRTSP – Decribe Method
18. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
18
RTSP – Setup MethodRTSP – Setup Method
19. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
19
RTSP – Play MethodRTSP – Play Method
20. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
20
RTSP – Pause MethodRTSP – Pause Method
21. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
21
RTSP – Teardown MethodRTSP – Teardown Method
22. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
22
RTSP – Signal Timing DiagramRTSP – Signal Timing Diagram
23. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
23
Summary of RTSP methodsSummary of RTSP methods
24. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
24
SIPSIP
Session Initiation Protocol
– Another session control protocol
– IETF RFC 3261 www.ietf.org/rfc/rfc3261.txt
Protocol that can establish, modify and terminate multimedia
sessions
Applications– IP telephony, multimedia conferences
SIP, likeRTSP,
– Uses text-based request/response transattion model
Requests contain Methods and Header fields
Responses include 3 digit status codes, eg "200 OK"
– Is Transport layer independent
– Uses other protocols for media delivery (eg RTP)
25. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
25
SIP MessagesSIP Messages
SIP AddressesSIP Addresses
RFC 3261 defined SIP addresses in form of s
sip:user@domain:port
sip:user@host:port
Default port is 5061
26. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
26
SIP Message TypesSIP Message Types
SIP Invite
SIP Response
27. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
27
SIPSIP
SIP Methods
– INVITE, ACK, CANCEL : for setting up sessions
– BYE : for terminating sessions
– REGISTER for registering contact information
– OPTIONS : for querying servers about capabilities
INVITE
– User agent client initiates a session with INVITE
– Invitation can be accepted by a user agent server
– Sip invitations convey session descriptions that allow
participants to agree on a set of compatible media types
– Offer/answer model
ACK
– Response confirmation to INVITE
28. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
28
SIP ResponseSIP Response
Code range from 100 to 699, divided into several classes
1xx, 2xx, …,6xx:
– 1xx : the status.
– 2xx : the query was processed successfully.
– 3xx : the query was sent to another servers to further processing.
– 4xx, 5xx, 6xx: There are error in the query processing
30. 05/10/14Bùi Thế Duy - Bộ môn Mạng và TTMT
30
SIPSIP
SIP supports user mobility
With proxy servers to help route requests
to user's current location
Registration function allowing users to
upload current locations for use by proxy
servers.