What is WebRTC? How it benefits developers? Is WebRTC a recognized standard? How RingCentral is using WebRTC? How RingCentral is involved in WebRTC? What the future of WebRTC looks like?

1. Confidential ©2021 RingCentral
September 20, 2021
async function call_ringout() {
try {
var resp = await
platform.post('/restapi/v1.0/account/~/ex
'from': { 'phoneNumber': RINGCENTRA
'to': { 'phoneNumber': RECIPIENT },
'playPrompt': false
})
var jsonObj = await resp.json()
console.log("Call placed. Call status
jsonObj.status.callStatus)
} catch (e) {
console.log(e.message)
}
}
The future of
WebRTC
Arnaud Budkiewicz
Sr Director of Video Engineering, W3C Member
@ArnaudBud

2. Agenda
1 2
The power of WebRTC
● What is WebRTC?
● Is WebRTC a standard?
● How it benefits developers?
The future of WebRTC
● More secure
● AI-powered features
● Better media quality
● Better UX
3
How RingCentral is Involved?
● Report Issues
● Contributions
● Standard definition

3. The power of
WebRTC

4. 4 ©2021 RingCentral
WebRTC is
10

5. 5 ©2021 RingCentral
ALL major browsers
● Chrome, Edge
● Firefox
● Safari
Video, Audio, Data
● Codecs
● Audio engine
● Video engine
● Any data
Peer-to-Peer
● 2 browsers
● 1 application, 1 server
● 2 servers
Open-source
● JS API
● libWebRTC
● Chromium
● WebKit
What is WebRTC?
WebRTC is a real-time communication technology, that
supports video, voice, and generic data to be sent
between peers.

6. 6 ©2021 RingCentral
WebRTC Media Engine WebRTC Protocol Stack
1 2
What is WebRTC?
Source: https://hpbn.co

7. 7 ©2021 RingCentral
Why use WebRTC?
This means that meetings and webinars can now be more accessible, and easier for people to join.

8. 8 ©2021 RingCentral
WebRTC is now an official W3C and IETF standard

9. 9 ©2021 RingCentral
How it benefits developers?
With a minimal effort, the application will be
supported by all the major browsers, on
desktop and mobile devices.
The entire stack is open source, the
community is large and supported by Apple,
Google, Microsoft and Mozilla, among others.
It comes with modern audio and video
codecs that are free to use.
var jsonObj = await resp.json()
console.log("Call placed. Call
status: " +
jsonObj.status.callStatus)
} catch (e) {
console.log(e.message)
}
}

10. 10 ©2021 RingCentral
How it benefits developers?
And with Data Channel, possibilities are
endless…
● Mesh eCDN (Peer5, StreamRoot)
● Browser Torrent Client (WebTorrent)
● Whiteboarding
● Annotation, Remote Control
● Chat

11. The future of
WebRTC

12. 12 ©2021 RingCentral
More Secure
End-to-end encryption (E2EE)
Secure Frame (Sframe), enables the developer to
implement true end-to-end media encryption,
even when a Media Server is involved.

13. 13 ©2021 RingCentral
More Secure
WebRTC Encoded Transform
SFrameTransform will enable the developer
to apply transformation functions on
encoded media.
Some uses cases are:
● Captioning
● Transcription
● Language translation
● Funny hats
● Background removal or blurring
● In-browser compositing
● Voice effects
● Stress detection

14. 14 ©2021 RingCentral
AI-powered features
WebRTC Insertable Streams exposes encoded data
from RTCPeerConnections
MediaStreamTrack Insertable Streams (a.k.a.
Breakout Box) enables the developer manipulating
raw media carried by MediaStreamTracks such as:
● the output of a camera, a microphone
● a screen capture
● the decoder part of a codec and the input to
the decoder part of a codec

15. 15 ©2021 RingCentral
AI-powered features
WebCodec gives to the developer
full control over the way media content is processed
using media components that are already present in
the browser. Specifically:
● Video and audio decoders
● Video and audio encoders
● Raw video frames
● Image decoders.

16. 16 ©2021 RingCentral
Better Media Quality
WebRTC Scalable Video Coding extensions to
enable configuration of encoding parameters for
SVC.
Many video codecs (VP8, VP9, AV1, H264-SVC)
have modes that allow an encoder to send out
video data in such a format that it's possible to strip
out certain packets from the stream and
reconstruct a lower quality video stream from the
result.
SVC is more efficient and more scalable than
simulcast.
VP9 SVC is partially “available” in WebRTC today.
SVC
Simulcast
Source: https://webrtchacks.com

17. 17 ©2021 RingCentral
Better Media Quality
Lyra, neural audio codec for low-bitrate speech
● Very low-bitrate speech codec
● Processing latency of 90ms (on the slow end of the
spectrum of real-time voice codecs)
● Designed to operate at 3kbps
● Currently optimized for the 64-bit ARM android
platform
Soundstream, extends Lyra to support speech and
music
● Measured with MUSHRA (MUltiple Stimuli with
Hidden Reference and Anchor) expert listeners)
● Part of the next, improved version of Lyra
Source: https://ai.googleblog.com/2021/08/soundstream-end-to-end-neural-audio.html

18. 18 ©2021 RingCentral
Better UX
Screen sharing
● Share THIS Tab, adding preferCurrentTab
to getDisplayMedia
● Share audio by default
Source: https://github.com/WICG/proposals/issues/32

19. 19 ©2021 RingCentral
Better UX
Capture Handle, allows a display-capturing
web-application to confidently identify the
web-application it is display-capturing (if the
captured application has opted-in).
Some uses cases are:
● Detect and prevent the hall-of-mirrors
● Cross-App Communications
For instance, remotely control of a
presentation
● Detecting unintended/unapproved captures
● Analytics on the content being shared
(Wikipedia, CNN, etc)
Source: https://github.com/wicg/capture-handle/
Remote control of a presentation
Prevent the hall-of-mirrors

20. How RingCentral is
involved?

21. 21 ©2021 RingCentral
Report Issues
● How to submit a WebRTC bug >>
● Bisect-builds.py
● Where to report:
○ crbug.com -- for Chrome.
○ bugzilla.mozilla.org -- for Firefox.
○ bugs.webkit.org -- for Safari.
○ developer.microsoft.com -- for Microsoft Edge.
○ bugs.webrtc.org -- for WebRTC native code.
python tools/bisect-builds.py -a mac
-g M85 -b M86 --use-local-cache
--verify-range
1
2
3
How RingCentral is involved?
https://webrtccourse.com

22. 22 ©2021 RingCentral
How RingCentral is involved?
Feedback on Experimental Features
Example:
RED (RTP Payload for Redundant Audio Data)
● Extensive lab testing
● Internal User feedback
Source: RingCentral

23. 23 ©2021 RingCentral
How RingCentral is involved?
Code Contribution
Examples:
Handling Powerpoint Presentation Mode
● Issue was reported 5 years ago
● 2 months of back and forth
Handling OpenOffice Presentation Mode
● Support of OpenOffice + improvements of the
previous implementation
● 7 months of back and forth
Individuals and corporations welcome!
https://webrtc.org/support/contributing

24. 24 ©2021 RingCentral
How RingCentral is involved?
Standard Definition
● RingCentral is a W3C Member.
● Community Group (WICG.io) lightweight
venue for proposing and discussing new
web platform features.
W3C Membership not required.

25. Confidential
Thank you.
Thank you.
@ringcentraldevs
developers.ringcentral.com
Friday, January 01, 2021
async function call_ringout() {
try {
var resp = await
platform.post('/restapi/v1.0/account/~/ex
'from': { 'phoneNumber': RINGCENTRA
'to': { 'phoneNumber': RECIPIENT },
'playPrompt': false
})
var jsonObj = await resp.json()
console.log("Call placed. Call status
jsonObj.status.callStatus)
} catch (e) {
console.log(e.message)
}
}