The slides I presented during the MP20 workshop in Hong Kong, just after the evaluation of the techologies proposed by nine technology leaders to the MPEG Call for Proposals

1. Point Cloud
Compression in MPEG
MP20 Workshop
Hong-Kong October 2017
Institut MINES TELECOM, FRANCE
Marius PREDA
MPEG 3D Graphics Chair

2. What a Point Cloud is and why we should care about?
PX vs PC
Visual
synthesis
Visual
capture

3. PX vs PC
HD, Full HD, 4K, 8K
LDR, HDR
Multi-camera
Stereoscopy
Visual
synthesis
Visual
capture
What a Point Cloud is and why we should care about?

4. PX vs PC
Geometric
primitives
Visual
synthesis
Visual
capture
What a Point Cloud is and why we should care about?

5. PX vs PC
Geometric
primitivesHD, Full HD, 4K, 8K
LDR, HDR
Stereoscopy
Multi-camera
Visual
synthesis
Visual
capture
What a Point Cloud is and why we should care about?

6. PX vs PC
Point Cloud –
a convergence between 2 worlds
Visual
synthesis
Visual
capture
What a Point Cloud is and why we should care about?

7. Point Cloud
PX vs PC
¢ A set of 3D points
• not ordered,
• without relations between
them
¢ Each point is defined by
• (X, Y, Z)
• (R, V, B) or (Y, U, V)
• reflectance, transparency, …

8. PC
PX vs PC

9. PC
PX vs PC
800,000 points -> 1 000 Mbps (uncompressed)
Compression is required in order to make PC useful

10. Point Cloud Compression
¢ MPEG initiated the work on
PCC in 2014
¢ In April 2017 MPEG issued a
Call for Proposals on PCC
PX vs PC

11. Point Cloud
PX vs PC

12. Point Cloud
PX vs PC
360°
background
3D
objects
free-­‐view
path

13. Point Cloud
PX vs PC

14. Point Cloud Compression
¢ MPEG initiated the work on
PCC in 2014
¢ In April 2017 MPEG issued a
Call for Proposals on PCC
¢ Nine technology leading companies
responded and MPEG evaluated
them in October 2017 (during
Macao meeting)
PX vs PC

15. Point Cloud Compression
0
2
4
6
8
10
1
2
3
4
5
6
7
8
9
10
11
12
13
14

16. Main outcome
¢ Decomposition of PC into 2D patches

17. Main outcome
¢ Decomposition of PC into 2D patches
Decomposition
into patches
Geometry video
frame(s)
Color video
frame(s)
Video
encoding
Video
encoding
MUX
Input
point
cloud
Occupancy
map
Bitstream
Packing
OMap
encoding
Motion field
video frames
Video
encoding
Auxiliary patch-
info
compression

18. Main outcome
¢ Decomposition of PC into 2D patches
Decomposition
into patches
Geometry video
frame(s)
Color video
frame(s)
Video
encoding
Video
encoding
MUX
Input
point
cloud
Occupancy
map
Bitstream
Packing
OMap
encoding
Motion field
video frames
Video
encoding
Auxiliary patch-
info
compression
8-16%
PCC = 3 VC + DELTA
DELTA is between 10% and 20%
2-4%
Video encoder

19. MPEG PCC v0
PX vs PC
800,000 points -> 1 000 Mbps (uncompressed)
800,000 points -> 8 Mbps (MPEG PCC 2017)

20. Conclusion
¢ State-of-the-art point cloud compression can be
significantly improved by leveraging decades of 2D
video coding technology development
¢ By combining 2D and 3D compression technologies,
PCC provides synergies with existing hardware and
software infrastructure for rapid deployment of new
immersive experiences
¢ MPEG PCC is a solid basis for the next few decades in
3D graphics compression

21. Conclusion
¢ We are at the beginning of a new era when humanity
will re-gain its third dimension!

22. Disclaimer
¢ Several pictures and videos used in this presentation
are provided by 8i (https://8i.com/)