1. Overview of SelectedCurrent MPEG Activities Christian Timmerer Klagenfurt University (UNIKLU)  Faculty of Technical Sciences (TEWI) Department of Information Technology (ITEC)  Multimedia Communication (MMC) http://research.timmerer.com  http://blog.timmerer.com  mailto:christian.timmerer@itec.uni-klu.ac.at A report from the 91st MPEG meeting, Kyoto, Japan January 2010

2. Outline Background / Introduction MPEG, who the f*** is MPEG? Benefits for using MPEG technologies and contributing to MPEG Selected Current MPEG Activities Req: MVS, MMT, AIT Sys: MPEG-M/-U/-V Vid: 3DVC, HVC Aud: SAOC Conclusions January 2010 2 Christian Timmerer, Klagenfurt University, Austria

5. Coding

7. Multimedia search engines

8. Content-based retrieval

10. MPEG-7: makes digital content searchable (value in the metadata!)

12. Media mining and decision support© John R. Smith, Tutorial at WWW’04

16. Application Programming Interfaces

17. Resource / quality management

18. Fault / integrity management

20. Sensory Information

22. MPEG-B/-C/-D: have fueled tremendous growth in digital media content

23. MPEG-E/-M: make standards accessible enabling tiny applications

24. MPEG-U/-V: increase the Quality of Experience

25. Elementary / Aggregated Services

28. Point & Find service by Nokia

29. kooaba application by kooaba ltd

31. Improve performance of mobile visual search applications

32. Facilitate efficient implementation of visual search functionality on mobile phoneshttp://www.chiariglione.org/mpeg/working_documents.htm#Explorations

33. MPEG Media Transport (MMT) January 2010 Christian Timmerer, Klagenfurt University, Austria 7 Requirements Multimedia Applications Objectives Efficient delivery of media Enable content and network adaptive Enable cross-layer optimization Support integrated services Support DRM tools Support content forwarding and retransmission Multimedia Applications MPEG Media Transport (MMT) MPEG Media Transport (MMT) MPEG Media Transport (MMT) Data Link Interface Timeline Call for Proposal in its next meeting in April 2010 Evaluation of submissions in its July 2010 meeting Phase I: Application layer protocols to be finalized by the first quarter of 2011 http://www.chiariglione.org/mpeg/working_documents.htm#Explorations

34. Advanced IPTV Terminal (AIT) January 2010 Christian Timmerer, Klagenfurt University, Austria 8 Requirements Aim: definition of elementary services with corresponding set of protocols and APIs to enable any user in an AIT value chain to access those services in an interoperable fashion. The service definition and its composition is also within the scope of AIT. An AIT value chain is a collection of Users, including Creators, End Users and Service Providers . Service: a set of content and functions to be offered to a User within the AIT value chain. Elementary Service: a service for which protocols and APIs are defined within AIT. Aggregated Service: two or more elementary services. http://www.chiariglione.org/mpeg/working_documents.htm#Explorations

35. AIT: Elementary Services January 2010 Christian Timmerer, Klagenfurt University, Austria 9 Requirements

37. Part 2 – MXM Application Programming Interfaces (APIs)

38. Part 3 – MXM Reference Software

40. MPEG-V: Media Context and Control (MCC) January 2010 Christian Timmerer, Klagenfurt University, Austria 12 Systems System Architecture Pt. 1: Architecture Pt. 2: Control Information Pt. 3: Sensory Information Pt. 4: Virtual World Object Characteristics Pt. 5: Data Formats for Interaction Devices Pt. 6: Common Types and Tools Pt. 7: Conformance and Reference Software http://www.chiariglione.org/mpeg/working_documents.htm#MPEG-V

42. Backward compatible w/ legacy devices

43. Agnostic of coding formats

44. Limited depth range (doesn’t handle occlusions)

45. ISO/IEC 14496-10 Amd: Multiview Video Coding (MVC)

46. Direct coding of multiple views

47. Exploits inter-camera redundancy

48. Rate of MVC encoded video is proportional to the number of viewshttp://www.chiariglione.org/mpeg/working_documents.htm#Explorations

49. High-performance Video Coding (HVC) Final CfP issued jointly: MPEG + VCEG Timeline 01/22-02/15: formal registration period (33 pre-registered) 02/22: coded test material shall be available at the test site 03/02: Start of subjective tests 04/12-13: registration/submission of documents 04/17: subjective test results available 04/17-23: evaluation of proposals at standardization meeting Test classes(* … only PSNR evaluation) Class A*: Cropped areas of size 2560x1600 (30fps): Class B: 1920x1080p 24 fps & 1920x1080p 50-60 fps Class C: 832x480p 30-60 fps (WVGA) Class D: 416x240p 30-60 fps (WQVGA) Class E: 1280x720p 60fps Testing fee: 8900 CHF plus 7.6% VAT Test coordinator: VittorioBaroncini (FUB) January 2010 Christian Timmerer, Klagenfurt University, Austria 14 Video Applications ➪ Everything but nothing new!? ➪ Just more performance!? Requirements ➪ Compression Performance ➪ Picture formats (8Kx4K) ➪ Color spaces + sampling ➪ Frame rates ➪ Scanning modes ➪ Complexity ➪ Low delay ➪ Random access, trick modes ➪ Error resilience ➪ Buffer models ➪ Interface to system layers ➪ Scalable Video Coding http://www.chiariglione.org/mpeg/working_documents.htm#Explorations

52. Backward compatibility with respect to existing trans- mission structureshttp://www.chiariglione.org/mpeg/working_documents.htm#MPEG-D

53. Conclusions What is MPEG and what are they doing (right now)? SDO in the area of multimedia coding & systems MVS, MMT, AIT, MXM, RMUI, MCC, 3DVC, HVC, SAOC, etc. Long time commitment but sustainability Next meeting: 19-23 April 2010, Dresden (not that far away) January 2010 Christian Timmerer, Klagenfurt University, Austria 16

54. Thank you for your attention ... questions, comments, etc. are welcome … Ass.-Prof. Dipl.-Ing. Dr. Christian Timmerer Klagenfurt University, Department of Information Technology (ITEC) Universitätsstrasse 65-67, A-9020 Klagenfurt, AUSTRIA christian.timmerer@itec.uni-klu.ac.at http://research.timmerer.com/ Tel: +43/463/2700 3621 Fax: +43/463/270099 3621 © Copyright: Christian Timmerer 17 January 2010 Christian Timmerer, Klagenfurt University, Austria