1. Digital Media Production Gastcollege – Nieuwe Media en Maatschappij

2. Quid VRT-Medialab? +/- 22 experts – research and development Member of international associations EBU (P/SCAIE, P/MAG, P/NP, P/HDTV,…) AMWA, SMPTE, IPTC, W3C Deliverables Expertise Proof of Concept Technology transfer

3. http://medialab.vrt.be

4. Table of Content Background – Digital Media Production Anno 2004 - The Digital Media Factory Reconciliation of requirements Creative staff Case 1 – Media Asset Management The consumer Case 2 – Non-linear Distribution The near future Case 3 – Computer Integrated Manufacturing

5. 2004...

6. 2004...

7. Background – Proof of Concept

9. Tape-less production

10. Re-purposing of material

11. Integrated system for radio,TV and online

12. Strategy - Generic if possible, specialised if required

13. Central storage services are the core of the architecture

14. The MAM system implements the central warehouse processes

15. State-of-the-art production systems are integrated with the MAM system

17. Lessons Learned There is a mismatch between business requirements and state-of-the-art technology; Media technology suppliers don’t acknowledge the limitations of IT technology; IT suppliers don’t sufficiently understand the requirements of (media) production; Re-using applications in a context which they have not originally been designed for is usually a sub-optimal solution; Proper reasearch and development are quintessential.

18. Online searching, re-viewing and cutting

19. One-click re-purposing of content

21. Single system for radio, tv and online

22. File-based production

23. Re-use of content

24. But – Needle in the haystack

25. Unstructured information

26. 10 times more items

27. No native file-based tools available

28. Media Asset Mgnt. - Effective re-use

29. Harvesting and Annotation

30. Search and Retrieval

31. Non-linear distribution

32. on demand

33. Personalisation

34. Computer Integrated Manufacturing

35. CAD – Computer Assisted Design

37. Media Asset Management Media Asset Management Production and distribution Infrastructure – Networks and Storage Production Platform

39. Redundant information – Overflow

40. ManualprocessingNewsroom Computer System

41. The problem (2) – videoprocessing « Prosperity in life istransitory and dependant on luck » The semantic gap -> interpretationis unique to audiovisual media -> The source of valuablemetadataisProduct Engineering -> Computer vision techniques canonlyrecogniselower-levelfeatures Allegory of Fortune, DossoDossi (Courtesy of the J.Paul Getty museum)

42. For example… Master Data Management Production and distribution Infrastructure – Networks and Storage Production Platform

43. The State of the Art archiefnummer : ALG 20010813 1 fragmentnummer : 1 reeks : 1000 ZONNEN EN GARNALEN bandnummer : E03024404 formaat : DBCM fragmenttitel : 1000 ZONNEN & GARNALEN beeld : KL/PALPLUS fragmentduur : 18 20 tekst : 0'00" TOERISTISCH REPORTAGEMAGAZINE OVERZICHT ONDERWERPEN GENERIEK TOERISTISCH REPORTAGEMAGAZINE, OVERZICHT ONDERWERPEN 0'50" VANDAAG : KUNSTENAAR LUC HOFKENS ONTWIERP EEN OASE OP ZIJN DAKTERRAS IN BORGERHOUT DIE DOET DENKEN AAN DE GRAND CANYON INTERVIEW MET LUC EN ZIJN VROUW MARILOU BUITENBEELD DAK MET OMGEVING BUITENKANT ARBEIDERSWONING, PANO OVER ROTSWANDEN, KRATEN MET WATER, BEPANTING, FOTOALBUM MET VERLOOP WERKEN 4'00" JUNIOR : KLAARTJE ALAERTS, 13 JAAR WIL ASTRONAUTEN WORDEN ZE BEZOEKT HETEUROSPACE CENTER METRUIMTEVEREN, RAKETTEN SIMULATIE IN RUIMTEVEER, INTERVIEW, HEEFT EEN UFO GEZIEN MAAKT ZELF KLEIN RAKETJE, SCHIET HET AF 7'50" DE SCHEURKALENDER : ARCHIEF RECLAMEFILM IBM INTERVIEW MAURICE DE WILDE, EERSTE PERSOONLIJKECOMPUTER trefwoorden : BELGIE; BORGERHOUT; ARTIEST; OASE; KUNST; GRAND CANYON (NATUURGEBIED); DAK; TERRAS; INTERVIEW; EURO SPACE CENTER; RUIMTEVAART; PC; BOOTTOCHT; RIJKDOM; PASSAGIER; GASTRONOMIE; RESTAURANT; PERSONEEL; VAKANTIE; BINNENBEELD; SCHIP; BECKERS LEEN; VRT; LOTTO; RADIOOMROEPSTER; KLANKSTUDIO; UITVINDING; BARBECUE; BETONMOLEN; IBM; RECLAMESPOT rechthebbende : VRT Opzoekscherm FILM Set: 16 Aantal: 1 blz 1 van 3 trefwoorden: ibm and vrt archiefnummer: - uitzendjaar: maand: dag: fragmentnummer: fragmentduur: reeks: formaat: bandnummer: aflevering: afleveringsnummer: programma: uitzenddatum: fragmenttitel: tekst: kategorie: opnamedatum: opnamenummer: journalist: rechthebbende: SETS The strings required for the operation are not defined F11 F12 F13 F14 F17 F18 F19 F20 Ent Eindigen Sets Refset Toon Vorige Volg/Leeg Thesaurus Commando Opzoeken

45. Proof of Concept

46. Shot Segmentation and Scene Recognition

47. Face recognition and identification

49. Linking stories over time

51. No upfront selection - information overload;

52. Multiple sources of more or less structured metadata;

53. Parallel sources cause dupplicates;

55. 80% of the context is in the speech

56. Machines may recognise more objects

58. An item is relevant or it is not;

59. Retrieve all relevant items;

60. No false positivesProduction Platform

63. In professional context, it is key to trace dependencies between objects. Hence, as opposed to any conventional approach, a search engine must integrate information rather than to index multiple sources;

64. Computer Vision does not replace formal annotation, but substantially accelerates the process and increases the accuracy! A consistent application framework and proper user-interfaces are the key to effective re-use and supply chain integration in general. (≠ Digitizing analogue and disintegrated workflows)

65. Case 2 – Non-linear Distribution Data Video Audio Communication (Information) Master Data Management Meta Data Meta Data Production and distribution Infrastructure – Networks and Storage Digital Broadcasting via DVB, IP or other Production Platform

69. 1914 – First radio broadcast

70. 1937 – Die Volksempfaenger

71. 1955 - Mobile radio...

72. Digital Broadcasting – Que?

73. 2004 – Live Streaming

74. Porting the radioplayer...

75. Porting the radioplayer...

77. Currently over 60.000 installations

78. 2500 users per day

81. Watch anytime - BBC iPlayer

84. On demand complements live offering

86. Internet - Seamless integration of live and on demand

89. Short attention span, high level of attention

90. Impulse-driven

92. Adaptive streaming enables bandwidth-friendly distribution

93. Excellent quality where possible, lower bit-rate if necessary

94. Open distribution frameworkhttp://myradio.vrt.com

97. Speech recognition and indexing

100. Trend - From « metadata » to CAD/CAM ?

101. Case 3 – Computer Integrated Manufacturing

102. State of the Art

103. Use Case – Drama Production

104. Proof of Concept - Scoop http://www.youtube.com (search for “scoop”, “ibbt”, “CAD”)

105. 54 http://medialab.vrt.be http://myradio.vrt.be Maarten.verwaest@vrt.be