FIAT/IFTA World Conference 2015 Vienna

1. Mediateka
Digital archive
Bojan Kosi

2. RTV Slovenia
26.11.2015 2Mediateka RTV Slovenija
• three national radio channels
• three national TV channels
• radio and TV channels for the Italian and Hungarian minorities
• radio and TV channels for Slovenian minorities in Italy and Hungary
• radio an TV programmes for Romany community
• radio channel for foreign audience
• teletext, internet and mobile
• symphony orchestra, big band, choirs
• label company

3. Archive in 2012
26.11.2015 3Mediateka RTV Slovenija
carriers/meters hours % hours
1 2 3 4=(2*3)
Audio tape Rtv Slo 200.000 150.000 100 % 150.000
CD & CDR Rtv Slo + others 70.000 55.000 60 % 33.000
DAT Rtv Slo 10.000 15.000 100 % 15.000
files Rtv Slo 80.000 50.000 100 % 50.000
Total 360.000 270.000 248.000
Videotape Betacam (+SP) Rtv Slo + others 59.800 75.800 75 % 56.850
Videotape Digital Betacam Rtv Slo 620 720 100 % 720
Videotape MPEG IMX Rtv Slo 14.200 20.800 100 % 20.800
DVC Pro Rtv Slo 2.380 4.500 100 % 4.500
Videotape MGS 1" Rtv Slo 11.000 19.300 100 % 19.300
Total 88.000 121.120 102.170
Film - B&W Rtv Slo 12.820.000 18.700 100 % 18.700
Film - Color Rtv Slo 7.210.000 10.500 100 % 10.500
Perforated magnetic tape Rtv Slo 6.800.000 9.900 100 % 9.900
Total 26.830.000 39.100 39.100
for digitization
Video
Audio
Media type Carrier type Production
Archive content
Film

4. Mediateka - Digital archive
11/26/2015 4Mediateka RTV Slovenija
Management and development:
- workflow management and system development
Ingest:
- digitizing, ingesting and archiving
Catalogue:
- virtual segmentation and metadata annotating
Restoration:
- physical carrier restoration

5. Mediateka
Digital archive
Physical archives
Production systems
New relations
11/26/2015 5Mediateka RTV Slovenija
Archive system
(Ingest & MAM & storage)
Ljubljana
Koper Ljubljana Maribor Lendava
old
database
Koper
migration
ingest ingestingestingest
exchange
Lendava
exchangeexchange
Maribor

6. 26.11.2015 6Mediateka RTV Slovenija
Archive MAM
differs from
production MAM.

7. … and workflows are the key solution…
26.11.2015 7Mediateka RTV Slovenija

8. Workflows are the key solution…
11/26/2015 8Mediateka RTV Slovenija
Usually over 3.000 flows are managed simultaneously from Archive MAM:
• digitizing / ingesting contents from physical carriers
• daily created digital content ingesting,
• cataloguing
• ordering and distribution
• meta data extraction
• informing the users

9. 26.11.2015 9Mediateka RTV Slovenija
Audio

10. Audio digitization project… DONE!
11/26/2015 10Mediateka RTV Slovenija
• 2002-2004 Searching the solution, preparing the project
• 2005 Ingest system tender
• 2006 Archive MAM system tender
• 2007 Configuring and testing the system and workflows
• 2008-2014 Massive digitization phase
carriers hours % hours
1 2 3 4=(2*3)
Audio tape Rtv Slo 200.000 150.000 100 % 150.000
CD & CDR Rtv Slo + others 70.000 55.000 60 % 33.000
DAT Rtv Slo 10.000 15.000 100 % 15.000
files Rtv Slo 80.000 50.000 100 % 50.000
Total 360.000 270.000 248.000
for digitization
Audio
Media type Carrier type Production
Archive content

11. 26.11.2015 11Mediateka RTV Slovenija
Videotape

12. Videotape digitization project
11/26/2015 12Mediateka RTV Slovenija
• 2013 Searching the solution, preparing the project
• 2014 Ingest & MAM system upgrade
• 2015 Configuring and testing the workflows
• 2015-2021 Massive digitization phase
carriers hours % hours
1 2 3 4=(2*3)
Videotape Betacam (+SP) Rtv Slo + others 59.800 75.800 75 % 56.850
Videotape Digital Betacam Rtv Slo 620 720 100 % 720
Videotape MPEG IMX Rtv Slo 14.200 20.800 100 % 20.800
DVC Pro Rtv Slo 2.380 4.500 100 % 4.500
Videotape MGS 1" Rtv Slo 11.000 19.300 100 % 19.300
Total 88.000 121.120 102.170
for digitization
Video
Media type Carrier type Production
Archive content

13. Videotape – general flow
26.11.2015 13Mediateka RTV Slovenija
Mediateka – Digital archiveTV archive
Cleaning
&
checking
Selecting
&
preparing
tapes
QC
Virtual
segmentation
&
Cataloguing
Digitizing
&
Ingesting

14. Videotape – Ingest
26.11.2015 14Mediateka RTV Slovenija

15. Videotape – Ingest flow
26.11.2015 15Mediateka RTV Slovenija

16. Videotape – Long term archive format… FFV1
26.11.2015 16Mediateka RTV Slovenija
• open source and available under GNU LGPL,
• hardware independent,
• able to support the 4:3, 16:9 and other picture format,
• able to support SD, HD, 2K and other resolutions,
• able to map all current colorspaces, including subsampling options,
• mathematically lossless (when encoding),
• playable with standard player, without extra payable decoders
• …

17. Ingest & MAM & storage
26.11.2015 17Mediateka RTV Slovenija

18. 26.11.2015 18Mediateka RTV Slovenija
Film

19. Film restoration & digitization project
11/26/2015 19Mediateka RTV Slovenija
• 2013 Searching the solution, preparing the project
• 2014 Film scanner tender, Ingest & MAM system upgrade
• 2015 Configuring and testing the workflows
• 2015-2040 Restoration & digitization phase (25 years)
Estimated labour cost: 7.000.000 EUR (~180 EUR per hour)
meters hours % hours
1 2 3 4=(2*3)
Film - B&W Rtv Slo 12.820.000 18.700 100 % 18.700
Film - Color Rtv Slo 7.210.000 10.500 100 % 10.500
Perforated magnetic tape Rtv Slo 6.800.000 9.900 100 % 9.900
Total 26.830.000 39.100 39.100
for digitization
Film
Media type Carrier type Production
Archive content

20. Film
11/26/2015 20Mediateka RTV Slovenija

21. Film – Vinegar syndrom
11/26/2015 21Mediateka RTV Slovenija

22. Film – general flow
26.11.2015 22Mediateka RTV Slovenija
MediatekaTV Arhiv
Restoration
& cleaning
(film)
Restoration
(perfo)
Selecting
&
preparing
the
material
Digitization
(film)
Cataloguing
Picture
QC
Digitization
(perfo)
Audio
QC

23. Film – restoration
26.11.2015 23Mediateka RTV Slovenija

24. Film – restoration & jumbo role
26.11.2015 24Mediateka RTV Slovenija

25. Film – jumbo role
26.11.2015 25Mediateka RTV Slovenija

26. Film –jumbo role
26.11.2015 26Mediateka RTV Slovenija

27. Film – jumbo role types
26.11.2015 27Mediateka RTV Slovenija

28. Film – jumbo role types
26.11.2015 28Mediateka RTV Slovenija
B&W films
ORIGINALS
1 REVERSAL - MUTE
2 REVERSAL - SEPMAG
3 REVERSAL - COMMAG rare
4 NEGATIVE - MUTE
5 NEGATIVE - SEPMAG rare
PRINTS
6 PRINTS - MUTE
7 PRINTS - COMOPT
8 PRINTS - SEPMAG
9 PRINTS - COMMAG rare
PERFORATED MAGNETIC TAPES
COLOR films
ORIGINALS
1 REVERSAL - MUTE
2 REVERSAL - SEPMAG
3 REVERSAL - COMMAG rare
4 NEGATIVE - MUTE
5 NEGATIVE - SEPMAG rare
PRINTS
6 PRINTS - MUTE
7 PRINTS - COMOPT
8 PRINTS - SEPMAG
9 PRINTS - COMMAG rare
PRINTS (ORANGE MASK)
10 PRINTS - MUTE
12 PRINTS - SEPMAG

29. Film – scanning
26.11.2015 29Mediateka RTV Slovenija
• DPX
• 2K
• 10bit log
• QC
• segmentation (EDL)
• making TAR packages (automated)
• no digital restoration
• no color correction (no grading)

30. Film – file ingest flow (MAM)
26.11.2015 30Mediateka RTV Slovenija
• extracting DPX from TAR package
• checking timecode and frame number
• encoding mezzanine video & merging audio
• analysing & keyframes
• Human QC
• Encoding FFV1 & proxy
• Sending to the storage (DPX & FFV1 & proxy)

31. Film – MediaFormats example
26.11.2015 31Mediateka RTV Slovenija

32. Storage (audio & video & film)
26.11.2015 32Mediateka RTV Slovenija
• HSM (online – nearline – offline)
• LTO6, up to 30 PB in 25 years

33. Access
26.11.2015 33Mediateka RTV Slovenija

34. Metadata objects
Serie
Programme
26.11.2015 34Mediateka RTV Slovenija
Project
Playout slot
Schedule
Carrier
Playout slot
Spored
Entity
Entity
Avtor
Izvajalec
Contract