2. Background
Aalto University School of Science and Technology
Department of Information and Computer Science
(http://ics.hut.fi/ )
Adaptive Informatics Research Centre, Academy CoE
(http://www.cis.hut.fi/research/ )
Erkki Jorma Ville Mats He Xi Jing
Oja Laaksonen Viitaniemi Sjoberg
¨ Zhang Chen Wu
(2/20)
3. Overview of my talk
• Introduction
• Concept-based video search
• Video summarization
• Video analysis in AR applications
(3/20)
8. Types of video material
Shot-based video, obtained with
shot boundary detection
Continuous material, sampled
with regular interval
Online video, received one frame
at a time
(8/20)
9. Shot-based video indexing
video shot
...missile Motion SOM
launch...
keyframe audio text Temporal Color SOM
binary keyword
Texture SOM Color SOM Audio SOM Word histogram Keyword freq. inverted file
(9/20)
12. Concept ontologies
sports weather court office meeting studio outdoor building desert
vegetation mountain road sky snow urban waterscape/ crowd face
waterfront
person police/ military prisoner animal computer/TV US flag airplane car
security screen
bus truck boat/ship walking/ people explosion/ natural maps charts
running marching fire disaster
(12/20)