Semantic interface for multimedia browsing. Poster for the demo at ACM Multimedia 2010 International Conference

1. Web-based semantic browsing of video collections
using multimedia ontologies
Marco Bertini, Gianpaolo D’Amico, Andrea Ferracani, Marco Meoni and Giuseppe Serra
Media Integration and Communication Center, University of Florence, Italy
Semantic browing tool
• Interactive and user friendly content-based
semantic browsing of video collections
• Concept cloud view for the concepts with
more instances
• Graph representation of semantic structure
of ontology that describe the video domain
• Support for multiple ontologies browsing
and ontology reasoning
• Thumbnails view of the instances of each
concept that is annotated
Interactive multimedia access
• Access to video metadata and video
streaming from the in a large video player.
The video player shows the position of the
concept within the whole video.
• Multiple automatic layout algorithms for
spatial positioning and manual drag & drop
• Efficient web-based interface, using the
Rich Internet Application paradigm (RIA)
Second prize in the Adobe YouGC contest, RIA
category
Related contents
• Access to the related contents of the concept from different sources, differing from each other by color
• Enrichment of information with associated material. Improve information completeness and increase user’s
knowledge with a larger number of information sources
• The system uses the publicly available APIs of YouTube as source of video contents, Flickr for images and
pictures and Twitter for social and real-time content.
TM
Acknowledgments: This work was partially supported by the EU IST Vidi- Video project (www.vidivideo.info - contract FP6-045547) and EU IST IM3I project
(http://www.im3i.eu/ - contract FP7-222267). The authors thank Nicola Martorana for his help in software development.
ACM Multimedia 2010 - DEMO Program http://www.micc.unifi.it/ {bertini, damico, ferracani, meoni, serra}@dsi.unifi.it