The document discusses OmniMedia's intelligent rich media search platform. It aims to make multimedia like images and videos searchable for e-learning applications. The solution involves a community-based video editing platform that exposes descriptive text searchable metadata to any digital video. It takes an automated but collaborative approach to metadata generation between artificial and human intelligence. The technology reduces costs by facilitating incremental, collaborative learning and knowledge sharing through open communities.
13. Image Recognition Input image Texture Based Classification Tree / Not-Tree Classification Feature Vector Decision Input Image Shape Based Classification car car ped Biological Model Feature Extraction Car / Not-Car Classification Feature Vector Decision
17. Clustering – add contextual info http://eigencluster.csail.mit.edu/
18. Interdisciplinary framework (hybrid solution) OMNIMedia Cluster Algorithm OMNIMedia platform Auto-generate Initial Metadata Add contextual Info to further enhance metadata User enriched Media content Metadata – fine Tune the image Recognition engine Computer Vision (Image recognition)
19. Online Content Delivery Stack MySpace Operating System Browser ??? MLB.com YouTube etc G o o g l e WWW Internet
20. Online Content Delivery Stack Semantic Web / Metadata layer Internet OS (Browser and OS converge) Search www Internet G o o g l e OMNIMedia MySpace MLB.com YouTube etc ?
21. Technology Diffusion Web 2.0 services -> applications on InternetOS Data-driven G o o g l e OMNIMedia
Searchable video stream Non-linear video content access Crawlable - Video content -> text -> publish to web and crawled by search engine such as Google (and use Search Optimization technique) Dynamic - insert Ad (use image detection to detect sponsor images (e.g. ketchup) and dynamically insert link inside the video) Linkable - insert link (from one region of a frame in a clip to another frame in another clip – hypermedia) Unobtrusive - insert Text Ads to the clip on the side instead of a short clip at the opening