CUbRIK application for Digital Humanities illustrated during the demo session of the International Workshop on Multimedia Signal Processing IEEE MMSP 2013

1. CUbRIK Presentation 0
Combining human and machine
computation for the digital humanities
Demo session at MMSP‘13

2. CUbRIK in a nutshell
CUbRIK Presentation 1
Open Entities Repository
Space/Location Awareness
Time Awareness
Increase multimedia content processing automatic computation ability
Games
Q&A
Crowdtasks
Open to hybrid workflows
Humans in the loop
Machine tasks
Human tasks
Social tasks
Solve uncertainty from automatic computation using collective intelligence
Open to plug-in
Off-the-Shelf open source
From R&D projects
3rdParty
Open to algorithms
Open to components
White box MM search
Processing
Indexing

3. CUbRIK
CUbRIK Presentation 2

4. Humans in the loop
CUbRIK Presentation 3
Raw content
High level features
(automatic annotations)
Conflict
(e.g., “Image contains
‘Romano Prodi’ ”
Confidence = low)
?
Conflict store
Conflict manager
Conflict resolution
task store
Conflict resolution
task: conflict,
required skill, priority, ..
CUbRIK app for Conflict resolution
Game
Q&A
Crowdtask

5. CUbRIK Presentation 4
Context

6. Goals

New tool for research and exploration ofmultimedia collections

Based on two focus groups, two dedicated roundof user interviews and an online questionnaire

Showcases integration of CUbRIK components

Status Y2 of 3
CUbRIK Presentation 5

7. User Story: Who is this person? Tell me more!
6

8. Conclusion & Outlook

Very specific challenges

What is truth? Humanities vs. Computer Science

Gathering requirements for tools that haven‘t beendeveloped yet

Engaging crowds

Image copyrights

Refinement of the application

Additional datasources

Improvement of the interface

Integration of the different components
7

9. WWW.CUBRIKPROJECT.EU
Visit us on
8
@CUBRIKPROJECT
Or follow us on Twitter