What to do when one size does not fit all?!

What to do when one size does not fit all?! Arjen P. de Vries [email_address] Centrum Wiskunde & Informatica Delft University of Technology Spinque B.V.

Core Questions ,[object Object],[object Object],[object Object],[object Object],[object Object]

Complications ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Complications ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Complications ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Tweets about blip.tv ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Even More Complications ,[object Object],[object Object],[object Object],[object Object],[object Object]

The one size fits all "semantically enhanced retrieval model“? BM25 BM25F LM RM VSM DFR QIR? Learning to rank? Document Collection: Anchors Entity types Sentiment Tweets Cited documents … Context User Ran ked list of answers

http://www.hellokids.com/c_19938/coloring-page/holiday-coloring-pages/easter-coloring-pages/jesus-coloring-pages/the-holy-grail-coloring-page

Parameterised Search System Cannot we ‘remove’ this IR engineer from the loop, like DBMS software removes the data engineer from the loop? Cornacchia, De Vries, ECIR 2007 A Parametrised Search System

Search by Strategy ,[object Object]

Search by Strategy ,[object Object],[object Object]

BBs and typed pins ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],BB 1 (in 1 ,in 2 ,in 3 , u 1 ,u 2 ) in 1 in 2 in 3 out BB 2 (in 1 ) in 1 out

From Strategies to DB Queries ,[object Object],[object Object],[object Object],CREATE VIEW a AS SELECT .. CREATE VIEW b AS SELECT .. CREATE VIEW c AS SELECT .. Strategy Relational DB BB 1 (in 1 ,in 2 ,in 3 , u 1 ,u 2 ) in 1 in 2 in 3 out BB 2 (in 1 ) in 1 out

Probabilistic Relational Algebra Strategy Relational DB ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

SpinQL, the sneak preview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What’s in the DB? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],T D f t 0 d 3 3 t 0 d 5 10 t 1 d 2 4 subj pred/attr obj/value p Arjen speaks_to you 0.95 you follow Arjen 0.5 speech minutes 45 0.8 Img_id f 1 … f N 0 0.12 … 0.84 1 0.54 … 0.31 2 0.23 … 0.1

VIEWS and TABLES ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],CREATE VIEW a AS SELECT … FROM term-doc … ; CREATE VIEW b AS SELECT … FROM a WHERE a.x = u 1 ; CREATE VIEW c AS SELECT … FROM a WHERE a.x = 42 ; CREATE VIEW d AS SELECT … FROM b … ; CREATE TABLE a AS SELECT … FROM term-doc … ; CREATE VIEW b AS SELECT … FROM a WHERE a.x = u 1 ; CREATE TABLE c AS SELECT … FROM a WHERE a.x = 42 ; CREATE VIEW d AS SELECT … FROM b … ; User parameter Stored relation No user parameter Pre-computable relation

Exploratory Search ,[object Object],[object Object],[object Object],[object Object],[object Object]

Probabilistic faceted browsing ,[object Object],[object Object],[object Object],[object Object],[object Object],Price ,[object Object],[object Object],[object Object],Rooms ,[object Object],[object Object],[object Object],Size ,[object Object],[object Object],[object Object],Price ,[object Object],[object Object],[object Object],Rooms ,[object Object],[object Object],[object Object],Size ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Dynamic facets ,[object Object],[object Object],[object Object],[object Object],[object Object],Price ,[object Object],[object Object],[object Object],Rooms ,[object Object],[object Object],[object Object],Size ,[object Object],[object Object],[object Object],Price ,[object Object],[object Object],[object Object],Rooms ,[object Object],[object Object],[object Object],Size ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Probabilistic facets and strategies (current) ,[object Object],[object Object],[object Object],Price ,[object Object],[object Object],[object Object],Rooms ,[object Object],[object Object],[object Object],Size ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Original strategy ,[object Object],[object Object],[object Object],Size ,[object Object],[object Object],[object Object],Price ,[object Object],[object Object],[object Object],Rooms

Probabilistic facets and strategies (better) ,[object Object],[object Object],[object Object],Price ,[object Object],[object Object],[object Object],Rooms ,[object Object],[object Object],[object Object],Size ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Original strategy 20% 50% 30% Mix ,[object Object],[object Object],[object Object],Size ,[object Object],[object Object],[object Object],Price ,[object Object],[object Object],[object Object],Rooms

Mixing probabilistic data streams ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],20% 50% 30% Mix

Mixing probabilistic data streams in RA ,[object Object],[object Object],[object Object],α 1 S 1 α 2 S 2 S 1 S 2 id p id 0 0.2*0.1 = 0.02 id 1 0.2*0.7 = 0.14 id 2 0.2*0.9 = 0.18 id 0 0.8*0.2 = 0.16 id 2 0.8*1.0 = 0.8 id p id 0 0.02 + 0.16 = 0.18 id 1 0.14 id 2 0.18 + 0.8 = 0.26 20% 80% Mix id p id 0 0.1 id 1 0.7 id 2 0.9 id p id 0 0.2 id 2 1.0 Inputs Union( α 1 S 1 ,…, α n S N ))) Sum( p , GroupBy( id))

Mixing probabilistic data streams in RA ,[object Object],[object Object],[object Object],[object Object],S 1 S 2 20% 80% Mix id p id 0 0.1 id 1 0.7 id 2 0.9 id p id 0 0.2*0.1 + 0.8*0.2 = 0.18 id 1 0.2*0.7 = 0.14 id 2 0.2*0.9 + 0.8*1.0 = 0.26 id p id 0 0.2 id 2 1.0 id p 1 p 2 id 0 0.1 0.2 id 1 0.7 id 2 0.9 1.0 Inputs OuterJoin( id 1 =… id n , ( S 1 ,…,S N )) Project( α 1 p 1 +…+ α N p N )

Limitations Search & Browse ,[object Object],[object Object],[object Object]

Who needs a Join? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

1. Which universities/colleges hold patents? 2. Who are the inventors named in those patents? 3. Which inventors are active in the area of our company? Real-life patent search example: Which researchers associated to universities and colleges should our Human Resources manager know to hire the right people on time?

How Strategies Help ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Conclusion ,[object Object],[object Object]

Search Intermediaries ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Task complexity

Research Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Current Situation ,[object Object],[object Object],[object Object],[object Object],[object Object],Search & explore Schema definition

Desirable Situation ,[object Object],[object Object],[object Object],[object Object],[object Object],Mixed Initiative Schema definition Search & explore

Interactive Information Access ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What to do when one size does not fit all?!

Recommended

Recommended

More Related Content

What's hot

What's hot (9)

Viewers also liked

Viewers also liked (8)

Similar to What to do when one size does not fit all?!

Similar to What to do when one size does not fit all?! (20)

More from Arjen de Vries

More from Arjen de Vries (20)

Recently uploaded

Recently uploaded (20)

What to do when one size does not fit all?!

Editor's Notes