Batch Querying with Cascading

Batch Querying with Cascading Nathan Marz Rapleaf

Batch Querying ,[object Object],[object Object]

Motivation ,[object Object],[object Object],[object Object]

Motivation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Records Keys ,[object Object],[object Object],[object Object],[object Object],Results

Features ,[object Object],[object Object],[object Object],[object Object]

Algorithm #1 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Algorithm #1 (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Algorithm #1 (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Algorithm #1 (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Input Output

Algorithm #2 (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Algorithm #2 (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Algorithm #2 (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],It works!

Algorithm #2 Analysis ,[object Object],[object Object],[object Object]

Speeding it up ,[object Object],[object Object]

Algorithm #3 ,[object Object],[object Object],[object Object],[object Object]

Algorithm #3 (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Algorithm #3 (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Algorithm #3 (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Interface Two M/R jobs with filter One map-only job (false positives) Two M/R jobs (no filter)

Interface One M/R job with filter One map-only job (false positives) One M/R job (no filter)

Finishing Touches ,[object Object],[object Object]

Limitations ,[object Object],[object Object],[object Object]

Batch Querying with Cascading

Recommandé

Recommandé

Contenu connexe

En vedette

En vedette (20)

Dernier

Dernier (20)

Batch Querying with Cascading