7. Analyze & Report
Discover & Explore
Structured Semi-Structured Unstructured
SQL SQL++ Java/C++/Pig/Hive
Production Data Warehousing Contextual-Complex Analytics Structure the Unstructured
Large Concurrent User-base Deep, Seasonal, Consumable Data Sets Detect Patterns
Data Warehouse Data Warehouse + Hadoop
Behavioral
Enterprise-class System Low End Enterprise-class System Commodity Hardware System
8+PB 60+PB 40+PB
10. Data
questions later
structure later
(<$0.04/GB, <$80/2TB)
single HDFS instances >50PB
Value > Cost 10
11. Designing for the Unknown
>85% of analytical workload is NEW & Unknown
The metrics you know are cheap
The metrics you don’t know are expensive – but high in potential ROI
Exploration & Testing are core pillars of an analytics-driven
organization
18. Value > Cost
$’s per year in incremental revenue
www.wallpapertimes.com
19.
20.
21. Toys and Hobbies
ATC > Artist trading card in ART
ATC > Automatic Tool Change in Business and Industrial
22. German Compound Words
• German compound words can be arbitrarily created and extremely long
Adidastrainingsanzug (Adidas track suit)
Rindfleischetikettierungsüberwachungsaufgabenübertragungsgesetz
(beef labeling regulation & delegation of supervision law)
• Syntactically, words can be combined and split in many ways.
• Some words shouldn’t be de-compounded.
beiden (both) – bei(at) den(the)
• Too many candidates for
Granitpflastersteine (granite paving stones)
Granit(granite) pflastersteine(cobblestones)
Granit(granite) pflaster(paving/band-aid) steine(stones)
• Binding characters
Hochzeitsschuhe (grammatically correct, 593 hits on ebay.de)
Hochzeitschuhe (129 hits on ebay.de).
23. Synonyms
derived
from
top
queries
in
item
query
clusters
texas
instruments
ba
ii
plus
/
ba
ii
plus
brighton
handbag
brighton
purse
lenovo
x200
thinkpad
x200
king
bedspread
king
coverlet
rockabilly
dress
swing
dress
1963
ford
falcon
63
falcon
jessica
simpson
hair
extensions
jessica
simpson
hairdo
Abbrevia7ons/acronym
derived
from
query
transi7ons
stanford
ky
stanford
kentucky
dc
sub
dc
subwoofer
snowboard
helmet
l
snowboard
helmet
large
motorcycle
cam
motorcycle
camera
diamond
amp
diamond
amplifier