SlideShare une entreprise Scribd logo
1  sur  24
Télécharger pour lire hors ligne
!
        !
        !




CloudCon, Tuesday, October 2nd, 11am
Every Second – in over thousands of Categories
Value > Cost
                         $’s per year in incremental revenue




www.wallpapertimes.com
Big
Detail
incremental   storage


                            Volume

                            DATA
    structured    Variety            Velocity      processing
semi-structured
                                                change
        un-structured
Analyze & Report
                                                                         Discover & Explore


      Structured                               Semi-Structured                                  Unstructured
         SQL                                       SQL++                                      Java/C++/Pig/Hive
Production Data Warehousing                Contextual-Complex Analytics                       Structure the Unstructured
Large Concurrent User-base             Deep, Seasonal, Consumable Data Sets                        Detect Patterns




  Data Warehouse                            Data Warehouse +                                         Hadoop
                                               Behavioral



Enterprise-class System                Low End Enterprise-class System                    Commodity Hardware System



        8+PB                                      60+PB                                              40+PB
!    Data Growing Faster
Data


         questions later
         structure later



              (<$0.04/GB, <$80/2TB)

single HDFS instances >50PB




Value > Cost                          10
Designing for the Unknown
>85% of analytical workload is NEW & Unknown

The metrics you know are cheap

The metrics you don’t know are expensive – but high in potential ROI

Exploration & Testing are core pillars of an analytics-driven
  organization
•    Impact
!"#$   %$&               '()*+,"-+       .-)/01$2&   3-#$
4!     5"*2"$,           5"*2&
4!     6*77"$,           6*77&
4!     82*+6$22"$,       82*+6$22&
4!     9-77"+7           9-7
4!     :",;"+7/,#"8<$2   :",;/,#"8<$2,
4%     )*+$=,            )*+$=="+7
4%     )2-#$8#"-+        )2-#$8#$2
4%     ="+"+7            ="+$5
4%     *+">*#"-+         *+">*#$5
4%     #218<,            #218<"+7
4%     $57"+7            $57$,
4%     +$#,              +$##"+7
!"#$   %$&               '()*+,"-+       .-)/01$2&                      3-#$
4!     5"*2"$,           5"*2&           6*7)"2$/5"*2"$,
4!     8*99"$,           8*99&           )*#*9-+"*/8*99"$,              9--5/:-2/)*#*9-+"*/8*99&;/+-#/9--5/*<-+$
4!     =2*+8$22"$,       =2*+8$22&       #>$/=2*+8$22"$,
4!     ?-99"+9           ?-9             ?-99"+9/,#2-<<$2
4!     :",>"+9/,#"=@$2   :",>/,#"=@$2,   :",>"+9/,#"=@$2                ,)-2#,/6,A/@"5,/2--7,
4%     )*+$<,            )*+$<<"+9       :$+=$/)*+$<,
4%     )2-#$=#"-+        )2-#$=#$2       7=*:$$/#-#*</)2-#$=#"-+/BCDB   ,=2$$+/)2-#$=#$2/",/#-)/4!/E1$2&
4%     <"+"+9            <"+$5           )"+@/<"+"+9/=>*+9"+9/8*9
4%     *+"7*#"-+         *+"7*#$5        *+"7*#"-+/=$<
4%     #21=@,            #21=@"+9        =-29"/#21=@,
4%     $59"+9            $59$,           9*25$+/$59"+9
4%     +$#,              +$##"+9         )12,$/+$#,
Value > Cost
                         $’s per year in incremental revenue




www.wallpapertimes.com
Toys and Hobbies
ATC   >   Artist trading card   in ART
ATC   >   Automatic Tool Change in Business and Industrial
German Compound Words
 •    German compound words can be arbitrarily created and extremely long
          Adidastrainingsanzug (Adidas track suit)
          Rindfleischetikettierungsüberwachungsaufgabenübertragungsgesetz
                   (beef labeling regulation & delegation of supervision law)
 •    Syntactically, words can be combined and split in many ways.
 •    Some words shouldn’t be de-compounded.
          beiden (both) – bei(at) den(the)
 •    Too many candidates for
          Granitpflastersteine (granite paving stones)
          Granit(granite) pflastersteine(cobblestones)
          Granit(granite) pflaster(paving/band-aid) steine(stones)
 •    Binding characters
      Hochzeitsschuhe (grammatically correct, 593 hits on ebay.de)
      Hochzeitschuhe (129 hits on ebay.de).
Synonyms	
  derived	
  from	
  top	
  queries	
  in	
  item	
  query	
  clusters	
  
texas	
  instruments	
  ba	
  ii	
  plus	
  
                                          /	
  ba	
  ii	
  plus	
  
brighton	
  handbag	
                     brighton	
  purse	
  
lenovo	
  x200	
                          thinkpad	
  x200	
  
king	
  bedspread	
                       king	
  coverlet	
  
rockabilly	
  dress	
                     swing	
  dress	
  
1963	
  ford	
  falcon	
                  63	
  falcon	
  
jessica	
  simpson	
  hair	
  extensions	
  
                                          jessica	
  simpson	
  hairdo	
  
                                        	
  
              Abbrevia7ons/acronym	
  derived	
  from	
  query	
  transi7ons	
  
stanford	
  ky	
                          stanford	
  kentucky	
  
dc	
  sub	
                               dc	
  subwoofer	
  
snowboard	
  helmet	
  l	
                snowboard	
  helmet	
  large	
  
motorcycle	
  cam	
                       motorcycle	
  camera	
  
diamond	
  amp	
                          diamond	
  amplifier	
  
CloudCon Data Mining Presentation

Contenu connexe

Similaire à CloudCon Data Mining Presentation

The Enterprise Architecture You Always Wanted
The Enterprise Architecture You Always WantedThe Enterprise Architecture You Always Wanted
The Enterprise Architecture You Always Wanted
Thoughtworks
 
Call Tracking with Twilio - Cloudstock 2010
Call Tracking with Twilio - Cloudstock 2010Call Tracking with Twilio - Cloudstock 2010
Call Tracking with Twilio - Cloudstock 2010
Twilio Inc
 
Visual Studio 2013, Xamarin and Microsoft Azure Mobile Services: A Match Made...
Visual Studio 2013, Xamarin and Microsoft Azure Mobile Services: A Match Made...Visual Studio 2013, Xamarin and Microsoft Azure Mobile Services: A Match Made...
Visual Studio 2013, Xamarin and Microsoft Azure Mobile Services: A Match Made...
Rick G. Garibay
 

Similaire à CloudCon Data Mining Presentation (20)

The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director...
The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director...The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director...
The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director...
 
The Enterprise Architecture You Always Wanted
The Enterprise Architecture You Always WantedThe Enterprise Architecture You Always Wanted
The Enterprise Architecture You Always Wanted
 
AWS Elastic Beanstalk
AWS Elastic BeanstalkAWS Elastic Beanstalk
AWS Elastic Beanstalk
 
Web mapping with vector data. Is it the future ? 2012
Web mapping with vector data. Is it the future ? 2012Web mapping with vector data. Is it the future ? 2012
Web mapping with vector data. Is it the future ? 2012
 
HTML5 & Friends
HTML5 & FriendsHTML5 & Friends
HTML5 & Friends
 
Call Tracking with Twilio - Cloudstock 2010
Call Tracking with Twilio - Cloudstock 2010Call Tracking with Twilio - Cloudstock 2010
Call Tracking with Twilio - Cloudstock 2010
 
The Enterprise Architecture you always wanted: A Billion Transactions Per Mon...
The Enterprise Architecture you always wanted: A Billion Transactions Per Mon...The Enterprise Architecture you always wanted: A Billion Transactions Per Mon...
The Enterprise Architecture you always wanted: A Billion Transactions Per Mon...
 
OSGI workshop - Become A Certified Bundle Manager
OSGI workshop - Become A Certified Bundle ManagerOSGI workshop - Become A Certified Bundle Manager
OSGI workshop - Become A Certified Bundle Manager
 
Device deployment
Device deploymentDevice deployment
Device deployment
 
Танки_в_Лунапарке: нагрузочное_тестирование_в_Яндексе
Танки_в_Лунапарке: нагрузочное_тестирование_в_ЯндексеТанки_в_Лунапарке: нагрузочное_тестирование_в_Яндексе
Танки_в_Лунапарке: нагрузочное_тестирование_в_Яндексе
 
Games for the Masses (Jax)
Games for the Masses (Jax)Games for the Masses (Jax)
Games for the Masses (Jax)
 
Introduction to Riak - Red Dirt Ruby Conf Training
Introduction to Riak - Red Dirt Ruby Conf TrainingIntroduction to Riak - Red Dirt Ruby Conf Training
Introduction to Riak - Red Dirt Ruby Conf Training
 
[PASS Summit 2016] Blazing Fast, Planet-Scale Customer Scenarios with Azure D...
[PASS Summit 2016] Blazing Fast, Planet-Scale Customer Scenarios with Azure D...[PASS Summit 2016] Blazing Fast, Planet-Scale Customer Scenarios with Azure D...
[PASS Summit 2016] Blazing Fast, Planet-Scale Customer Scenarios with Azure D...
 
Zero to Sixty: AWS Elastic Beanstalk (DMG204) | AWS re:Invent 2013
Zero to Sixty: AWS Elastic Beanstalk (DMG204) | AWS re:Invent 2013Zero to Sixty: AWS Elastic Beanstalk (DMG204) | AWS re:Invent 2013
Zero to Sixty: AWS Elastic Beanstalk (DMG204) | AWS re:Invent 2013
 
Visual Studio 2013, Xamarin and Microsoft Azure Mobile Services: A Match Made...
Visual Studio 2013, Xamarin and Microsoft Azure Mobile Services: A Match Made...Visual Studio 2013, Xamarin and Microsoft Azure Mobile Services: A Match Made...
Visual Studio 2013, Xamarin and Microsoft Azure Mobile Services: A Match Made...
 
The memory of the architect: archiving 2D and 3D born digital architectural a...
The memory of the architect: archiving 2D and 3D born digital architectural a...The memory of the architect: archiving 2D and 3D born digital architectural a...
The memory of the architect: archiving 2D and 3D born digital architectural a...
 
CouchDB
CouchDBCouchDB
CouchDB
 
Greenberg, Starr, Kunze, and Hammond, "Show Me the Data: Managing Data Sets f...
Greenberg, Starr, Kunze, and Hammond, "Show Me the Data: Managing Data Sets f...Greenberg, Starr, Kunze, and Hammond, "Show Me the Data: Managing Data Sets f...
Greenberg, Starr, Kunze, and Hammond, "Show Me the Data: Managing Data Sets f...
 
JavaScript for Flex Devs
JavaScript for Flex DevsJavaScript for Flex Devs
JavaScript for Flex Devs
 
Big Data answers in seconds with Amazon Athena
Big Data answers in seconds with Amazon AthenaBig Data answers in seconds with Amazon Athena
Big Data answers in seconds with Amazon Athena
 

Plus de Brian Johnson

Plus de Brian Johnson (7)

Graph Walks & Vector Embeddings: Exploiting the head and exploring the tail
Graph Walks & Vector Embeddings: Exploiting the head and exploring the tail Graph Walks & Vector Embeddings: Exploiting the head and exploring the tail
Graph Walks & Vector Embeddings: Exploiting the head and exploring the tail
 
2015-04 eBay Statistics
2015-04 eBay Statistics2015-04 eBay Statistics
2015-04 eBay Statistics
 
Treemaps: Visualizing Hierarchical and Categorical Data
Treemaps: Visualizing Hierarchical and Categorical DataTreemaps: Visualizing Hierarchical and Categorical Data
Treemaps: Visualizing Hierarchical and Categorical Data
 
11 964 181 System And Method For Providi
11 964 181 System And Method For Providi11 964 181 System And Method For Providi
11 964 181 System And Method For Providi
 
11 641 262 Proprietor Currency Assignmen
11 641 262 Proprietor Currency Assignmen11 641 262 Proprietor Currency Assignmen
11 641 262 Proprietor Currency Assignmen
 
10 977 279 Method And System For Categor
10 977 279 Method And System For Categor10 977 279 Method And System For Categor
10 977 279 Method And System For Categor
 
11 869 290 Electronic Publication System
11 869 290 Electronic Publication System11 869 290 Electronic Publication System
11 869 290 Electronic Publication System
 

CloudCon Data Mining Presentation

  • 1. ! ! ! CloudCon, Tuesday, October 2nd, 11am
  • 2. Every Second – in over thousands of Categories
  • 3. Value > Cost $’s per year in incremental revenue www.wallpapertimes.com
  • 4. Big
  • 6. incremental storage Volume DATA structured Variety Velocity processing semi-structured change un-structured
  • 7. Analyze & Report Discover & Explore Structured Semi-Structured Unstructured SQL SQL++ Java/C++/Pig/Hive Production Data Warehousing Contextual-Complex Analytics Structure the Unstructured Large Concurrent User-base Deep, Seasonal, Consumable Data Sets Detect Patterns Data Warehouse Data Warehouse + Hadoop Behavioral Enterprise-class System Low End Enterprise-class System Commodity Hardware System 8+PB 60+PB 40+PB
  • 8. !  Data Growing Faster
  • 9.
  • 10. Data questions later structure later (<$0.04/GB, <$80/2TB) single HDFS instances >50PB Value > Cost 10
  • 11. Designing for the Unknown >85% of analytical workload is NEW & Unknown The metrics you know are cheap The metrics you don’t know are expensive – but high in potential ROI Exploration & Testing are core pillars of an analytics-driven organization
  • 12. •  Impact
  • 13.
  • 14. !"#$ %$& '()*+,"-+ .-)/01$2& 3-#$ 4! 5"*2"$, 5"*2& 4! 6*77"$, 6*77& 4! 82*+6$22"$, 82*+6$22& 4! 9-77"+7 9-7 4! :",;"+7/,#"8<$2 :",;/,#"8<$2, 4% )*+$=, )*+$=="+7 4% )2-#$8#"-+ )2-#$8#$2 4% ="+"+7 ="+$5 4% *+">*#"-+ *+">*#$5 4% #218<, #218<"+7 4% $57"+7 $57$, 4% +$#, +$##"+7
  • 15. !"#$ %$& '()*+,"-+ .-)/01$2& 3-#$ 4! 5"*2"$, 5"*2& 6*7)"2$/5"*2"$, 4! 8*99"$, 8*99& )*#*9-+"*/8*99"$, 9--5/:-2/)*#*9-+"*/8*99&;/+-#/9--5/*<-+$ 4! =2*+8$22"$, =2*+8$22& #>$/=2*+8$22"$, 4! ?-99"+9 ?-9 ?-99"+9/,#2-<<$2 4! :",>"+9/,#"=@$2 :",>/,#"=@$2, :",>"+9/,#"=@$2 ,)-2#,/6,A/@"5,/2--7, 4% )*+$<, )*+$<<"+9 :$+=$/)*+$<, 4% )2-#$=#"-+ )2-#$=#$2 7=*:$$/#-#*</)2-#$=#"-+/BCDB ,=2$$+/)2-#$=#$2/",/#-)/4!/E1$2& 4% <"+"+9 <"+$5 )"+@/<"+"+9/=>*+9"+9/8*9 4% *+"7*#"-+ *+"7*#$5 *+"7*#"-+/=$< 4% #21=@, #21=@"+9 =-29"/#21=@, 4% $59"+9 $59$, 9*25$+/$59"+9 4% +$#, +$##"+9 )12,$/+$#,
  • 16.
  • 17.
  • 18. Value > Cost $’s per year in incremental revenue www.wallpapertimes.com
  • 19.
  • 20.
  • 21. Toys and Hobbies ATC > Artist trading card in ART ATC > Automatic Tool Change in Business and Industrial
  • 22. German Compound Words •  German compound words can be arbitrarily created and extremely long Adidastrainingsanzug (Adidas track suit) Rindfleischetikettierungsüberwachungsaufgabenübertragungsgesetz (beef labeling regulation & delegation of supervision law) •  Syntactically, words can be combined and split in many ways. •  Some words shouldn’t be de-compounded. beiden (both) – bei(at) den(the) •  Too many candidates for Granitpflastersteine (granite paving stones) Granit(granite) pflastersteine(cobblestones) Granit(granite) pflaster(paving/band-aid) steine(stones) •  Binding characters Hochzeitsschuhe (grammatically correct, 593 hits on ebay.de) Hochzeitschuhe (129 hits on ebay.de).
  • 23. Synonyms  derived  from  top  queries  in  item  query  clusters   texas  instruments  ba  ii  plus   /  ba  ii  plus   brighton  handbag   brighton  purse   lenovo  x200   thinkpad  x200   king  bedspread   king  coverlet   rockabilly  dress   swing  dress   1963  ford  falcon   63  falcon   jessica  simpson  hair  extensions   jessica  simpson  hairdo     Abbrevia7ons/acronym  derived  from  query  transi7ons   stanford  ky   stanford  kentucky   dc  sub   dc  subwoofer   snowboard  helmet  l   snowboard  helmet  large   motorcycle  cam   motorcycle  camera   diamond  amp   diamond  amplifier