SlideShare une entreprise Scribd logo
1  sur  22
Télécharger pour lire hors ligne
Jazz's Lightening Talk

巨量資料的新商業模式?
雲端資料分析服務
雲端運算
Cloud
Computing
2014-03-08

巨量資料
Big
Data

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

1
爵士閃電講

巨量資料的新商業模式?
他山之石可以攻錯!

https://www.moedict.tw/他山之石可以攻錯
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

2
爵士閃電講

巨量資料的新商業模式?
他山之石可以攻錯!
案例:
從日誌蒐集到線上分析
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

3
生、流、存、算、用、看

圖 1. Big Data Lifecycle 與產業發展
http://fredbigdata.blogspot.tw/2013/06/big-data-lifecycle.html

2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

4
Data Science Workflow

資料模型 / 模式

資料
擷取
蒐集

資料
整理
凈化

資料
儲存
管理

特徵
萃取

視覺化分析
互動式查詢

說故事
結果闡釋

Data Analysis: Just One Component of the Data Science Workflow,
By Ben Lorica, 'Big Data Now 2013', OR'eilly

2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

5
Life of Big Data :蒐、存、取、析、用

蒐
存

析
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

取

用

6
Treasure Data Cloud 的商業定位

生

蒐
流

存

取

算
析
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

用
看
7
Data Flow of Log Analysis
生

2014-03-08

流

存

算

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

用

看

8
Data Flow of Log Analysis (Enhanced ?)

2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

9
td-agent / flunetd
Unstructure → Unstructure

Unstructure → Structured

2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

10
爵士閃電講

巨量資料的新商業模式?
他山之石可以攻錯!
從日誌蒐集到線上分析
Live Demo:
Treasure Data Cloud
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

11
爵士閃電講

< 聲明 >
@ 2014-03-08
本人與 TreasureData
公司無任何利益關係
( 不代表未來不會合作 )
以下純屬個人的用戶經驗分享
PS. 順便學一下 UI / UX
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

12
1. Visit Web Console

https://console.treasuredata.com/login
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

13
2. Sign up for free testing account

https://console.treasuredata.com/login
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

14
3. Read Quick Start Tutorial

https://console.treasuredata.com/login
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

15
4. Understand SampleDB Data Structure

https://console.treasuredata.com/login
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

16
5. Submit Query …. online!

https://console.treasuredata.com/login
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

17
Running via AJAX / RESTful method

https://console.treasuredata.com/login
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

18
6. Get the result interactively

https://console.treasuredata.com/login
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

19
Possible Use Cases

https://console.treasuredata.com/login
2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

20
Support High Availability

2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

21
fluentd plugins ( in_XXX, out_XXX )

2014-03-08

Hadoop Ecosystem Workshop Q1 2014
jazzwang@etusolution.com

http://fluentd.org/plugin/

22

Contenu connexe

Similaire à Introduction to TreasureData Cloud

Putting Business Intelligence to Work on Hadoop Data Stores
Putting Business Intelligence to Work on Hadoop Data StoresPutting Business Intelligence to Work on Hadoop Data Stores
Putting Business Intelligence to Work on Hadoop Data StoresDATAVERSITY
 
Where does hadoop come handy
Where does hadoop come handyWhere does hadoop come handy
Where does hadoop come handyPraveen Sripati
 
The future of big data and hadoop
The future of big data and hadoopThe future of big data and hadoop
The future of big data and hadoopventuresity
 
Data Science Perspective and DS demo
Data Science Perspective and DS demo Data Science Perspective and DS demo
Data Science Perspective and DS demo PivotalOpenSourceHub
 
2015 HortonWorks MDA Roadshow Presentation
2015 HortonWorks MDA Roadshow Presentation2015 HortonWorks MDA Roadshow Presentation
2015 HortonWorks MDA Roadshow PresentationFelix Liao
 
Mike keating - News Int - 18th BDL meetup
Mike keating - News Int - 18th BDL meetupMike keating - News Int - 18th BDL meetup
Mike keating - News Int - 18th BDL meetupbigdatalondon
 
2014 Big_Data_Forum_Pivotal
2014 Big_Data_Forum_Pivotal2014 Big_Data_Forum_Pivotal
2014 Big_Data_Forum_PivotalCOMPUTEX TAIPEI
 
Analyzing Big Data - Jeff Scheel
Analyzing Big Data - Jeff ScheelAnalyzing Big Data - Jeff Scheel
Analyzing Big Data - Jeff ScheelKangaroot
 
Navigating the big data landscape
Navigating the big data landscapeNavigating the big data landscape
Navigating the big data landscapeMWD Advisors
 
Java day Big Data Analysis In Java World
Java day   Big Data Analysis In Java WorldJava day   Big Data Analysis In Java World
Java day Big Data Analysis In Java WorldSerg Masyutin
 
Cloudera's Original Pitch Deck from 2008
Cloudera's Original Pitch Deck from 2008Cloudera's Original Pitch Deck from 2008
Cloudera's Original Pitch Deck from 2008Accel
 
Building intelligent applications, experimental ML with Uber’s Data Science W...
Building intelligent applications, experimental ML with Uber’s Data Science W...Building intelligent applications, experimental ML with Uber’s Data Science W...
Building intelligent applications, experimental ML with Uber’s Data Science W...DataWorks Summit
 
8 douetteau - dataiku - data tuesday open source 26 fev 2013
8   douetteau - dataiku - data tuesday open source 26 fev 2013 8   douetteau - dataiku - data tuesday open source 26 fev 2013
8 douetteau - dataiku - data tuesday open source 26 fev 2013 Data Tuesday
 
Bay Area Hadoop User Group
Bay Area Hadoop User GroupBay Area Hadoop User Group
Bay Area Hadoop User GroupPentaho
 
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...John Sing
 
Big Data Hadoop ,Business Analytics& Data Warehousing Online Training
Big Data Hadoop ,Business Analytics& Data Warehousing Online TrainingBig Data Hadoop ,Business Analytics& Data Warehousing Online Training
Big Data Hadoop ,Business Analytics& Data Warehousing Online Trainingsarala vanga
 
Operationalizing Data Analytics
Operationalizing Data AnalyticsOperationalizing Data Analytics
Operationalizing Data AnalyticsVMware Tanzu
 
Secrets of Enterprise Data Mining: SQL Saturday 328 Birmingham AL
Secrets of Enterprise Data Mining: SQL Saturday 328 Birmingham ALSecrets of Enterprise Data Mining: SQL Saturday 328 Birmingham AL
Secrets of Enterprise Data Mining: SQL Saturday 328 Birmingham ALMark Tabladillo
 
Bi and The Cloud: What does it all mean?
Bi and The Cloud: What does it all mean?Bi and The Cloud: What does it all mean?
Bi and The Cloud: What does it all mean?Pano Xinos
 
Picking the right streaming tools for the job
Picking the right streaming tools for the jobPicking the right streaming tools for the job
Picking the right streaming tools for the jobOfir Manor
 

Similaire à Introduction to TreasureData Cloud (20)

Putting Business Intelligence to Work on Hadoop Data Stores
Putting Business Intelligence to Work on Hadoop Data StoresPutting Business Intelligence to Work on Hadoop Data Stores
Putting Business Intelligence to Work on Hadoop Data Stores
 
Where does hadoop come handy
Where does hadoop come handyWhere does hadoop come handy
Where does hadoop come handy
 
The future of big data and hadoop
The future of big data and hadoopThe future of big data and hadoop
The future of big data and hadoop
 
Data Science Perspective and DS demo
Data Science Perspective and DS demo Data Science Perspective and DS demo
Data Science Perspective and DS demo
 
2015 HortonWorks MDA Roadshow Presentation
2015 HortonWorks MDA Roadshow Presentation2015 HortonWorks MDA Roadshow Presentation
2015 HortonWorks MDA Roadshow Presentation
 
Mike keating - News Int - 18th BDL meetup
Mike keating - News Int - 18th BDL meetupMike keating - News Int - 18th BDL meetup
Mike keating - News Int - 18th BDL meetup
 
2014 Big_Data_Forum_Pivotal
2014 Big_Data_Forum_Pivotal2014 Big_Data_Forum_Pivotal
2014 Big_Data_Forum_Pivotal
 
Analyzing Big Data - Jeff Scheel
Analyzing Big Data - Jeff ScheelAnalyzing Big Data - Jeff Scheel
Analyzing Big Data - Jeff Scheel
 
Navigating the big data landscape
Navigating the big data landscapeNavigating the big data landscape
Navigating the big data landscape
 
Java day Big Data Analysis In Java World
Java day   Big Data Analysis In Java WorldJava day   Big Data Analysis In Java World
Java day Big Data Analysis In Java World
 
Cloudera's Original Pitch Deck from 2008
Cloudera's Original Pitch Deck from 2008Cloudera's Original Pitch Deck from 2008
Cloudera's Original Pitch Deck from 2008
 
Building intelligent applications, experimental ML with Uber’s Data Science W...
Building intelligent applications, experimental ML with Uber’s Data Science W...Building intelligent applications, experimental ML with Uber’s Data Science W...
Building intelligent applications, experimental ML with Uber’s Data Science W...
 
8 douetteau - dataiku - data tuesday open source 26 fev 2013
8   douetteau - dataiku - data tuesday open source 26 fev 2013 8   douetteau - dataiku - data tuesday open source 26 fev 2013
8 douetteau - dataiku - data tuesday open source 26 fev 2013
 
Bay Area Hadoop User Group
Bay Area Hadoop User GroupBay Area Hadoop User Group
Bay Area Hadoop User Group
 
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...
 
Big Data Hadoop ,Business Analytics& Data Warehousing Online Training
Big Data Hadoop ,Business Analytics& Data Warehousing Online TrainingBig Data Hadoop ,Business Analytics& Data Warehousing Online Training
Big Data Hadoop ,Business Analytics& Data Warehousing Online Training
 
Operationalizing Data Analytics
Operationalizing Data AnalyticsOperationalizing Data Analytics
Operationalizing Data Analytics
 
Secrets of Enterprise Data Mining: SQL Saturday 328 Birmingham AL
Secrets of Enterprise Data Mining: SQL Saturday 328 Birmingham ALSecrets of Enterprise Data Mining: SQL Saturday 328 Birmingham AL
Secrets of Enterprise Data Mining: SQL Saturday 328 Birmingham AL
 
Bi and The Cloud: What does it all mean?
Bi and The Cloud: What does it all mean?Bi and The Cloud: What does it all mean?
Bi and The Cloud: What does it all mean?
 
Picking the right streaming tools for the job
Picking the right streaming tools for the jobPicking the right streaming tools for the job
Picking the right streaming tools for the job
 

Introduction to TreasureData Cloud