Recommandé
Recommandé
Contenu connexe
Dernier
Dernier (20)
En vedette
En vedette (20)
Big Data: People, Technologies, Jobs and Hong Kong (15 Oct 2013)
- 1. big data people, technologies, jobs and Hong Kong Scott Brady Drummonds scott@infoincog.com
- 7. the real challenge: what to do with all these data?
- 8. components: creating value from data servers traditional DBMS visualization storage columnar DBs network s hardware software NoSQL platforms Hadoop appliances people traditional IT platform architects comp. scientists stats. people
- 10. applications
- 11. a few examples
- 15. privacy • what is your expectation of your data’s lifespan? • what is the relationship between privacy and intellectual property protection? • do you know your digital exhaust? • should you be compensated for helping Google earn another billion dollars?
- 16. why now? • • • • cheap storage unbounded compute data accessibility and world datafication internet scale: Yahoo! and Google – offspring of Hadoop
- 17. visibility/expectations adapted from Gartner hype cycle time trigger inflated disillusionment productivity expectations enlightenment
- 18. big data: where are we today? adapted from Gartner hype cycle visibility/expectations this will be caused by a lack of statistics knowledge time trigger inflated disillusionment productivity expectations enlightenment
- 19. Asia
- 20. enterprise IT adoption Global USA business interest Asia Hong Kong time http://www.infoincog.com/big-data-in-asia-pacific/
- 21. Hong Kong
- 28. want to get involved? • decision tree: – individual? • learn: join G+ group, ask Scott for reading recommendations • work: Scott knows some recruiters and hiring businesses – research ideas? • meet with CS students about HK data research platform – social or civic engagement? • come to regular ODHK meetings
- 29. changing future • borderless big data will increasingly become invasive. how will regional laws keep up? • “free” services will shift money from many small contributors to a few large businesses. • data must be properly valued which requires a market. • those with computer science and statistics skills will be very well paid for may years.
- 30. want more? Google+: Hong Kong Big Data http://www.infoincog.com/ scott@infoincog.com all content by Scott Brady Drummonds – scott@infoincog.com
Notes de l'éditeur
- $6.3B in 2012, $48.3B by 2018, CAGR 40.5%
- 2009: http://www.nature.com/nature/journal/v457/n7232/full/nature07634.htmlCDC, 60 years old, dept. of health and human services
- Gartner, 2001, three v’s. veracity added by others later.
- “too big from which to derive value”
- 76% of analysts use MS Excel: http://www.billingviews.com/microsoft-excel-king-analytics-hill/
- http://www.intel.com/content/www/us/en/communications/internet-minute-infographic.html
- Retail:CRM – Customer Scoring,Store Siting and Layout,Fraud Detection / Prevention,Supply Chain OptimizationFinancial Services:Algorithmic Trading,Risk Analysis,Fraud Detection,Portfolio AnalysisManufacturing:Product Research,Engineering Analytics,Process & Quality Analysis,Distribution Optimization (GE and Wikibon think manufacturing/industrial growing 2x faster than any other segment: http://online.wsj.com/article/PR-CO-20130618-908554.html)Government:Market Governance,Counter-Terrorism,Econometrics,Health InformaticsEnergy:Smart Grid,ExplorationHealthcare & Life Sciences:Pharmaco-Genomics,Bio-Informatics,Pharmaceutical Research,Clinical Outcomes ResearchAdvertising & Public Relations:Demand Signaling,Ad Targeting,Sentiment Analysis,Customer AcquisitionMedia & Telecommunications:Network Optimization,Customer Scoring,Churn Prevention,Fraud Prevention
- http://www.nytimes.com/2012/02/19/magazine/shopping-habits.html?pagewanted=1&_r=1&hp
- Doug Cutting and Mike Cafarella in 2005
- US leads the globe by about six months.Asia trails the US by about 18 monthsHong Kong trails Asia by about six months
- http://www.gov.hk/en/theme/psi/datasets/questions:what is the relationship between traffic and air pollution? (data joining)how does property value lead/trail changes in population (historical analysis)what are the trends for weather-related closures (trending)
- http://www.gov.hk/en/theme/psi/datasets/questions:what is the relationship between traffic and air pollution? (data joining)how does property value lead/trail changes in population (historical analysis)what are the trends for weather-related closures (trending)
- 博文约礼
- http://www.gov.hk/en/theme/psi/datasets/questions:what is the relationship between traffic and air pollution? (data joining)how does property value lead/trail changes in population (historical analysis)what are the trends for weather-related closures (trending)