This document discusses several topics related to big data and data science over time, including:
1. In the past, competition and control were key issues in big data, while cloud computing and crowdsourcing became popular.
2. More recently, topics like curation, culture, and containers have become important in data science, as context and the container may be more important than just content alone.
3. Looking to the future, predictive analytics, smart data, and making data actionable will be important trends, as will balancing accuracy and real-time capabilities in big data applications.
26. THEN NOW
Context Container 5 Internet Trends
Competition Convolution 1. Structured/Linked Data
Control (un-)Certainty 2. Real-time Internet
Cloud C
3. Personalization
Crowds Curation
4. Mobile & Augmented Reality
Consumption Culture
Convenience Control 5. Internet of Things
Connection Continuity
ir ls?
o tg
h
are
here
w
29. We’ve faced challenges to dealing with
Large-Scale Data
Time-Series Data
in Real-Time
+ Big Data
Unstructured Data
Persuasion
with
Interpretation
&
Visualization
30. Big Data
Volume Platform Problem
Variety
o rk
Velocity W
+ a ta
D
Value People Productivity
Platform
Monitoring/ Decision
Execution
Sensing Making
Intelligent System
31. Smart Data
- Moving from big data to smart data
- 2013: The year of smart data
- Big data spotlight: Big data is dead! Long live smart data!
- Big data won’t save pharma, but smart data might
So Much Data, So Little Impact.
- Big data? Try smart data
- Investing in big data’s second act
32. Make Big Data work.
Big Data + Analytics + Visualization
Actionable Insight
33. If you can predict the future, you also change it.
Predictive Analytics
34. Prediction
Model
Evaluation
Model Predictive Control
35.
36. Realtime
- Simple algorithms
Counting / Random Forest / Regression
Accurate vs Real-time
- Feature selection & summary
- Streaming processing and analytics
- In-memory storage
Data Science = Data + Analytics + Action
37. So, what?
Those who cannot remember the past are condemned to repeat it.
We live in pasts we’ve never lived.