How to Troubleshoot Apps for the Modern Connected Worker
When two seconds is too long, Acunu
1. When Two Seconds Is Too Long
A look at low latency, real-time analytics
dai clegg
VP Product Marketing
dai@acunu.com
@daiclegg
2. The new data sources driving big data analytics
social media
mobile apps
web clicks
infrastructure fabric/logs
smart grids/smart meters
dfid tags, etc
Machine Data
Social Data
Batch Analytics
Operational Intelligence
mobile marketing
social apps
infrastructure monitoring
@daiclegg
batch reporting
exploratory analysis
data discovery
2
3. the BigHERE technology landscape
TITLE Data
data mining/
data warehousing
quantitative
analytics
data access
@daiclegg
3
4. the BigHERE technology landscape
TITLE Data
use case
Subtitle
complexity of analytics
data mining/
data warehousing
money-off
coupons
‣
‣
quantitative
analytics
Identifies items that shoppers are likely to
buy in future visits
Coupon redemption rates as high as 24%
data access
immediacy of results
hours
@daiclegg
minutes
seconds
4
milli-seconds
5. the BigHERE technology landscape
TITLE Data
use case
Subtitle
complexity of analytics
data mining/
data warehousing
money-off
coupons
‣
‣
120 babies monitored
‣
quantitative
analytics
Neo-natal infant monitoring
120k messages /second
babies
data access
immediacy of results
hours
@daiclegg
minutes
seconds
5
milli-seconds
6. the BigHERE technology landscape
TITLE Data
use case
Subtitle
complexity of analytics
data mining/
data warehousing
money-off
coupons
windmills
‣
‣
weather data, turbine operational data
‣
quantitative
analytics
2.5 petabytes in Hadoop
model weather to optimise wind farms
babies
data access
immediacy of results
hours
@daiclegg
minutes
seconds
6
milli-seconds
7. the BigHERE technology landscape
TITLE Data
use case
Subtitle
complexity of analytics
data mining/
data warehousing
money-off
coupons
windmills
‣
‣
‣
quantitative
analytics
‣
000s of transactions per second
‣
120k messages /second
shopping
babies
carts
data access
hours
@daiclegg
‣
Neo-natal infant monitoring
Global e-store
120 babies monitored
Shopping cart session store
minutes
seconds
7
milli-seconds
immediacy of results
8. the BigHERE technology landscape
TITLE Data
use case
Subtitle
complexity of analytics
data mining/
data warehousing
money-off
coupons
windmills
‣
‣
‘000s of test readings per second
Hi-tech Mftg
‣
comparing results to historic metrics
quantitative
analytics
‣
monitoring the test stations’ performance
shopping
babies
carts
data access
hours
@daiclegg
automated hi-tech assembly
minutes
seconds
8
milli-seconds
immediacy of results
9. the BigHERE technology landscape
TITLE Data
use case
Subtitle
complexity of analytics
data mining/
data warehousing
money-off
coupons
windmills
‣
Neo-natal infant monitoring
Real-time visibility of infrastructure
‣
‣
120 babies monitored
Insight delivered into the cab
‣
Hi-tech Mftg
‣
quantitative
analytics
‣
taxis
shopping
babies
carts
data access
hours
@daiclegg
120k messages /second
Caught competitor ‘stealing’ web data
minutes
seconds
9
milli-seconds
immediacy of results
10. the BigHERE technology landscape
TITLE Data
use case
Subtitle
complexity of analytics
data mining/
data warehousing
money-off
coupons
windmills
‣
Hi-tech Mftg5000 events per second
over
‣
quantitative
analytics
‣
taxis maintaining 90 days history per campaign
‣ Mktg
SMS Oracle/NetApp only supported 45 days
shopping
babies
carts
data access
hours
@daiclegg
ingesting 300m SMSs daily
minutes
seconds
10
milli-seconds
immediacy of results
11. the BigHERE technology landscape
TITLE Data
use case
Subtitle
complexity of analytics
data mining/
data warehousing
money-off
coupons
windmills
quantitative
analytics
‣
Neo-natal infant monitoring
‣ 1000s of votes/boos/applauds per second
‣
120 babies monitored
‣ “we were able to handle our problems with
Hi-tech Mftg
‣ $5,000 and amessages /second
120k credit card.” - CTO, Tellybug
taxis
shopping
babies
carts
data access
hours
@daiclegg
X-factor
SMS Mktg
minutes
seconds
11
milli-seconds
immediacy of results
12. the BigHERE technology landscape
TITLE Data
use case
Subtitle
complexity of analytics
data mining/
data warehousing
deep analytics
worth the wait
latest data,
historic context,
analytic insight
money-off
coupons
windmills
Hi-tech Mftg
quantitative
analytics
taxis
shopping
babies
carts
data access
hours
minutes
seconds
just need put & get
@daiclegg
X-factor
SMS Mktg
12
milli-seconds
just need recent data
immediacy of results
13. the Acunu Analytics
Prod 1
Acunu Analytics can ingest data,
at very high velocity, from any
source
Prod 2
Prod 3
Ventas Ron Rate
Then, when a dashboard
query is executed, the
answer is there for instant
response
Mes en Curso
Ventas x Vendedor
Ventas BSF
delay text
The data is pre-processed, as
it arrives, to filter, transform
and enrich it with other
corporate data
Acunu
Analytics
But not just
dashboards; there’s a
JSON API so queries
can be embedded in
other apps
delay text
And the original data is
stored for further analysis
and to share with other
analytic tools
And aggregated into roll-up
cubes of sums, averages, top k,
etc, so query answers are
already stored
@daiclegg
Prod 4
Contabilidad
Cuentas Por
Cobrar
13
Cuentas Por
Pagar
