Barbaccia has worked for IPSOS as International Director of Audience Measurement since last August. He came from AGB Nielsen Media Research, where he worked as Director of Metering and Field Operations, and before that as Operation and Business Development Director in AGB Nielsen UK for BARB.
Since joining ACNielsen in 1984, he has held a number of senior positions, including that of European Panel Operations Director at Nielsen//NetRatings; South European Panel Operations Director, responsible for the set-up and management of web-audience samples in Italy, Spain, Switzerland and Austria; and as Sources Director, managing ACNielsen operations in Italy for the FMCG business.
www.sempl.si
2. Agenda for Today
ο§ Technical description of passive measurement
ο§ Field Trials
ο§ The London Radio Panel
3. 3
Technical
description
3
An Overview of MediaCell
4. Ipsos radio measurement in 27 countries
Region Countries Samples Methods Main surveys
Europe Diary/Online
9 388,000
(1992) /CATI
Latin Personal
America 7 154,000 interviews/
(1999) CATI
MENA &
Africa 11 118,450 CATI
(2000)
4
4
5. Electronic measurement
5
ο§ Why?
β Traditional methods struggle with increase in number of stations
β Increasing respondent burden in diary/DAR methods
β Rapid feedback, possibility to study short-term format changes
β Accountability, puts radio on a par with TV
β Possibility to combine TV and radio measurement
ο§ Why not?
β From listening to exposure
β Potential Cost issues
β Potential Compliance issues
5
6. Approaches to electronic measurement (1)
6
ο§ Signal encoding
β Inaudible watermark inserted by broadcaster
β Station ID, platform, date/time (plus anything else?)
ο§ Advantages
β Currently most accurate
β Very limited data transfer need
β Easy to measure time-shifted listening
ο§ Disadvantages
β Stations must agree to encode
6
7. Approaches to electronic measurement (2)
7
ο§ Audio matching (finger printing)
β Device takes regular samples of audio (signatures)
β Matched against reference sites
ο§ Advantages
β No need for stations to encode
ο§ Disadvantages
β More difficult to measure time-shifted listening / source
β Cannot differentiate between βplatformsβ
β Complexity of managing reference sites
β Intense in data transfer
7
8. The Philosophy of the Data Processing
8
Real Time iMonitor Decoder Server
Encoder Independent Application on Data analysis
Inserted in monitoring station Handset
broadcast chain
DATA CENTRE
RADIO STATION AUDIO RECEPTION & COLLECTION, RATINGS
SERVERS TRANSMISSION TRANSMISSION AGGREGATION, ACCESS
PROCESSING
9. Traditional = Recall / βprecallβ (RAJAR)
9
ο§ βAll the situations when you listen to or hear a radio stationβ
β In home; someone elseβs home; in a car; at work or somewhere else
β AM/FM, DAB, Digital TV or internet
ο§ βPlease record every time you listen for at least 5 minutesβ
ο§ Historical criticisms:
β Recall of normative listening behaviour to favourite brands?
β Tendency to βforgetβ short listening sessions?
10. Electronic = Exposure
10
ο§ Measuring the person NOT the device (TV, Internet focus on
device)
ο§ Exposure in all environments and occasions to:
β Radio stations that the participant chooses to βlistenβ to
β Radio stations that someone else chooses to βlistenβ to
β Radio stations that the participant is unaware of what they are βlisteningβ
to
β Live & time shifted βlisteningβ
β All of the above by Platform
11. The concept
11
ο§ Software (not hardware) solution
ο§ Runs on Smartphones
ο§ Uses real time signal encoding
11
12. Taking Advantage of Nature:
How Intrasonics Technology Works 12
The ear/brain naturally filters out Original sound
echoes, particularly the early Early reflections
reflections
Reverberation
Loudness
Time
13. Qualitative Research:
Role of the Smartphone 13
Smartphones play multiple roles in respondents lives beyond communication. There are
some respondents who owned a second smartphone which is usually a business phone.
βI use my phone forβ¦β
Communication Entertainment
(voice calls, text (games, videos, list
messages, emails) en to the radio)
Internet Navigation
browsing (via GPS)
Social networking Organisation
(checking on and updating (calendar, contact list)
friends)
Respondents are highly engaged with their smartphones and comfortable with using
applications and functions
14. Qualitative Research:
Where they keep their phones 14
All respondents were heavily reliant on their smartphones, which play an integral part of their
lives to the extent that most carry their phone with them so they can always hear them.
Bedside
Now that I think about it, I
table,
always have my phone in my
desk, pocket, in my hand or within
counter reaching distance!
In hand
Mobile phones
are always within
earshot
throughout the
day!
In car In pocket
Smartphones are rarely any distance from respondents throughout the day
15. Smartphone Penetration by Market
15
Base: users of mobile phones; n= 13.505
Source: GfK; The CEE Telco Industry Report 2011
Slovenia 27.6
Turkey 23.7
Lithuania 18.5
Kazakhstan 15.7
Croatia 15.5
BIH 15.5
Czech Republic 14.3
Serbia 13.3
Hungary 12.9
Estonia 12.7
Russia 11.8
Latvia 10.7
Slovakia 9.3
Ukraine 8.9
Romania 8.4
17. London Field Trials - Summary
Field Test 1 Field Test 2 Field Test 3
Sample Source Internal Ipsos & Consumer Voice Consumer Voice
Intrasonics (Ipsos Panel) (Ipsos Panel)
Sample Size 10 20 51
Dates 3-23 June 2010 16th August to 24th November 2010 to
15th October 2010 15th March 2011
Length 3-4 Days 4 Weeks 12 Weeks
Installation n/a Central Location Central Location
Stations Eagle Sound Absolute, Smooth, Absolute, Smooth,
talkSport talkSport, Kiss, Magic,
XFM
Share of Voice n/a 7% 23%
18. Field Tests: Objectives & Achievements
Field Test 1 Field Test 2 Field Test 3
Installation of encoders Yes Yes Yes
Longitudinal performance of encoders Yes Yes Yes
Recruitment Yes Yes
Documentation Yes Yes
Handset swapping Yes Yes
Handset functionality Yes Yes
Daily data collection Yes Yes
Examination of compliance data Yes Yes
Exit Interviews Yes Yes
Respondent Participation (Coincidental Yes
calls, Handsets, Incentives)
Active compliance management Yes
(Procedures, Flags, Editing, DP)
Data Examination Yes
21. London Radio Panel: 65% SOV
21
ο§ Stations (at least) to provide 84% Weekly Reach:
β BBC Radio 1 FM
β BBC Radio 2 FM
β BBC Radio 4 FM & DAB
β Absolute FM & DAB
β Smooth FM & DAB
β Capital FM, DAB & Web
β Heart FM, DAB & Web
β XFM FM, DAB, Web & DSAT
β Classic FM FM, DAB & DSAT
β LBC FM, DAB, Web & DSAT
β talkSPORT AM, DAB & Web
β Magic FM, DAB, Web & DTV
β Kiss FM, DAB, Web & DTV
22. London Radio Panel: 65% SOV
22
ο§ Sample: 375 (includes 25% churn)
ο§ Field Test dates: 12 months
ο§ Recruitment: F2F CAPI
ο§ Incentives: The Handset
ο§ Handsets: Nokia & Android (iPhone & BlackBerry)
ο§ Compliance: CATI compliance / courtesy / closure / exit
Ipsos has an interest in passive electronic measurement for radio, because we have a long tradition in providing audience measurement for radio going back nearly 20 years and now encompassing nearly 30 countries and nearly 600,000 interviews per year.These interviews use every conceivable methodology (diaries, DAR, online, offline, f2f, self completion, cati).There is no proscriptive method, each market adopts the most suitable approach for its needs.However, the growth of stations and available broadcast platform, coupled with the desire for faster and more accountable measures mean that electronic methods need to be considered.
We have introduced the concept of the three Cs:CarryChargeConnectBy carry, we simply ask that participants carry the phone with them at all times (not an unreasonable request)By charge, we ask that participants charge their phone at least once a day. The development work so far has looked at optimising how the app works on the phone in the background and how we can minimise the impact on battery life.By connect, we ask that the phone connects to 3g or wifi, again not an issue for smartphone owners. The app stores information on the phone itself and transfers data back when connected. It can store data until connections is made and data is not deleted from the phone until our servers instruct this. A process that requires no intervention by the panellist.What is this data that we store and transmit:One element is the decoded signatures that the phone has detected.But what we have already stated is that this is not enough to define listening.The app also passively detects the activity and movement of the phone and transmits this data too.So codewords PLUS activity = listening.