In this presentation I introduce the methods for developing research insight about how people experience arts and entertainment events, and cultural experiences. How do we collect the data and information to inform our communications and marketing activities. The main two approaches discussed include qualitative (observation, interviews and focus groups) and quantitative (surveys or questionnaires. digital tracking) data collection methods.
2. @drkellypage!/drkellypage!Date: 10/7/13!
What is Audience & Market Research?
âThe systematic and objective identification, collection,
analysis, dissemination and use of information that is
undertaken to improve decision making related to
identifying and solving problems in marketingâ
(Malhotra, 2009: 30)
Opportunistic?
Identify the market and/or community of interest
Helps in decision making for resource allocation
Insightful?
Marketing research is the key to understanding the environment
Provides information for altering marketing
Â
Â
3. @drkellypage!/drkellypage!Date: 10/7/13!
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
More
 Academic
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
More
 Consultancy
Â
Types of Audience Research
Â
Â
4. @drkellypage!/drkellypage!Date: 10/7/13!
The Functions of Experience Research
How is it used by decision makers?
1.⯠Descriptively â the gathering and presenting of
statements of fact
â˘âŻ e.g. 55% of customers are male, etc.
2.⯠Diagnostically â the explanation of data or
actions
â˘âŻ e.g. What do audiences want? Why do
audiences behave that way?
3.⯠Predictively â specification of how to use
descriptive and diagnostic research to predict
the results of a planned marketing decision
â˘âŻ e.g., what will audiences do?
3.⯠Evaluative â to review communications
activities and evaluate their effectiveness for a
program of work
â˘âŻ e.g., what was the reach of the social media
campaign
Â
Â
5. @drkellypage!/drkellypage!Date: 10/7/13!
Audience
 Research
 is
 Intui6ve
Â
Understand
 the
 other
 players
 in
 our
Â
arts
 and
 entertainment
 landscape
Â
ĂďâŻComplete
 category
 overview,
 levels
Â
of
 success
 and
 poten7al
 cross-Ââover
Â
between
 and
 among
 audiences
Â
Â
Get
 to
 know
 our
 audience
Â
ĂďâŻWho
 they
 are,
 preferences,
Â
frustra7ons,
 and
 a<endance
 pa<erns
Â
How
 Does
 It
 Help
 Me?
Â
â˘âŻ Iden7fy
 opportuni7es
 and
 solve
Â
problems
Â
â˘âŻ Improve
 organiza7on
Â
management
Â
â˘âŻ InďŹuence
 decisions
 on
 budgets,
Â
fundraising
 and
 promo7on
Â
â˘âŻ Priori7ze
 spending
 and
 seek
Â
funding
Â
â˘âŻ Iden7fy
 poten7al
 new
 audiences
Â
â˘âŻ Predict
 future
 audience
 behavior
Â
Â
6. @drkellypage!/drkellypage!Date: 10/7/13!
Evaluative Research
â˘âŻ Audience analysis by syndicated research companies
â˘âŻ Exposure ratings use both gross and cumulative
measures such as GRP, CPP and CPM.
â˘âŻ Advertising Research
â˘âŻ Measures who sees the ad, the page, the content
â˘âŻ Determines audience response to content
â˘âŻ Evaluates effect of ad through sales data
â˘âŻ Nielsen Media Research tracks product placement
ratings
â˘âŻ Alexa and Quantcast as emerging models for digital
audience research
7. @drkellypage!/drkellypage!Date: 10/7/13!
The Functions of Research II
Broad decisions
â˘âŻ Which new audiences to reach (Older/younger)
â˘âŻ Which new features to introduce (Sustainable)
â˘âŻ Which new partner opportunities to pursue (Apps).
Narrow decisions
â˘âŻ Communication effectiveness
â˘âŻ Experience/Event positioning
â˘âŻ Ticket Sales tracking
â˘âŻ Monitoring audience satisfaction
Â
Â
8. @drkellypage!/drkellypage!Date: 10/7/13!
The Functions of Research III
How is MR predominantly used by decision makers?
-⯠The quest for audience satisfaction
-⯠The quest for audience retention
-⯠The quest for audience participation
-⯠The quest for increased WOM
-⯠The quest for share of wallet
-⯠The quest for share of voice
-⯠The quest for sustainability
(Claes Fornell - Founder of the American Customer Satisfaction Index & Professor of
Marketing, University of Michigan)
Â
Â
Airline
 War
 Goes
 Social;
Â
Who's
 winning
 in
 the
 BA
Â
versus
 Virgin
 Atlan9c
Â
ba;le?
Â
9. @drkellypage!/drkellypage!Date: 10/7/13!
When shouldnât audience/community research be used?
1.⯠Resources are lacking
2.⯠Research results wouldnât be useful/used
3.⯠The opportunity has passed
4.⯠Decision making information already exists
5.⯠Costs outweigh BenefitsâŚ
6.⯠When it is just to justify a decision⌠(95% of womenâŚ)
10. @drkellypage!/drkellypage!Date: 10/7/13!
Â
Â
Â
Â
Â
Â
WHY?
Â
The Research Process
Â
Â
(2)
Creating of the
Research
Design
(4)
Selecting the
Sampling
Procedure
(5)
Collecting the
Data
(6)
Analyzing the
Data
(7)
Writing and
Presenting the
Report
(8)
Follow-up
(1)
Identification of
the Problem
and Statement
of Objectives
(3)
Choosing the
Method of
Research
11. @drkellypage!/drkellypage!Date: 10/7/13!
Link Research to Your Communications Plan
â˘âŻ Itâs
 the
 ďŹrst
 step
 in
 your
 planning
 cycle
Â
â⯠Focus
 on
 understanding
 the
 best,
 most
 prac7cal
 solu7ons
 for
 insight
Â
â⯠We
 call
 this
 âdeďŹning
 the
 research
 problemâ
Â
The
 Problem
Â
â˘âŻ What
 is
 the
 Experience/
Event
 Issue?
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
â˘âŻ example:
 less
 people
 are
Â
a<ending
 our
Â
performances
Â
â˘âŻ example:
 poor
Â
par7cipa7on
 at
 our
Â
event
Â
The
 Ques7on
Â
â˘âŻ Re-Ââstate
 the
 issue
 in
Â
research
 terms
Â
â˘âŻ example:
 why
 do
 less
Â
people
 buy
 7ckets
 to
 our
Â
performances?
Â
â˘âŻ example:
 why
 do
 people
Â
not
 par7cipate
 /
 are
Â
passive
 at
 our
 event
Â
The
 Research
 Proposi7on
Â
â˘âŻ Decide
 what
 type
 of
Â
research
 to
 do
 and
 how
Â
it
 will
 provide
 insight
 to
Â
the
 issue
Â
â˘âŻ example:
 survey
Â
audiences
 that
 a<ended
Â
single
 events
 vs.
 mul7ple
Â
events
Â
12. @drkellypage!/drkellypage!Date: 10/7/13!
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
 HOW?
Â
Â
Â
Â
Â
Â
Â
WHY?
Â
The Research Process
Â
Â
(2)
Creating of the
Research
Design
(4)
Selecting the
Sampling
Procedure
(5)
Collecting the
Data
(6)
Analyzing the
Data
(7)
Writing and
Presenting the
Report
(8)
Follow-up
(1)
Identification of
the Problem
and Statement
of Objectives
(3)
Choosing the
Method of
Research
13. @drkellypage!/drkellypage!Date: 10/7/13!
STAGE 2:
Creating of the Research Design
Types of Research Designs
1. Exploratory:
â˘âŻ To explore, further define or understand further the problem/opportunity at
hand
â˘âŻ Secondary Data; Qualitative â interviews, focus groups
2. Descriptive:
â˘âŻ To describe and provide insight to the who what, where, when and how
questions.
â˘âŻ Secondary Data; Cross sectional & Longitudinal Surveys; Statistical Data
Analysis
3. Causal:
â˘âŻ To establish cause-&-effect thus whether the value of one variable (IV)
influences the value of another variable (DV).
â˘âŻ Secondary Data; Cross sectional & Longitudinal Surveys; Experiments; Time
Sequence; Systematic Elimination
14. @drkellypage!/drkellypage!Date: 10/7/13!
STAGE 3:
Choosing a Research Method
Qualitative Versus Quantitative Research
Qualitative Research
Exploratory
To gain a qualitative
understanding of the underlying
reasons and motivations
Small number of non-
representative cases
Unstructured
Non-statistical
Develop an initial understanding
Secondary Research,
Observation, Interviews, Focus
Groups
Objective
Type of Study
Sample
Data Collection
Data Analysis
Outcome
Methods
Quantitative Research
Descriptive, Causal
To quantify the data and generalize
the results from the sample to the
population of interest
Large number of representative cases
Structured
Statistical
Recommend a final course of action
Secondary Research, Surveys,
Experiments
15. @drkellypage!/drkellypage!Date: 10/7/13!
Classification of Segmentation Variables
Measurement
Objec7ve Subjec7ve
General
 Level
Â
(Par%cipants)
Â
(e.g.,
 audience
Â
proďŹle)
Age
Â
Educa7on
 Level
Â
Geographic
 Area
Â
Family
 life-Ââcycle
Lifestyle
Â
General
 Values
Â
Personality
Domain-ÂâspeciďŹc
Â
Level
Â
(Par%cipa%on
 with
Â
A&E
 Type
 of
Â
Experience)
Â
Â
(e.g.,
 immersive
Â
theater)
Â
Usage
 Frequency
Â
Subs7tu7on
Â
Complementary
Percep7on
Â
AYtude,
 preference,
Â
interests,
 opinions,
Â
Â
domain-ÂâspeciďŹc
 values
SpeciďŹc
 Level
Â
(Our
 Branded
Â
Experience)
Â
(e.g.,
 Redmoon
Â
experience)
Brand
 loyalty
 (behaviour)
Â
Recency,
 Usage
 Frequency,
Â
Â
Monetary
 Value
 (RFM)
Brand
 loyalty
 (aYtude)
Â
Brand
 preference
Â
Purchase
 inten7on
16. @drkellypage!/drkellypage!Date: 10/7/13!
WHO?
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
WHY?
Â
The Research Process
Â
Â
(2)
Creating of the
Research
Design
(4)
Selecting the
Sampling
Procedure
(5)
Collecting the
Data
(6)
Analyzing the
Data
(7)
Writing and
Presenting the
Report
(8)
Follow-up
(1)
Identification of
the Problem
and Statement
of Objectives
(3)
Choosing the
Method of
Research
17. @drkellypage!/drkellypage!Date: 10/7/13!
STAGE 4:
Selecting the Sampling Procedure
Samples & Populations
â˘âŻ Census SamplingâŚ
â˘âŻ Probability Sampling:
âEvery case (person) in a population has a statistically equal
probability of being selected for researchâ.
â˘âŻ Non-probability Sampling:
âNot every case (person) in a population has a statistically equal
probability of being selected for researchâ.
Chicago
 Arts
 Ins9tute:
 Not
 only
 picked
 a
 sample
Â
of
 arts
 students
 but
 oneâs
 who
 had
 the
Â
characteris%cs
 to
 be
 brand
 ambassadors
 of
 the
Â
futureâŚ
Â
18. @drkellypage!/drkellypage!Date: 10/7/13!
Â
Â
Â
Â
Â
Â
WHY?
Â
The Research Process
Â
Â
(2)
Creating of the
Research
Design
(4)
Selecting the
Sampling
Procedure
(5)
Collecting the
Data
(6)
Analyzing the
Data
(7)
Writing and
Presenting the
Report
(8)
Follow-up
(1)
Identification of
the Problem
and Statement
of Objectives
(3)
Choosing the
Method of
Research
HOW?
Â
19. @drkellypage!/drkellypage!Date: 10/7/13!
Topline
Â
Approach
Â
â˘âŻ Focus
 on
 quality
Â
â˘âŻ Designed
 to
 âask
 whyâ
 people
Â
act
 on
 mo7va7ons
 for
 decisions
Â
Method
Â
â˘âŻ Observa7ons
Â
â˘âŻ In-Ââdepth
 interviews
Â
â˘âŻ Focus
 Groups
Â
Skill
Â
â˘âŻ Challenging
 for
 small,
 mid-Ââsize
Â
arts
 organiza7ons
Â
â˘âŻ Need
 experienced
 researchers
Â
Audience
 Considera6ons
Â
Qualitative: Why?
20. @drkellypage!/drkellypage!Date: 10/7/13!
Observation Research
â˘âŻ Two Main Approaches:
â˘âŻ Participant observation involves interaction with those being
watched.
â˘âŻ Ethnography (NTW, Southbank Centre, Redmoon Theater)
â˘âŻ âGoing Nativeâ --- Hanging out with people.
â˘âŻ Non-participant observation involves no interaction with the
participants.
â˘âŻ Human (watching) / (lurking)
â˘âŻ Electronic methods (Camera; Apps)
â˘âŻ Quantcast, Web Trends Analytics
23. @drkellypage!/drkellypage!Date: 10/7/13!
Focus Group
An interview conducted by a trained moderator among a small group of respondents
in an unstructured and natural manner.
â˘âŻ Discussion group involving 8-12 people
â˘âŻ Last from 1-3 hours
â˘âŻ Relaxed environment
â˘âŻ Incentivized
â˘âŻ Requires a homogenous group of participants
â˘âŻ Aims to establish group consensus / difference of opinion
â˘âŻ Considerations when using FGâs:
(a)⯠Selecting respondents
(b) Choosing a venue
(c) Client involvement
(d) How many focus groups?
(e) Record keeping
(f) How do I moderate a focus group?
24. @drkellypage!/drkellypage!Date: 10/7/13!
Interviews
What is a depth interview?"
â˘âŻ âAn unstructured, direct, personal interview in which a single
respondent is probed by a highly skilled interviewer to uncover
underlying motivations, beliefs, attitudes, and feelings on a
topicâ.!
Properties of a depth-interview:"
â˘âŻ 20 minutes-1 hour!
â˘âŻ The interviewer has pre-planned questions, but then
encourages the respondent to talk freely about his/her
opinions towards an issue!
â˘âŻ Interviewer follows up with probing questions!
â˘âŻ Good interviewers listen to a greater extent than talk!
25. @drkellypage!/drkellypage!Date: 10/7/13!
The Discussion Guide
1. Why do we need a guide / schedule?
â˘âŻ To help in formulating the research
â˘âŻ To ensure all questions are covered
â˘âŻ To improve reliability between
interviews / FGâs
â˘âŻ As a safety net for the researcher
2. Properties of the guide / schedule:
â˘âŻ Best kept to one-two pages.
â˘âŻ Have a checklist of preamble:
â˘âŻ Consent forms, format, timings,
incentives
â˘âŻ Rules (if a FG)
â˘âŻ Have some introduction:
â˘âŻ Breaking the ice
Have the main questions:
â˘âŻ Use the filter approach â can be very
structured and specific or very loose
and open-ended depending on the
study.:
â˘âŻ If interested in separate themes,
break this into topics of discussion:
e.g.
â˘âŻ Attitudes
â˘âŻ Intentions
â˘âŻ Behavior
3. Close - Have a checklist of key information
â˘âŻ Confidentiality
â˘âŻ Follow-up queries
â˘âŻ Result summary (?)
26. @drkellypage!/drkellypage!Date: 10/7/13!
Quantitative: âWhoâ and âWhatâ
Approach
Â
â˘âŻ Focus
 on
 quan7ty
Â
â˘âŻ Designed
 to
 âcountâ
 people
Â
with
 spec
 behavior
 or
 aYtudes
Â
Method
Â
â˘âŻ Survey
Â
â˘âŻ Ques7onnaire
Â
Skill
Â
â˘âŻ Simple
 for
 small,
 mid-Ââsize
 arts
Â
organiza7ons
Â
â˘âŻ Easy;
 No
 specialist
 required
Â
â˘âŻ Topline
 Audience
 Considera6ons
Â
28. @drkellypage!/drkellypage!Date: 10/7/13!
Questionnaire Design Process
Measurement Types:
â˘âŻ Measurement
â⯠The process of assigning numbers or labels to personâs, objects,
or events in accordance with specific rules for representing
quantities and qualities of attributes e.g., Biological Sex: 0 =
Males, 1 = Female
â˘âŻ Levels of Measurement
â⯠Nominal (a)
â⯠Ordinal (b)
â⯠Interval
â⯠Ratio
b)
 How
 frequently
 do
 you
 use
 the
 Internet?
Â
Â
 Â
 Once
 a
 month
Â
Â
 1
Â
 Â
 Twice
 a
 month
Â
Â
 2
Â
 Â
 Once
 a
 week
Â
Â
Â
Â
 3
Â
 Â
 Twice
 a
 week
Â
Â
Â
Â
 4
Â
a)
 Please
 indicate
 your
 gender?
Â
Â
 Â
 Male
Â
Â
Â
Â
Â
Â
 0
Â
 Â
 Female
Â
 1
Â
29. @drkellypage!/drkellypage!Date: 10/7/13!
Question Response Format
Open-ended questions"
â˘âŻ Participant responds in own
words!
â˘âŻ Open response option (a)!
"
Close-ended questions"
â˘âŻ Participants required to choose
from a pre-determined list of
answers!
â˘âŻ Dichotomous (b)!
â˘âŻ Multichotomous c)!
"
Partially open-ended (d)"
b)
 Have
 you
 used
 the
 Internet
 today?
Â
Â
 Â
 Yes
Â
Â
 Â
 No
Â
c)
 Which
 best
 represents
 your
 age?
Â
 a)
 Under
 17
Â
Â
Â
Â
Â
Â
Â
 d)
 36-Ââ50
Â
 b)
 18-Ââ25
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
 e)
 51-Ââ65
Â
 c)
 26-Ââ35
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
 f)
 66+
Â
d)
 What
 is
 your
 preferred
 brand
 of
 car?
Â
Â
 Â
 BMW
 Â
 Mercedes
 Â
 Ford
 Â
 Other
 (please
 specify)
 ________________
Â
a)
 Why
 is
 brand
 X
 be<er?
Â
30. @drkellypage!/drkellypage!Date: 10/7/13!
Question Wording
â˘âŻ Objectionable questions
â⯠How old are you? ________________ (Too Direct)
â⯠Please indicate your age: (Better)
â˘âŻ Bias in more than one direction
â⯠Are you against same sex marriage and in favour of legislation
to ban it? (Biased)
â⯠What is your view of same sex marriage? (Less Bias)
â˘âŻ Emotionally charged words
â⯠Was the government negligent by ignoring the views of the
people whom were opposed to the war in Iraq? (Emotional)
â⯠Given the views expressed against the ware in Iraq, what
should have the government done? (Less Emotional)
31. @drkellypage!/drkellypage!Date: 10/7/13!
Question Wording II
â˘âŻ Estimation questions
â⯠What is your yearly cat food expenditure? (Too difficult)
â⯠Approximately how much do you spend per week on your
cat food?: (Easier)
â˘âŻ Double-barreled questions
â⯠Do you like rap and rock music? (Two questions)
â⯠Do you like rap music? (One question)
â⯠Do you like rock music? (One question)
â˘âŻ Double negatives
â⯠Do you dislike it when people donât wipe their feet when
entering your home?
32. @drkellypage!/drkellypage!Date: 10/7/13!
Flow & Layout
General Guidelines:
â˘âŻ Divide the questionnaire into sub-sections
â˘âŻ Use Times Roman for the text (or Arial)
â˘âŻ Donât put too much information on a page
â˘âŻ Makes the questionnaire look complex reducing uptake
â˘âŻ Use vertical columns for lists
Suggested Layout:
â˘âŻ Screening questions: Use to identify appropriate respondents
â˘âŻ Questions to gain interest (Warm-ups): Easy to answer questions
â˘âŻ General Questions: e.g., behavioral question about purchase/usage
â˘âŻ Difficult & Complicated questions - e.g. attitudes, rankings etc
â˘âŻ Position sensitive, threatening, and demographic questions at the end -
e.g., age, income etc.
â˘âŻ Distinguish instructions - e.g., capitals, italics
35. @drkellypage!/drkellypage!Date: 10/7/13!
Analytical Design
Qualitative Data
â˘âŻ Sorting and categorization of interview text is used to identify
emerging themes
â˘âŻ Top-of-mind preferences are used to answer the question
âwhyâ
â˘âŻ Projective techniques yield patterns
â˘âŻ Triangulation uses multiple methods to authenticate the data
collection and analysis
"
Quantitative Data"
â˘âŻ Descriptive statistics: frequencies, cross-tabulations,
correlations. !
â˘âŻ Multivariate statistics: regression, SEM etc!
36. @drkellypage!/drkellypage!Date: 10/7/13!
DISSEMINATE
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
WHY?
Â
The Research Process
Â
Â
(2)
Creating of the
Research
Design
(4)
Selecting the
Sampling
Procedure
(5)
Collecting the
Data
(6)
Analyzing the
Data
(7)
Writing and
Presenting the
Report
(8)
Follow-up
(1)
Identification of
the Problem
and Statement
of Objectives
(3)
Choosing the
Method of
Research
HOW?
Â
38. @drkellypage!/drkellypage!Date: 10/7/13!
Lifestage vs. Frequency of Use
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Infancy Teenager Newlyweds Parents The Golden
Years
Frequency
Rarely
Occasionally
Regularly
Frequently
39. @drkellypage!/drkellypage!Date: 10/7/13!
Audience Frequency of Use vs. Information Used
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%Frequently
Regularly
O
ccasionally
Rarely
Frequency
Advocacy/Activism
Personal Satisfaction
Purchase behavior
Demographic
*select all that apply
40. @drkellypage!/drkellypage!Date: 10/7/13!
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Â
Problem
 Addressed/Insight?
Â
Â
Â
Â
Â
Â
Â
WHY?
Â
The Research Process
Â
Â
(2)
Creating of the
Research
Design
(4)
Selecting the
Sampling
Procedure
(5)
Collecting the
Data
(6)
Analyzing the
Data
(7)
Writing and
Presenting the
Report
(8)
Follow-up
(1)
Identification of
the Problem
and Statement
of Objectives
(3)
Choosing the
Method of
Research
HOW?
Â