Contextual surveys: going asynchronous for more context (by Bas de Luij, Senior Research Innovator InSites Consulting), presented at the NewMR online event on Advances in Quantitative Research on September 19, 2012.
Corporate Profile 47Billion Information Technology
Contextual surveys - Going asynchronous for more context (by Bas de Luij)
1. Contextual Surveys
going asynchronous for more context
Bas de Luij
bas@insites-consulting.com
@basdeluy
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
2. Our vision
At InSites Consulting we
believe that market research
should shift
• From validation to collaboration
• From asking questions to observing,
facilitating, and joining conversations
• From ad hoc and post hoc to always-on
and in-the-moment
• From rational thinking to emotional
sensing
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
3. How can we live up to
this vision in quant
surveys?
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
4. Are surveys a dead end
approach?
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
5. Are surveys a dead end
approach?
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
6. Our challenge
Rethink and take it step
by step
• How can we inspire both clients and
participants in more engaging surveys?
• How can we tell a lively story about
customers? And bring rich context next to
numbers and graphs?
• How can we can make people generate
information?
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
7. Fusing methods,
stretching boundaries
Fusion
Using the „goods‟ of qualitative
This means:
- Stretching the boundaries of quantitative
research by adding (ethnographic) tasks next
to questions
- photo, video, explore their environment
- Stretching the boundaries of our profession by
adding co-research elements
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
8. platform within a survey
no moderation, but automation
ethnographic tasks next to questions
explore your environment
make pictures
enables participants to co-researcher tasks
come back over time to complete in later stage Interview a peer
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
9. 4th of July project
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
10. Example task
Your 4th of July
party
Upload 6 pictures of you drinking and
or eating at the party. And describe
your decision on what you are drinking
or eating at that moment with as much
detail as possible:
- Why this food/drink?
- Why this moment? How did/do you
feel?
- Why this brand?
- What are your thoughts when
eating/drinking?
Good luck!
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
11. ForwaR&D lab test
Investigate the borders of task-based research in surveys
Investigate to what extent participants are capable and
willing of taking up a researcher‟s role in surveys
Find proof for contextual surveys being a good qualitative
Add-on
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
12. ForwaR&D lab test
Investigate the borders of task-based research in surveys
Panel members are quite willing to
participate in this type of survey.
Yes
38% (n=201)
62%
No
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
13. ForwaR&D lab test
Investigate the borders of task-based research in surveys
Contextual respondents show a drop in
their responses.
30% completed >80% of tasks
70% completed <80% of tasks
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
14. ForwaR&D lab test
Investigate the borders of task-based research in surveys
Leading to over
700 photos
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
15. ForwaR&D lab test
Investigate the borders of task-based research in surveys
Photo quality differs quite a lot.
~500 high quality/high relevance
~200 low relevance/“google images”
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
16. Investigate the borders of task-based research in surveys
This type of research adds a new
dimension to “straight lining”.
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
17. ForwaR&D lab test
Investigate to what extent participants are capable and
willing of taking up a researcher‟s role in surveys
Participants found it hard to complete the
co-research tasks (interview someons at
the party)
- Don‟t like to interrupt party people
- Found it hard to convince people to
take part
- Didn‟t like the idea of putting pictures
online
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
18. ForwaR&D lab test
Find proof for contextual surveys being a good qualitative
Add-on
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
19. ForwaR&D lab test
Find proof for contextual surveys being a good qualitative
Add-on
consumer story dashboard
fun, engaging, interactive experience
to slice, dice, deep zoom into content
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
20. 4th of July (survey only)
80%
Of Americans who celebrate the 4th of July attend/organize a backyard barbeque.
60%
Is (very) likely to consume beer during
this barbecue
Typical food at their party
Hamburgers 26%
Hot dogs 22%
Ribs 6%
Potato salad 6%
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
21. 4th of July (+contextual)
Unpretentious, relaxed, casual, food mostly home-
made, using all American brands.
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
22. ForwaR&D lab test
Find proof for contextual surveys being a good qualitative
Add-on
The high quality responses truly enrich our
data.
Pictures, personal stories and visual material
bring our respondents to live.
The consumer story dashboard allows us and
clients to immerse into their stories
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
23. Forward lab test
“I think this survey was pretty fun! :)”
“Interesting survey...wouldn't mind
doing another in the near future”
“Very cool and different survey”
“I like this survey, it was fun”
“good survey, i like this format.”
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
24. To
conclude…
1. High potential
2. Added value for clients
Deliver ‘best’ of both worlds
3. Learn more, improve
more
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
25. Q&A
Ray Poynter Bas de Luij
VCU, Vision Critical InSites Consulting
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
26. Thank you
Bas de Luij
bas@insites-consulting.com
@basdeluy
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2
27. Thank you
Bas de Luij
bas@insites-consulting.com
@basdeluy
Bas de Luij, InSites Consulting, Netherlands
NewMR Advances in Quantitative Research Event, 19 September 2012, Session 2