SlideShare une entreprise Scribd logo
1  sur  18
Télécharger pour lire hors ligne
Leading People to
Longer Queries
+ CHI 2013
-Elena Agapie, et al.
/정다미
x 2014 winter
AUTHOR
Elena Agapie
Harvard University
->Microsoft Research Fuse Labs

Gene Golovchinsky
FX Palo Alto Laboratory, Inc.

Pernilla Qvarfordt
FX Palo Alto Laboratory, Inc.
INTRODUCTION
✴

좀 더 긴 키워드 쿼리가 정보요구를 상세히 표현할 수 있고 원하는 것만 나올 수
있게 검색 결과를 좁힐 수 있어 좋은 검색 결과로 이끈다

✴

하지만, 사람들은 짧은 쿼리를 입력하려고 한다

✴

검색창 비쥬얼라이제이션이 검색어 입력에 영향을 미치는지 실험
-> 검색창 디자인에 변화를 주어 더 긴 쿼리를 입력하게 하고자 함
USER INTERFACE
Halo

✴ 검색어 길이에 따라 검색창 주위로 여
러 색깔의 후광(halo)가 나타나게 함

✴

long queries -> 7개 단어 이상

✴ animating color change
EXPERIMENT1

Search Tasks
✴ Search puzzles (A-Google-a-day, agoogleaday.com)

Task Question
Task 1. 세계최초 삼단돔(triple-domed) 성당을 만든
건축가가 런던 대화제 이후 지은 교회의 수는?
Task 2. 포유류가(영장류 제외) 식용으로 삼는 나무는?
Task 3. 비결정성 고체 형태의 저녁식사 아이템을 만
들기 위해서는 라임, 소다와 함께 어떤 재료를 섞어야
하는가?
EXPERIMENT1

Experimental sw/design
✴ web-based system
1

2

1. Task Question
2. Answer & Evidence

3

어디서 정보 발견했는지 기록하게 함
-> 추측, 이미 알고있는 지식으로 답하는거 방지

3. Query Box & SearchResults
BING search API
Filtering ‘google’, ‘google a day’
puzzle question 그대로 쿼리로 입력하는 것 금지
EXPERIMENT1

Experimental design
✴ 2 X 2 factorial between-subjects experiment design
Halo O

Halo X

Instruction X

1
Group 1

3
Group 1

Instruction O

2
Group 1

4
Group 1

✴ Subjects through Mechanical Turk / 100 participants -> 61 completed
✴ Analysis of 451 query
Hypotheses

EXPERIMENT1

H 1. 검색창 주변의 halo visualization이 길이가 긴 쿼리를 입력하게하는가?
(the halo visualization around the query box would result in people typing longer queries)

H 2. 긴 쿼리 입력에 대한 효과에 대한 명시가 사람들이 입력하는 쿼리 길이에 영향
을 끼치는가?
(instruction about the effect of longer queries would result in longer queries)
Results
✴ two-way ANOVA

Halo 있을 때가 없을 때 보다 더 쿼리
길게 입력 (F(1, 447) = 5.1, p<0.05)
Instruction 쿼리 길이에 영향 안끼침
(F(1,447) = 3.4, p=0.064)

-> Halo와 Instruction 사이에 유의미한 차이 있음 (F(1,447) = 41.7, P<0.001)

EXPERIMENT1
Results
✴ 사후 검증 Tukey HSD test

Halo + No instruction 이 가장 좋은
결과(쿼리 가장 길게 입력) 나타냄
아무것도 없는것이, No Halo+Inst. 보
다 더 낫다 (p < 0.01)

EXPERIMENT1
Search Tasks

EXPERIMENT2

✴ Goal : Halo효과가 단지 특정 색깔 때문인지, 인터랙티브 측면 때문인지 검증
✴ Experiment1에서와 task, 피실험자 모집 비슷
✴ Google-A-Day에서 좀 더 복잡해보이는 문제로 새로 고름
Task 1. I’m a serious piece of music known for comedy. I was played by a famous cat. I’ve been played by a
woodpecker, dueling ducks and two vaudevillian brothers. Who composed me?
Task 2. There may be 39 signatures on the U.S. Constitution, but there were only 38 signers. Which state’s absent
delegate had his name signed by a colleague?
Task 3.You are standing in the farthest west U.S. town with a population of one person. What is the speed limit?
Experimental design
✴ one factor between-subject design
✴ factor : color
1) Halo : red -> blue
2) Inverted : blue -> red
3) Static : static blue
4) Control : no halo

EXPERIMENT2
Hypotheses
H1. 인터랙티브한 Halo가 더 긴 쿼리를 입력하게 할 것이다
<- 색깔의 변화가(인터랙티브) 사람들이 계속해서 검색창을 주목하게 한다고 가정
(the change in color was responsible for people’s continued attention)
Halo, Inverted가 Static, Control보다 더 좋은 결과 낼 것

EXPERIMENT2
EXPERIMENT2

Results
✴ 84 participants, 1077 queries
✴ one-way ANOVA

정적인 검색창
인터랙티브 검색창

-> 인터랙티브 color 변화가 쿼리를 더 길게 쓰게 만듦
(F(3,1073) = 3.876, p<0.05)
Results
✴ 사후 검증 Tukey HSD test

Halo가 가장 더 길게 쿼
리 입력하게 함 (p<0.05)
(Halo와 Inverted 사이에 유의미한 차이 없음)

EXPERIMENT2
DISCUSSION
✴ Red -> Blue halo 효과 있었음
: 실험1에서처럼 Instruction 있고 반대의 경우(Blue -> Red)에 대해서는 검증 못함
: 문화적 규범 때문일 수도

✴ 실험1에서 halo / control 비교와

(6.6 / 4.2 words)

실험2에서 halo / control 비교의 (6.52 / 5.73 words) 검색어 길이 차이는?
-> 실험2가 더 어려웠음, 정답률도 낮음(실험1 0.69 vs 실험2 0.39)

✴ 더 많은 토픽에 대해 실험할 필요 있음
CONCLUSION
✴ Search에서의 persuasive technology 적용
✴ 새로운 인터랙션 기술로 쿼리를 더 길게 입력하게 하였고, Mechanical Turk로 실
험함

✴ Evaluation 결과는 이 분야 더 조사할만한 것이라고 제안
DISCUSSION POINT
✴ 논문 검색할 때, 내가 찾는 주제와 관련된 키워드를 생각해내고 검색하는게 어렵
지 않나요?

✴ 나만의 논문검색 노하우는?

Contenu connexe

En vedette

Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 

En vedette (20)

Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 

Leading People to Longer Queries

  • 1. Leading People to Longer Queries + CHI 2013 -Elena Agapie, et al. /정다미 x 2014 winter
  • 2. AUTHOR Elena Agapie Harvard University ->Microsoft Research Fuse Labs Gene Golovchinsky FX Palo Alto Laboratory, Inc. Pernilla Qvarfordt FX Palo Alto Laboratory, Inc.
  • 3. INTRODUCTION ✴ 좀 더 긴 키워드 쿼리가 정보요구를 상세히 표현할 수 있고 원하는 것만 나올 수 있게 검색 결과를 좁힐 수 있어 좋은 검색 결과로 이끈다 ✴ 하지만, 사람들은 짧은 쿼리를 입력하려고 한다 ✴ 검색창 비쥬얼라이제이션이 검색어 입력에 영향을 미치는지 실험 -> 검색창 디자인에 변화를 주어 더 긴 쿼리를 입력하게 하고자 함
  • 4. USER INTERFACE Halo ✴ 검색어 길이에 따라 검색창 주위로 여 러 색깔의 후광(halo)가 나타나게 함 ✴ long queries -> 7개 단어 이상 ✴ animating color change
  • 5. EXPERIMENT1 Search Tasks ✴ Search puzzles (A-Google-a-day, agoogleaday.com) Task Question Task 1. 세계최초 삼단돔(triple-domed) 성당을 만든 건축가가 런던 대화제 이후 지은 교회의 수는? Task 2. 포유류가(영장류 제외) 식용으로 삼는 나무는? Task 3. 비결정성 고체 형태의 저녁식사 아이템을 만 들기 위해서는 라임, 소다와 함께 어떤 재료를 섞어야 하는가?
  • 6. EXPERIMENT1 Experimental sw/design ✴ web-based system 1 2 1. Task Question 2. Answer & Evidence 3 어디서 정보 발견했는지 기록하게 함 -> 추측, 이미 알고있는 지식으로 답하는거 방지 3. Query Box & SearchResults BING search API Filtering ‘google’, ‘google a day’ puzzle question 그대로 쿼리로 입력하는 것 금지
  • 7. EXPERIMENT1 Experimental design ✴ 2 X 2 factorial between-subjects experiment design Halo O Halo X Instruction X 1 Group 1 3 Group 1 Instruction O 2 Group 1 4 Group 1 ✴ Subjects through Mechanical Turk / 100 participants -> 61 completed ✴ Analysis of 451 query
  • 8. Hypotheses EXPERIMENT1 H 1. 검색창 주변의 halo visualization이 길이가 긴 쿼리를 입력하게하는가? (the halo visualization around the query box would result in people typing longer queries) H 2. 긴 쿼리 입력에 대한 효과에 대한 명시가 사람들이 입력하는 쿼리 길이에 영향 을 끼치는가? (instruction about the effect of longer queries would result in longer queries)
  • 9. Results ✴ two-way ANOVA Halo 있을 때가 없을 때 보다 더 쿼리 길게 입력 (F(1, 447) = 5.1, p<0.05) Instruction 쿼리 길이에 영향 안끼침 (F(1,447) = 3.4, p=0.064) -> Halo와 Instruction 사이에 유의미한 차이 있음 (F(1,447) = 41.7, P<0.001) EXPERIMENT1
  • 10. Results ✴ 사후 검증 Tukey HSD test Halo + No instruction 이 가장 좋은 결과(쿼리 가장 길게 입력) 나타냄 아무것도 없는것이, No Halo+Inst. 보 다 더 낫다 (p < 0.01) EXPERIMENT1
  • 11. Search Tasks EXPERIMENT2 ✴ Goal : Halo효과가 단지 특정 색깔 때문인지, 인터랙티브 측면 때문인지 검증 ✴ Experiment1에서와 task, 피실험자 모집 비슷 ✴ Google-A-Day에서 좀 더 복잡해보이는 문제로 새로 고름 Task 1. I’m a serious piece of music known for comedy. I was played by a famous cat. I’ve been played by a woodpecker, dueling ducks and two vaudevillian brothers. Who composed me? Task 2. There may be 39 signatures on the U.S. Constitution, but there were only 38 signers. Which state’s absent delegate had his name signed by a colleague? Task 3.You are standing in the farthest west U.S. town with a population of one person. What is the speed limit?
  • 12. Experimental design ✴ one factor between-subject design ✴ factor : color 1) Halo : red -> blue 2) Inverted : blue -> red 3) Static : static blue 4) Control : no halo EXPERIMENT2
  • 13. Hypotheses H1. 인터랙티브한 Halo가 더 긴 쿼리를 입력하게 할 것이다 <- 색깔의 변화가(인터랙티브) 사람들이 계속해서 검색창을 주목하게 한다고 가정 (the change in color was responsible for people’s continued attention) Halo, Inverted가 Static, Control보다 더 좋은 결과 낼 것 EXPERIMENT2
  • 14. EXPERIMENT2 Results ✴ 84 participants, 1077 queries ✴ one-way ANOVA 정적인 검색창 인터랙티브 검색창 -> 인터랙티브 color 변화가 쿼리를 더 길게 쓰게 만듦 (F(3,1073) = 3.876, p<0.05)
  • 15. Results ✴ 사후 검증 Tukey HSD test Halo가 가장 더 길게 쿼 리 입력하게 함 (p<0.05) (Halo와 Inverted 사이에 유의미한 차이 없음) EXPERIMENT2
  • 16. DISCUSSION ✴ Red -> Blue halo 효과 있었음 : 실험1에서처럼 Instruction 있고 반대의 경우(Blue -> Red)에 대해서는 검증 못함 : 문화적 규범 때문일 수도 ✴ 실험1에서 halo / control 비교와 (6.6 / 4.2 words) 실험2에서 halo / control 비교의 (6.52 / 5.73 words) 검색어 길이 차이는? -> 실험2가 더 어려웠음, 정답률도 낮음(실험1 0.69 vs 실험2 0.39) ✴ 더 많은 토픽에 대해 실험할 필요 있음
  • 17. CONCLUSION ✴ Search에서의 persuasive technology 적용 ✴ 새로운 인터랙션 기술로 쿼리를 더 길게 입력하게 하였고, Mechanical Turk로 실 험함 ✴ Evaluation 결과는 이 분야 더 조사할만한 것이라고 제안
  • 18. DISCUSSION POINT ✴ 논문 검색할 때, 내가 찾는 주제와 관련된 키워드를 생각해내고 검색하는게 어렵 지 않나요? ✴ 나만의 논문검색 노하우는?