SlideShare une entreprise Scribd logo
1  sur  39
“I like to explore sometimes”:
Adapting to Dynamic User
Novelty Preferences
Komal
Kapoor
Vikas
Kumar
Joe
Konstan
Paul
Schrater
Loren
Terveen
1Twitter: #adaNovR
In this paper:
predict novelty preferences based on past
consumption behavior.
users’ novelty preferences vary over time.
adaptive novelty recommender
2
What are Preferences?
Preferences determine how we make our
everyday choices…
3
What are Preferences?
Preferences determine how we make our
everyday choices…
Wait!!
Everyone knows this!
4
What are Preferences?
Novelty Preferences determine how well we
appreciate new items..
Novelty
Source: tumblr
5
Why we want to understand these
novelty preferences?
Explore Recommend
same old
Bored Churn
Exploit Recommend
New Items
Frustration Churn
6
Why we want to understand these
novelty preferences?
Explore Recommend
same old
Bored Churn
Exploit Recommend
New Items
Frustration Churn
7
Static Preference Models
Similar Users Have
Similar Preferences
Users Prefer
Similar Items
User-based Filtering Item-based Filtering
8
Static Preference Models
Similar Users Have
Similar Preferences
Users Prefer
Similar Items
User-based Filtering Item-based Filtering
No understanding of user
consumption behavior.
Fails when preferences change!!
9
Dynamic Novelty Preference
» not every user seek new
items
» some users seek (or
explore) more
» even they do it sometimes
10
Dynamic Novelty Preference
» not every user seek new
items
» some users seek (or
explore) more
» even they do it sometimes
11
Add value to user experience by
understanding their (changing) need
better
Data
» Music data:
• Closely related to human emotions and behavior
responses
• Low risk/cost of consumption
» Two Datasets:
NDA
12
Details: last.fm
last.fm
Duration 3 months
Number of Users 882
Avg. #session per user 56
Avg. session Length
(#items)
39
13
User Timeline: Sessions
14
User Timeline: Definitions
• Familiar Set:
• items recently consumed by user (within time
window T)
• Novel or New Set:
• New items consumed **compared to
previous familiar set (T-1)**
15
User Timeline: Definitions
• Familiar Set:
• items recently consumed by user (within time
window T)
• Novel or New Set:
• New items consumed **compared to
previous familiar set** set.
Novelty Seeking Score (nvSeek) =
#new-items / #unique-items
16
In this paper:
predict novelty preferences based on past
consumption behavior.
users’ novelty preferences vary over time.
adaptive novelty recommender
17
Results (1):
Users have different novelty preferences
Novelty Seeking Score
NumberofUsers
• We have some high
as well as some low
novelty seeking
users.
• Scores vary across
the users ( s.d >
0, p-val ~ 0)
18
Results (2):
Users have dynamic novelty preferences
Seeking Deviation
NumberofUsers
• users’ seeking score
deviation across multiple
time window.
• users show dynamic
seeking score over a
period of three months
(Mean > 0, pval ~ 0)
19
In this paper:
predict novelty preferences based on past
consumption behavior.
users’ novelty preferences vary over time.
adaptive novelty recommender
20
Intuition
Diverse users are likely to be
more novelty seeking
Diversity of the familiar set
User bored with their current
selection are likely to be more
novelty seeking
Boredom with the familiar set
21
Model features:
» Diversity = more items, more diverse
» Boredom:
• Dynamic Item Preference [Kapoor et al, WSDM 2015]
– More you play, OR
– less gap between your plays
Fast to reach boredom
22
Model
» Logistic Regression Model:
• prediction novelty preference score based on
past consumptions
23
Results:
» Accurate seeking score predictions than
constant novelty.
» Both features are significant and
positively correlated
• higher diversity seeking new items
• higher boredom seeking new items
24
In this paper:
predict novelty preferences based on past
consumption behavior.
users’ novelty preferences vary over time.
adaptive novelty recommender
25
Adaptive Recommendation
» Existing Systems:
» Adaptive System:
Novelty
Seeking
Score
26
Adaptive Novelty Recommendation
Novelty
Preference
High!
F1
F2
F3
F4
….
N1
N2
N3
N4
….
F1
N1
N2
F2
N3
….
Novelty
Preference
Low!
F1
F2
F3
F4
….
N1
N2
N3
N4
….
F1
F2
F2
N1
F4
….
27
Design
Adaptive Recommendation
Module
Novelty Seeking Prediction Module
Item Ranking Module
User Timelines
(Past Sessions)
Ranked
Familiar
Items
Ranked
Novel
Items
Consumed/
Rated Items
Behavioral/
Session
Attributes
Novelty
Seeking
Input Output
OutputInput
Top-N
Recommendations
- Item1
- Item2
- ItemN
Current Session
Recommendations
System Design
Adaptive
Ranking
Explicit
Implicit
28
Evaluation
» Baselines
• Item Based CF
• Constant Novelty
• PureN : only novel or new items
• PureF : only familiar items
29
Metrics
» Metrics
• Recommendation Accuracy
• cost sensitive weighted F-measure
• Novelty Accuracy:
• new items recommended Vs. new items consumed
30
Results
Recommendation Accurracy
Last.fm
Weighted F-measure for different novelty seeking score
31
Results
Recommendation Accurracy
Last.fm
Weighted F-measure for different novelty seeking score
Performance of PureF and Item Based
declines as novelty seeking score
increases
32
Results
Recommendation Accurracy
Last.fm
Weighted F-measure for different novelty seeking score
adaNov-R performs comparable to the
best baseline for all novelty seeking
scores 33
Novelty Accuracy
34
Novelty Accuracy
adaNov-R capable to adapt to number of
new items.
35
Novelty Accuracy
PureN provides all new items.
Item based CF rarely provides new
items
36
Key Takeaways:
» Novelty Preferences are dynamic across
and within users
» Past consumption provides significant
signal to predict future novelty
preferences.
» A recommender capable to adapt to
novelty preference
37
Conclusion
» Modeling novelty preference dynamics
significantly impacts recommendation
design
» Future Work:
• Study the effect on retention due to adaptive
recommendations.
38
Danke!!
(thanks!!)
Supported by National Science Foundation under grants IIS 08-08692, IIS 09-
64695, UMN SOBACO grant and Doctoral Dissertation Fellowship.
Questions?
39

Contenu connexe

Similaire à "I like to explore sometimes": Adapting to Dynamic User Novelty Preferences

Best data science courses in pune
Best data science courses in puneBest data science courses in pune
Best data science courses in puneprathyusha1234
 
Top data science institutes in hyderabad
Top data science institutes in hyderabadTop data science institutes in hyderabad
Top data science institutes in hyderabadprathyusha1234
 
best online data science courses
best online data science coursesbest online data science courses
best online data science coursesprathyusha1234
 
Recommender systems
Recommender systemsRecommender systems
Recommender systemsTamer Rezk
 
case based recommendation approach for market basket data
case based recommendation approach for market basket datacase based recommendation approach for market basket data
case based recommendation approach for market basket datamniranjanmurthy
 
Overview of recommender system
Overview of recommender systemOverview of recommender system
Overview of recommender systemStanley Wang
 
Usability evaluations (part 2)
Usability evaluations (part 2) Usability evaluations (part 2)
Usability evaluations (part 2) Andres Baravalle
 
Introduction to recommender systems
Introduction to recommender systemsIntroduction to recommender systems
Introduction to recommender systemsAndrea Gigli
 
The Universal Recommender
The Universal RecommenderThe Universal Recommender
The Universal RecommenderPat Ferrel
 
Tutorial on sequence aware recommender systems - UMAP 2018
Tutorial on sequence aware recommender systems - UMAP 2018Tutorial on sequence aware recommender systems - UMAP 2018
Tutorial on sequence aware recommender systems - UMAP 2018Paolo Cremonesi
 
Bmgt 311 chapter_4
Bmgt 311 chapter_4Bmgt 311 chapter_4
Bmgt 311 chapter_4Chris Lovett
 
Recommender systems for E-commerce
Recommender systems for E-commerceRecommender systems for E-commerce
Recommender systems for E-commerceAlexander Konduforov
 
Recommendation engines
Recommendation enginesRecommendation engines
Recommendation enginesGeorgian Micsa
 
Mod5_Recommendation Systems.pptx
Mod5_Recommendation Systems.pptxMod5_Recommendation Systems.pptx
Mod5_Recommendation Systems.pptxdivyammo
 

Similaire à "I like to explore sometimes": Adapting to Dynamic User Novelty Preferences (20)

Best data science courses in pune
Best data science courses in puneBest data science courses in pune
Best data science courses in pune
 
Top data science institutes in hyderabad
Top data science institutes in hyderabadTop data science institutes in hyderabad
Top data science institutes in hyderabad
 
best online data science courses
best online data science coursesbest online data science courses
best online data science courses
 
Recommender systems
Recommender systemsRecommender systems
Recommender systems
 
case based recommendation approach for market basket data
case based recommendation approach for market basket datacase based recommendation approach for market basket data
case based recommendation approach for market basket data
 
Overview of recommender system
Overview of recommender systemOverview of recommender system
Overview of recommender system
 
Recommenders.ppt
Recommenders.pptRecommenders.ppt
Recommenders.ppt
 
Recommenders.ppt
Recommenders.pptRecommenders.ppt
Recommenders.ppt
 
Usability evaluations (part 2)
Usability evaluations (part 2) Usability evaluations (part 2)
Usability evaluations (part 2)
 
Bmgt 311 week_4
Bmgt 311 week_4Bmgt 311 week_4
Bmgt 311 week_4
 
Introduction to recommender systems
Introduction to recommender systemsIntroduction to recommender systems
Introduction to recommender systems
 
The Universal Recommender
The Universal RecommenderThe Universal Recommender
The Universal Recommender
 
Tutorial on sequence aware recommender systems - UMAP 2018
Tutorial on sequence aware recommender systems - UMAP 2018Tutorial on sequence aware recommender systems - UMAP 2018
Tutorial on sequence aware recommender systems - UMAP 2018
 
Bmgt 311 chapter_4
Bmgt 311 chapter_4Bmgt 311 chapter_4
Bmgt 311 chapter_4
 
Recommender Systems
Recommender SystemsRecommender Systems
Recommender Systems
 
Recommender systems for E-commerce
Recommender systems for E-commerceRecommender systems for E-commerce
Recommender systems for E-commerce
 
Recommendation engines
Recommendation enginesRecommendation engines
Recommendation engines
 
MORS22.pdf
MORS22.pdfMORS22.pdf
MORS22.pdf
 
Mod5_Recommendation Systems.pptx
Mod5_Recommendation Systems.pptxMod5_Recommendation Systems.pptx
Mod5_Recommendation Systems.pptx
 
Recommender systems
Recommender systemsRecommender systems
Recommender systems
 

Dernier

Zoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfZoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfSumit Kumar yadav
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bSérgio Sacani
 
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...ssuser79fe74
 
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)Joonhun Lee
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY1301aanya
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryAlex Henderson
 
Unit5-Cloud.pptx for lpu course cse121 o
Unit5-Cloud.pptx for lpu course cse121 oUnit5-Cloud.pptx for lpu course cse121 o
Unit5-Cloud.pptx for lpu course cse121 oManavSingh202607
 
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)AkefAfaneh2
 
Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.Silpa
 
Conjugation, transduction and transformation
Conjugation, transduction and transformationConjugation, transduction and transformation
Conjugation, transduction and transformationAreesha Ahmad
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPirithiRaju
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.Nitya salvi
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPirithiRaju
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxRizalinePalanog2
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...chandars293
 
Bacterial Identification and Classifications
Bacterial Identification and ClassificationsBacterial Identification and Classifications
Bacterial Identification and ClassificationsAreesha Ahmad
 
Factory Acceptance Test( FAT).pptx .
Factory Acceptance Test( FAT).pptx       .Factory Acceptance Test( FAT).pptx       .
Factory Acceptance Test( FAT).pptx .Poonam Aher Patil
 
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 60009654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000Sapana Sha
 

Dernier (20)

Zoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfZoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdf
 
Site Acceptance Test .
Site Acceptance Test                    .Site Acceptance Test                    .
Site Acceptance Test .
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
 
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)
Feature-aligned N-BEATS with Sinkhorn divergence (ICLR '24)
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
 
Unit5-Cloud.pptx for lpu course cse121 o
Unit5-Cloud.pptx for lpu course cse121 oUnit5-Cloud.pptx for lpu course cse121 o
Unit5-Cloud.pptx for lpu course cse121 o
 
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
 
Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.
 
Conjugation, transduction and transformation
Conjugation, transduction and transformationConjugation, transduction and transformation
Conjugation, transduction and transformation
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
 
Clean In Place(CIP).pptx .
Clean In Place(CIP).pptx                 .Clean In Place(CIP).pptx                 .
Clean In Place(CIP).pptx .
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
 
Bacterial Identification and Classifications
Bacterial Identification and ClassificationsBacterial Identification and Classifications
Bacterial Identification and Classifications
 
Factory Acceptance Test( FAT).pptx .
Factory Acceptance Test( FAT).pptx       .Factory Acceptance Test( FAT).pptx       .
Factory Acceptance Test( FAT).pptx .
 
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 60009654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
 

"I like to explore sometimes": Adapting to Dynamic User Novelty Preferences

Notes de l'éditeur

  1. ----- Meeting Notes (9/16/15 14:43) ----- Explore Vs Exploit!! Lean back users Vs no interruption required users - One step closer to understand user behavior and able to make require changes in recommendations - Team!! (PhD Candidate @ GroupLens at University of Minnesota) - Paul - pysychological perspective
  2. Most of you listen to music. Raise your hand if you have been listening to same music playlist for over a month now? Now, raise your hand if you try to change your playlist often searching for new or music from the past?
  3. Most of you listen to music. Raise your hand if you have been listening to same music playlist for over a month now? Now, raise your hand if you try to change your playlist often searching for new or music from the past?
  4. Most of you listen to music. Raise your hand if you have been listening to same music playlist for over a month now? Now, raise your hand if you try to change your playlist often searching for new or music from the past?
  5. Now, if you
  6. We confirm the results with the other data too. Details are in the paper