SlideShare une entreprise Scribd logo
1  sur  25
Télécharger pour lire hors ligne
Using Trust
in Recommender Systems:
  an experimental analysis

            Paolo Massa
         University of Trento

(joint work with Bobby Bhattacharjee, UMD)
Motivation:
1. Recommender Systems recommends
   items the user might like, based on
   past ratings.
2. Now, Decentralized publishing of info:
  – Ratings on Items
  – Trust on Principals
     [Semantic Web]
3. New issues (sparseness, scalability,
   trust, attacks, ...)
           ... Trust-aware Decentralized RS
Summary
1. Recommender Systems (RSs)
  – Weaknesses
2. Solution: trust-awareness
  – Trust and trust metrics
3. Experiments on Epinions.com
  – Evidence trust solves RSs problems
  – (~50.000 users!)
4. Future works
Collaborative Filtering (CF)
1.       Input: ratings given by users to items
     ●     I like “ Titanic” as 4/5
2.       I ask recommendation
3.       RS computes the similarity of me
         against every other user
     ●     Pearson correlation coefficient
4.       RS find similar users and suggests to
         me items liked by them.
Item 1
                         It e m 2
                                    It e m 3
                                               It e m 4
                   I
   User1       2 5 ? 5
               2 5 5 5
   User2       5                    1          3
   User3       5         5                     1
   User4       2
               2         5
                         5          5
                                    5          4
                                               4

It does not consider the content of the items, only
     the ratings given by users.
It works independently of the domain (also jokes)
                             BUT
Overlapping of rated items required!
RSs weaknesses
1. Ratings Matrix sparseness (95-99%)
  – Low or No overlapping (users not comparable)
2. Cold start
  – New users have 0 ratings (->not comparable)
3. Easy Attacks by Malicious Users
  – Copy profile and become the most similar
4. Hard to understand and control
  – Black box (bad recs -> user gives up)

                Solution? Trust of course!
Trust-awareness
1. Trust statement =Rating by human to
   human about her usefulness (ex: in
   providing good movie reviews)
2. Explicitly provided
3. Trust is subjective! T(A,Z)=1 & T(B,Z)=0
  – No Global BAD principals!!!
4. Trust is asymmetric! I trust Bill Gates.
5. FOAF (Friend-Of-A-Friend) is an XML
   format to express relationships
  – Some millions files out there...
Trust Networks




     ME




6 degrees of separation
“ theorem”
Trust metrics
1. Task: based on known trust edges,
   predict trustworthiness of principals
2. Trust propagation (A->B,B->C|A-?->C)
3. Global (pagerank, ebay, ...)
4. Local (personalized)


                                  ME
Trust solves RS problems
1.   Trust solves CF sparseness problem
   – trust propagation and “ 6 degrees” -> reach many
2. Trust solves Cold Start problem
   – “ just add 1 friend”
3. Trust metrics resistant to copy-profile-attack.
   – “ you can be similar but if no trust path to you ...”
4. Trust easier to understand and control
     –    trust nets supports Explanation (HCI tests needed)

              EVIDENCE of 1 and 2 provided by analyzing a
                 REAL, VAST community (Epinions.com)
Experiment: Epinions.com
1. Epinions.com' users can
  –   Review and rate items (from 1 to 5)
  –   Keep web of trust (trust=1) and block list (trust=0).
  –   “ Reviewers whose reviews and ratings you have
      consistently found to be valuable” (Epinions FAQ)
2. Dataset (by crawling site):
  – ~50K users, ~140K items, ~660K ratings.
  – ~500K trust statements.
      •   No block list (not shown on site)
Epinions' recommendations
Taken one user “ ME” , we can
- use CF on ratings and compute
    “ similarity” of other users
- use Trust Metric and compute
    “ trustworthiness” of other users
Then we can suggest items liked by similar
    or trustable users.

          On how many users are they
               computable?
Statistics (1)




#Ratings expressed by Users
(#rev<5) = 52.82%! [Cold start users]
Statistics (2)




#Trust statements expressed by Users
(#trust<5) = 70.18%!
User Similarity Computability
1. Ideally, every user should be
   comparable against every other user.
2. BUT ratings sparseness = 99.99135%
   -> tiny overlapping between 2 users
3. Pearson correlation coefficient
   meaningful only if overlapping(A,U)>1
4. Question: taken one user, how many
   users are comparable?
US computability (cont.)
1. Taken one user, we computed all the
   comparable users.
  – On average an user has 161 comparable
    users (ideally ~50.000!)
2. We have averaged
   #comparable_users over users who
   expressed a certain number of
   reviews.
US computability (cont.)




         Cold Start Users


Ex: users with 40 reviews have ~800 comparable users.
                            BUT users (y axis) are ~50.000!
             And for Cold Start Users (>50%) this is 2.74
Trust computability
1. Trust metrics predict trust in unknown
   users based on known trust
   statements.
2. Distance from ME to U is a first
   measure of Trust computability
3. On average,
  – In 2 steps, reach 400 users
  – In 3 steps, reach 4386 users
Mean # Reachable Users (in k steps) for users
   expressing X trust statements
    In few steps, you can predict trust in every user!
                         Even for Cold Start Users!!!
Trust and US computability
                  comparison
  Mean number of Comparable                Mean number of Comparable
      users for All users                   users for Cold Start users
     Propagating Trust             Using        Propagating Trust      Using
Dist 1   Dist 2   Dist 3   Dist 4 Pearson Dist 1 Dist 2 Dist 3 Dist 4 Pearson

9.88     400      4386 16334      161    2.14 94.54 1675       9121    2.74
Contribution
Experimental evidence that
  – CF is ineffective in real world scenarios
     •   Especially for Cold Start users.
  – Trust can solve CF problems
     •   Sparseness
     •   Cold Start
     •   Attacks (self-evident)


  Trust is computable on many more users than
     user similarity
     Especially for cold start users (the majority!)
Future works
1. US and Trust correlate? Contradict?
  – US over trusted is higher than usual?
2. Distrust?
  – Propagation? Properties?
3. Design a Trust Metric (for RS)
  – Create and evaluate a Trust-aware RS
     •   Input data
Thanks for your attention!



   Questions?

                                    Paolo Massa
                             Email: massa@itc.it
   Blog: http://moloko.itc.it/paoloblog/index.html
Collaborative Filtering
Similarity measure: Pearson Correlation
Coefficient of user a and u
                         m
                    ∑i=1 r a ,i −r a r u ,i −r u 
   w a , u=
               ∑    m
                     i=1
                         r a , i −r u 
                                           2      m
                                               ∑i=1 r u , i −r u 
                                                                      2



 Prediction of rating given by user a to ite
                         n
                    ∑u=1  r u , i −ru ∗w a , u
   p a , i =r a 
                                n
                             ∑u=1 w a , u
Hard Trust and Soft Trust
1. Vocabulary:
  – Hard Trust: about security, identity of
    something (user, device, information)
     •   Public key cryptography
  – Soft Trust: appreciation of some principal
    (explicitly provided by another principal)
     •   Social Networks and Trust Metrics

Contenu connexe

Similaire à Using Trust in Recommender Systems: an experimental analysis

Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...
Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...
Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...Paolo Massa
 
Trustlet, Open Research on Trust Metrics
Trustlet, Open Research on Trust MetricsTrustlet, Open Research on Trust Metrics
Trustlet, Open Research on Trust MetricsPaolo Massa
 
Estimating the Magic Barrier of Recommender Systems: A User Study
Estimating the Magic Barrier of Recommender Systems: A User StudyEstimating the Magic Barrier of Recommender Systems: A User Study
Estimating the Magic Barrier of Recommender Systems: A User StudyAlan Said
 
Alleviating cold-user start problem with users' social network data in recomm...
Alleviating cold-user start problem with users' social network data in recomm...Alleviating cold-user start problem with users' social network data in recomm...
Alleviating cold-user start problem with users' social network data in recomm...Eduardo Castillejo Gil
 
The Magic Barrier of Recommender Systems - No Magic, Just Ratings
The Magic Barrier of Recommender Systems - No Magic, Just RatingsThe Magic Barrier of Recommender Systems - No Magic, Just Ratings
The Magic Barrier of Recommender Systems - No Magic, Just RatingsAlan Said
 
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @ChorusRated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @ChorusSease
 
IRJET- Fake Review Detection using Opinion Mining
IRJET- Fake Review Detection using Opinion MiningIRJET- Fake Review Detection using Opinion Mining
IRJET- Fake Review Detection using Opinion MiningIRJET Journal
 
The Wisdom of the Few @SIGIR09
The Wisdom of the Few @SIGIR09The Wisdom of the Few @SIGIR09
The Wisdom of the Few @SIGIR09Xavier Amatriain
 
IJCAI Workshop Presentation
IJCAI Workshop PresentationIJCAI Workshop Presentation
IJCAI Workshop PresentationNeal Lathia
 
Collaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CFCollaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CFYusuke Yamamoto
 
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model    A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model IJECEIAES
 
Telefonica Lunch Seminar
Telefonica Lunch SeminarTelefonica Lunch Seminar
Telefonica Lunch SeminarNeal Lathia
 
Enhancing Multi-Aspect Collaborative Filtering for Personalized Recommendation
Enhancing Multi-Aspect Collaborative Filtering for Personalized RecommendationEnhancing Multi-Aspect Collaborative Filtering for Personalized Recommendation
Enhancing Multi-Aspect Collaborative Filtering for Personalized RecommendationNurfadhlina Mohd Sharef
 
Computing Ratings and Rankings by Mining Feedback Comments
Computing Ratings and Rankings by Mining Feedback CommentsComputing Ratings and Rankings by Mining Feedback Comments
Computing Ratings and Rankings by Mining Feedback CommentsIRJET Journal
 
Recommender Systems! @ASAI 2011
Recommender Systems! @ASAI 2011Recommender Systems! @ASAI 2011
Recommender Systems! @ASAI 2011Ernesto Mislej
 
Collective Opinion Spam Detection Bridging Review Networks and Metadata
Collective Opinion Spam Detection Bridging Review Networks and MetadataCollective Opinion Spam Detection Bridging Review Networks and Metadata
Collective Opinion Spam Detection Bridging Review Networks and MetadataShebuti Rayana
 
A Survey on Evaluating Sentiments by Using Artificial Neural Network
A Survey on Evaluating Sentiments by Using Artificial Neural NetworkA Survey on Evaluating Sentiments by Using Artificial Neural Network
A Survey on Evaluating Sentiments by Using Artificial Neural NetworkIRJET Journal
 
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptx
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptxIAC22 Safe Tech Audit Presentation Noreen Whysel.pptx
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptxNoreen Whysel
 
Endorphin. Making sense of social data
Endorphin. Making sense of social dataEndorphin. Making sense of social data
Endorphin. Making sense of social dataArtem Zavyalov
 
Rating System Algorithms Document
Rating System Algorithms DocumentRating System Algorithms Document
Rating System Algorithms DocumentScandala Tamang
 

Similaire à Using Trust in Recommender Systems: an experimental analysis (20)

Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...
Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...
Controversial Users demand Local Trust Metrics: an Experimental Study on Epin...
 
Trustlet, Open Research on Trust Metrics
Trustlet, Open Research on Trust MetricsTrustlet, Open Research on Trust Metrics
Trustlet, Open Research on Trust Metrics
 
Estimating the Magic Barrier of Recommender Systems: A User Study
Estimating the Magic Barrier of Recommender Systems: A User StudyEstimating the Magic Barrier of Recommender Systems: A User Study
Estimating the Magic Barrier of Recommender Systems: A User Study
 
Alleviating cold-user start problem with users' social network data in recomm...
Alleviating cold-user start problem with users' social network data in recomm...Alleviating cold-user start problem with users' social network data in recomm...
Alleviating cold-user start problem with users' social network data in recomm...
 
The Magic Barrier of Recommender Systems - No Magic, Just Ratings
The Magic Barrier of Recommender Systems - No Magic, Just RatingsThe Magic Barrier of Recommender Systems - No Magic, Just Ratings
The Magic Barrier of Recommender Systems - No Magic, Just Ratings
 
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @ChorusRated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
Rated Ranking Evaluator (RRE) Hands-on Relevance Testing @Chorus
 
IRJET- Fake Review Detection using Opinion Mining
IRJET- Fake Review Detection using Opinion MiningIRJET- Fake Review Detection using Opinion Mining
IRJET- Fake Review Detection using Opinion Mining
 
The Wisdom of the Few @SIGIR09
The Wisdom of the Few @SIGIR09The Wisdom of the Few @SIGIR09
The Wisdom of the Few @SIGIR09
 
IJCAI Workshop Presentation
IJCAI Workshop PresentationIJCAI Workshop Presentation
IJCAI Workshop Presentation
 
Collaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CFCollaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CF
 
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model    A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model
A Reliable Peer-to-Peer Platform for Adding New Node Using Trust Based Model
 
Telefonica Lunch Seminar
Telefonica Lunch SeminarTelefonica Lunch Seminar
Telefonica Lunch Seminar
 
Enhancing Multi-Aspect Collaborative Filtering for Personalized Recommendation
Enhancing Multi-Aspect Collaborative Filtering for Personalized RecommendationEnhancing Multi-Aspect Collaborative Filtering for Personalized Recommendation
Enhancing Multi-Aspect Collaborative Filtering for Personalized Recommendation
 
Computing Ratings and Rankings by Mining Feedback Comments
Computing Ratings and Rankings by Mining Feedback CommentsComputing Ratings and Rankings by Mining Feedback Comments
Computing Ratings and Rankings by Mining Feedback Comments
 
Recommender Systems! @ASAI 2011
Recommender Systems! @ASAI 2011Recommender Systems! @ASAI 2011
Recommender Systems! @ASAI 2011
 
Collective Opinion Spam Detection Bridging Review Networks and Metadata
Collective Opinion Spam Detection Bridging Review Networks and MetadataCollective Opinion Spam Detection Bridging Review Networks and Metadata
Collective Opinion Spam Detection Bridging Review Networks and Metadata
 
A Survey on Evaluating Sentiments by Using Artificial Neural Network
A Survey on Evaluating Sentiments by Using Artificial Neural NetworkA Survey on Evaluating Sentiments by Using Artificial Neural Network
A Survey on Evaluating Sentiments by Using Artificial Neural Network
 
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptx
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptxIAC22 Safe Tech Audit Presentation Noreen Whysel.pptx
IAC22 Safe Tech Audit Presentation Noreen Whysel.pptx
 
Endorphin. Making sense of social data
Endorphin. Making sense of social dataEndorphin. Making sense of social data
Endorphin. Making sense of social data
 
Rating System Algorithms Document
Rating System Algorithms DocumentRating System Algorithms Document
Rating System Algorithms Document
 

Plus de Paolo Massa

Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)
Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)
Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)Paolo Massa
 
Manypedia: Comparing Language Points of View of Wikipedia Communities
Manypedia: Comparing  Language Points of View  of Wikipedia CommunitiesManypedia: Comparing  Language Points of View  of Wikipedia Communities
Manypedia: Comparing Language Points of View of Wikipedia CommunitiesPaolo Massa
 
Gamification Features 4 Fitcity
Gamification Features 4 FitcityGamification Features 4 Fitcity
Gamification Features 4 FitcityPaolo Massa
 
Rete e Reti: Per-che' e per-chi?
Rete e Reti: Per-che' e per-chi?Rete e Reti: Per-che' e per-chi?
Rete e Reti: Per-che' e per-chi?Paolo Massa
 
Social fitness (fitcity project)
Social fitness (fitcity project)Social fitness (fitcity project)
Social fitness (fitcity project)Paolo Massa
 
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES  DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES Paolo Massa
 
Reputation: local or global?
Reputation: local or global?Reputation: local or global?
Reputation: local or global?Paolo Massa
 
Collective Memory building in Wikipedia: the case of North African uprisings
Collective Memory building in Wikipedia: the case of North African uprisingsCollective Memory building in Wikipedia: the case of North African uprisings
Collective Memory building in Wikipedia: the case of North African uprisingsPaolo Massa
 
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...Paolo Massa
 
Social net-work 4 your business
Social net-work 4 your businessSocial net-work 4 your business
Social net-work 4 your businessPaolo Massa
 
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...Paolo Massa
 
Supporting Collaborative Networks in Organizational Settings using an Enterpr...
Supporting Collaborative Networks in Organizational Settings using an Enterpr...Supporting Collaborative Networks in Organizational Settings using an Enterpr...
Supporting Collaborative Networks in Organizational Settings using an Enterpr...Paolo Massa
 
Combining Ridesharing& Social Networks
Combining Ridesharing& Social NetworksCombining Ridesharing& Social Networks
Combining Ridesharing& Social NetworksPaolo Massa
 
The Simplicity Cycle by Dan Ward
The Simplicity Cycle by Dan WardThe Simplicity Cycle by Dan Ward
The Simplicity Cycle by Dan WardPaolo Massa
 
Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...Paolo Massa
 
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...The Future of Work, Fun, and Being Social: an introduction to the nascent adv...
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...Paolo Massa
 
Feedback Effects Between Similarity And Social Influence In Online Communities
Feedback Effects Between Similarity And Social Influence In Online CommunitiesFeedback Effects Between Similarity And Social Influence In Online Communities
Feedback Effects Between Similarity And Social Influence In Online CommunitiesPaolo Massa
 
Bowling Alone and Trust Decline in Social Network Sites
Bowling Alone and  Trust Decline in  Social Network SitesBowling Alone and  Trust Decline in  Social Network Sites
Bowling Alone and Trust Decline in Social Network SitesPaolo Massa
 
Social Networking 4 your business
Social Networking 4 your businessSocial Networking 4 your business
Social Networking 4 your businessPaolo Massa
 
OMG Girlz Don't Exist on teh Intarweb!!!!1
OMG Girlz Don't Exist on teh Intarweb!!!!1OMG Girlz Don't Exist on teh Intarweb!!!!1
OMG Girlz Don't Exist on teh Intarweb!!!!1Paolo Massa
 

Plus de Paolo Massa (20)

Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)
Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)
Monitoraggio - Alternanza Scuola Lavoro - 2016 (Slides del Ministro)
 
Manypedia: Comparing Language Points of View of Wikipedia Communities
Manypedia: Comparing  Language Points of View  of Wikipedia CommunitiesManypedia: Comparing  Language Points of View  of Wikipedia Communities
Manypedia: Comparing Language Points of View of Wikipedia Communities
 
Gamification Features 4 Fitcity
Gamification Features 4 FitcityGamification Features 4 Fitcity
Gamification Features 4 Fitcity
 
Rete e Reti: Per-che' e per-chi?
Rete e Reti: Per-che' e per-chi?Rete e Reti: Per-che' e per-chi?
Rete e Reti: Per-che' e per-chi?
 
Social fitness (fitcity project)
Social fitness (fitcity project)Social fitness (fitcity project)
Social fitness (fitcity project)
 
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES  DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES
DESIGN PRINCIPLES OF WIKIS AND THEIR IMPACT ON KNOWLEDGE EXCHANGE PROCESSES
 
Reputation: local or global?
Reputation: local or global?Reputation: local or global?
Reputation: local or global?
 
Collective Memory building in Wikipedia: the case of North African uprisings
Collective Memory building in Wikipedia: the case of North African uprisingsCollective Memory building in Wikipedia: the case of North African uprisings
Collective Memory building in Wikipedia: the case of North African uprisings
 
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...
Social networks of Wikipedia - Paolo Massa - Presentation at (2011). ACM Hype...
 
Social net-work 4 your business
Social net-work 4 your businessSocial net-work 4 your business
Social net-work 4 your business
 
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...
An Empirical Analysis on Social Capital and Enterprise 2.0 Participation in a...
 
Supporting Collaborative Networks in Organizational Settings using an Enterpr...
Supporting Collaborative Networks in Organizational Settings using an Enterpr...Supporting Collaborative Networks in Organizational Settings using an Enterpr...
Supporting Collaborative Networks in Organizational Settings using an Enterpr...
 
Combining Ridesharing& Social Networks
Combining Ridesharing& Social NetworksCombining Ridesharing& Social Networks
Combining Ridesharing& Social Networks
 
The Simplicity Cycle by Dan Ward
The Simplicity Cycle by Dan WardThe Simplicity Cycle by Dan Ward
The Simplicity Cycle by Dan Ward
 
Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...
 
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...The Future of Work, Fun, and Being Social: an introduction to the nascent adv...
The Future of Work, Fun, and Being Social: an introduction to the nascent adv...
 
Feedback Effects Between Similarity And Social Influence In Online Communities
Feedback Effects Between Similarity And Social Influence In Online CommunitiesFeedback Effects Between Similarity And Social Influence In Online Communities
Feedback Effects Between Similarity And Social Influence In Online Communities
 
Bowling Alone and Trust Decline in Social Network Sites
Bowling Alone and  Trust Decline in  Social Network SitesBowling Alone and  Trust Decline in  Social Network Sites
Bowling Alone and Trust Decline in Social Network Sites
 
Social Networking 4 your business
Social Networking 4 your businessSocial Networking 4 your business
Social Networking 4 your business
 
OMG Girlz Don't Exist on teh Intarweb!!!!1
OMG Girlz Don't Exist on teh Intarweb!!!!1OMG Girlz Don't Exist on teh Intarweb!!!!1
OMG Girlz Don't Exist on teh Intarweb!!!!1
 

Dernier

Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?SANGHEE SHIN
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
Spring24-Release Overview - Wellingtion User Group-1.pdf
Spring24-Release Overview - Wellingtion User Group-1.pdfSpring24-Release Overview - Wellingtion User Group-1.pdf
Spring24-Release Overview - Wellingtion User Group-1.pdfAnna Loughnan Colquhoun
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxYounusS2
 
RAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIRAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIUdaiappa Ramachandran
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
20200723_insight_release_plan
20200723_insight_release_plan20200723_insight_release_plan
20200723_insight_release_planJamie (Taka) Wang
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 

Dernier (20)

Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
Spring24-Release Overview - Wellingtion User Group-1.pdf
Spring24-Release Overview - Wellingtion User Group-1.pdfSpring24-Release Overview - Wellingtion User Group-1.pdf
Spring24-Release Overview - Wellingtion User Group-1.pdf
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptx
 
RAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIRAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AI
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
20200723_insight_release_plan
20200723_insight_release_plan20200723_insight_release_plan
20200723_insight_release_plan
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 

Using Trust in Recommender Systems: an experimental analysis

  • 1. Using Trust in Recommender Systems: an experimental analysis Paolo Massa University of Trento (joint work with Bobby Bhattacharjee, UMD)
  • 2. Motivation: 1. Recommender Systems recommends items the user might like, based on past ratings. 2. Now, Decentralized publishing of info: – Ratings on Items – Trust on Principals [Semantic Web] 3. New issues (sparseness, scalability, trust, attacks, ...) ... Trust-aware Decentralized RS
  • 3. Summary 1. Recommender Systems (RSs) – Weaknesses 2. Solution: trust-awareness – Trust and trust metrics 3. Experiments on Epinions.com – Evidence trust solves RSs problems – (~50.000 users!) 4. Future works
  • 4. Collaborative Filtering (CF) 1. Input: ratings given by users to items ● I like “ Titanic” as 4/5 2. I ask recommendation 3. RS computes the similarity of me against every other user ● Pearson correlation coefficient 4. RS find similar users and suggests to me items liked by them.
  • 5. Item 1 It e m 2 It e m 3 It e m 4 I User1 2 5 ? 5 2 5 5 5 User2 5 1 3 User3 5 5 1 User4 2 2 5 5 5 5 4 4 It does not consider the content of the items, only the ratings given by users. It works independently of the domain (also jokes) BUT Overlapping of rated items required!
  • 6. RSs weaknesses 1. Ratings Matrix sparseness (95-99%) – Low or No overlapping (users not comparable) 2. Cold start – New users have 0 ratings (->not comparable) 3. Easy Attacks by Malicious Users – Copy profile and become the most similar 4. Hard to understand and control – Black box (bad recs -> user gives up) Solution? Trust of course!
  • 7. Trust-awareness 1. Trust statement =Rating by human to human about her usefulness (ex: in providing good movie reviews) 2. Explicitly provided 3. Trust is subjective! T(A,Z)=1 & T(B,Z)=0 – No Global BAD principals!!! 4. Trust is asymmetric! I trust Bill Gates. 5. FOAF (Friend-Of-A-Friend) is an XML format to express relationships – Some millions files out there...
  • 8. Trust Networks ME 6 degrees of separation “ theorem”
  • 9. Trust metrics 1. Task: based on known trust edges, predict trustworthiness of principals 2. Trust propagation (A->B,B->C|A-?->C) 3. Global (pagerank, ebay, ...) 4. Local (personalized) ME
  • 10. Trust solves RS problems 1. Trust solves CF sparseness problem – trust propagation and “ 6 degrees” -> reach many 2. Trust solves Cold Start problem – “ just add 1 friend” 3. Trust metrics resistant to copy-profile-attack. – “ you can be similar but if no trust path to you ...” 4. Trust easier to understand and control – trust nets supports Explanation (HCI tests needed) EVIDENCE of 1 and 2 provided by analyzing a REAL, VAST community (Epinions.com)
  • 11. Experiment: Epinions.com 1. Epinions.com' users can – Review and rate items (from 1 to 5) – Keep web of trust (trust=1) and block list (trust=0). – “ Reviewers whose reviews and ratings you have consistently found to be valuable” (Epinions FAQ) 2. Dataset (by crawling site): – ~50K users, ~140K items, ~660K ratings. – ~500K trust statements. • No block list (not shown on site)
  • 12. Epinions' recommendations Taken one user “ ME” , we can - use CF on ratings and compute “ similarity” of other users - use Trust Metric and compute “ trustworthiness” of other users Then we can suggest items liked by similar or trustable users. On how many users are they computable?
  • 13. Statistics (1) #Ratings expressed by Users (#rev<5) = 52.82%! [Cold start users]
  • 14. Statistics (2) #Trust statements expressed by Users (#trust<5) = 70.18%!
  • 15. User Similarity Computability 1. Ideally, every user should be comparable against every other user. 2. BUT ratings sparseness = 99.99135% -> tiny overlapping between 2 users 3. Pearson correlation coefficient meaningful only if overlapping(A,U)>1 4. Question: taken one user, how many users are comparable?
  • 16. US computability (cont.) 1. Taken one user, we computed all the comparable users. – On average an user has 161 comparable users (ideally ~50.000!) 2. We have averaged #comparable_users over users who expressed a certain number of reviews.
  • 17. US computability (cont.) Cold Start Users Ex: users with 40 reviews have ~800 comparable users. BUT users (y axis) are ~50.000! And for Cold Start Users (>50%) this is 2.74
  • 18. Trust computability 1. Trust metrics predict trust in unknown users based on known trust statements. 2. Distance from ME to U is a first measure of Trust computability 3. On average, – In 2 steps, reach 400 users – In 3 steps, reach 4386 users
  • 19. Mean # Reachable Users (in k steps) for users expressing X trust statements In few steps, you can predict trust in every user! Even for Cold Start Users!!!
  • 20. Trust and US computability comparison Mean number of Comparable Mean number of Comparable users for All users users for Cold Start users Propagating Trust Using Propagating Trust Using Dist 1 Dist 2 Dist 3 Dist 4 Pearson Dist 1 Dist 2 Dist 3 Dist 4 Pearson 9.88 400 4386 16334 161 2.14 94.54 1675 9121 2.74
  • 21. Contribution Experimental evidence that – CF is ineffective in real world scenarios • Especially for Cold Start users. – Trust can solve CF problems • Sparseness • Cold Start • Attacks (self-evident) Trust is computable on many more users than user similarity Especially for cold start users (the majority!)
  • 22. Future works 1. US and Trust correlate? Contradict? – US over trusted is higher than usual? 2. Distrust? – Propagation? Properties? 3. Design a Trust Metric (for RS) – Create and evaluate a Trust-aware RS • Input data
  • 23. Thanks for your attention! Questions? Paolo Massa Email: massa@itc.it Blog: http://moloko.itc.it/paoloblog/index.html
  • 24. Collaborative Filtering Similarity measure: Pearson Correlation Coefficient of user a and u m ∑i=1 r a ,i −r a r u ,i −r u  w a , u= ∑ m i=1 r a , i −r u  2 m ∑i=1 r u , i −r u  2 Prediction of rating given by user a to ite n ∑u=1  r u , i −ru ∗w a , u p a , i =r a   n ∑u=1 w a , u
  • 25. Hard Trust and Soft Trust 1. Vocabulary: – Hard Trust: about security, identity of something (user, device, information) • Public key cryptography – Soft Trust: appreciation of some principal (explicitly provided by another principal) • Social Networks and Trust Metrics