SlideShare une entreprise Scribd logo
1  sur  13
Trust Modeling and Evaluation in Web 2.0 Collaborative Learning Social Software JTEL 2010 June 7-June 11 Na Li Swiss Federal Institute of Technology in Lausanne (EPFL)
Outline Research Questions Current Progress Future Work
Research Questions Lots of Web 2.0 learning environments bring about large amount of user-generated content What should we trust? Who should we trust? RSS Feeds Pictures Pictures Wiki Pages Documents Videos
Research Questions Trust Measurement Evaluate quality of user-generated content Recommend useful resources  Privacy management
Current Progress Trust-based rating prediction Quality evaluation in open learning environment Filter helpful learning resources, people and group activities
Trust-Based Rating Prediction Approach ,[object Object],What influences rating opinion: similarity and familiarity People tend to trust the opinions of acquaintance and those having similar interests and tastes.
Trust-Based Rating Prediction Approach Trust measurement Multi-relational trust metric Build a “Web of Trust” for a particular user using heterogeneous types of relationships Trust How Much?
Trust-Based Rating Prediction Approach Trust propagation Propagation distance (PD) Bob Commented by Article Rated by Sara Create Is Member Has Member French Learning Activity Luis Alice Rate Video Rated by Ben Created by Jack Propagate Propagate Propagate PD
Trust-Based Rating Prediction Approach Rating prediction from a user to an item Using user’s “Web of Trust” People in “Web of Trust” are seen as trustable Average of all the rating scores given by trustable people, weighted by their trust value
Evaluation and Results Using Remashed data set 50 users, 6000 items, 3000 tags and 450 ratings “Leave-one-out” method Compare “predicted score – actual score” deviation of trust-based prediction and simple average
Evaluation and Results Change parameters Weights for relationships doesn’t make a significant difference in rating prediction Increasing size of trust network might add noise, lead to bigger prediction error
Future Work Future deploy and evaluation will be conducted in a collaborative learning platform, namely Graaasp(graaasp.epfl.ch) Trust-based privacy management
Questions?

Contenu connexe

En vedette

Trust-Based Rating Prediction for Recommendation in Web 2.0 Collaborative Lea...
Trust-Based Rating Prediction for Recommendation in Web 2.0 Collaborative Lea...Trust-Based Rating Prediction for Recommendation in Web 2.0 Collaborative Lea...
Trust-Based Rating Prediction for Recommendation in Web 2.0 Collaborative Lea...jianjinshu
 
Trust and Privacy in Social Learning Environments_Na Li
Trust and Privacy in Social Learning Environments_Na LiTrust and Privacy in Social Learning Environments_Na Li
Trust and Privacy in Social Learning Environments_Na Lijianjinshu
 
Trust Modeling and Evaluation in Web 2.0 Collaborative Learning Social Softwa...
Trust Modeling and Evaluation in Web 2.0 Collaborative Learning Social Softwa...Trust Modeling and Evaluation in Web 2.0 Collaborative Learning Social Softwa...
Trust Modeling and Evaluation in Web 2.0 Collaborative Learning Social Softwa...jianjinshu
 
20100823.1215.presentation
20100823.1215.presentation20100823.1215.presentation
20100823.1215.presentationjianjinshu
 

En vedette (8)

Trust-Based Rating Prediction for Recommendation in Web 2.0 Collaborative Lea...
Trust-Based Rating Prediction for Recommendation in Web 2.0 Collaborative Lea...Trust-Based Rating Prediction for Recommendation in Web 2.0 Collaborative Lea...
Trust-Based Rating Prediction for Recommendation in Web 2.0 Collaborative Lea...
 
Icwl2010 epfl
Icwl2010 epflIcwl2010 epfl
Icwl2010 epfl
 
Trust and Privacy in Social Learning Environments_Na Li
Trust and Privacy in Social Learning Environments_Na LiTrust and Privacy in Social Learning Environments_Na Li
Trust and Privacy in Social Learning Environments_Na Li
 
Trust Modeling and Evaluation in Web 2.0 Collaborative Learning Social Softwa...
Trust Modeling and Evaluation in Web 2.0 Collaborative Learning Social Softwa...Trust Modeling and Evaluation in Web 2.0 Collaborative Learning Social Softwa...
Trust Modeling and Evaluation in Web 2.0 Collaborative Learning Social Softwa...
 
Presentation1
Presentation1Presentation1
Presentation1
 
Bab 3
Bab 3Bab 3
Bab 3
 
Comp2
Comp2Comp2
Comp2
 
20100823.1215.presentation
20100823.1215.presentation20100823.1215.presentation
20100823.1215.presentation
 

Similaire à Jtel 2010 na li

Social Network Analysis (SNA) and its implications for knowledge discovery in...
Social Network Analysis (SNA) and its implications for knowledge discovery in...Social Network Analysis (SNA) and its implications for knowledge discovery in...
Social Network Analysis (SNA) and its implications for knowledge discovery in...ACMBangalore
 
Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...Paolo Massa
 
Overview of Social Networks
Overview of Social NetworksOverview of Social Networks
Overview of Social NetworksPaolo Nesi
 
Osu ext2010 county-coordinators-11-9-2010
Osu ext2010 county-coordinators-11-9-2010Osu ext2010 county-coordinators-11-9-2010
Osu ext2010 county-coordinators-11-9-2010Karen Jeannette
 
Predicting Discussions on the Social Semantic Web
Predicting Discussions on the Social Semantic WebPredicting Discussions on the Social Semantic Web
Predicting Discussions on the Social Semantic WebMatthew Rowe
 
The changing nature of scholarly communication - What does this mean for rese...
The changing nature of scholarly communication - What does this mean for rese...The changing nature of scholarly communication - What does this mean for rese...
The changing nature of scholarly communication - What does this mean for rese...Research Information Network
 
Fitsi web based tools presentation
Fitsi web based tools presentationFitsi web based tools presentation
Fitsi web based tools presentationMarquis
 
How to study trust online
How to study trust onlineHow to study trust online
How to study trust onlineTina Guenther
 
Open Courses and Informal Learning in a Web 2.0 World: A Research Agenda
Open Courses and Informal Learning in a Web 2.0 World: A Research AgendaOpen Courses and Informal Learning in a Web 2.0 World: A Research Agenda
Open Courses and Informal Learning in a Web 2.0 World: A Research AgendaStian Håklev
 
Norman Mendoza CPRS Edmonton
Norman Mendoza CPRS EdmontonNorman Mendoza CPRS Edmonton
Norman Mendoza CPRS EdmontonNormanMendoza
 
Multichannel Self-Organized Learning and Research in Web 2.0 Environment
Multichannel Self-Organized Learning and Research in Web 2.0 EnvironmentMultichannel Self-Organized Learning and Research in Web 2.0 Environment
Multichannel Self-Organized Learning and Research in Web 2.0 EnvironmentMalinka Ivanova
 
Social Recommender Systems Tutorial - WWW 2011
Social Recommender Systems Tutorial - WWW 2011Social Recommender Systems Tutorial - WWW 2011
Social Recommender Systems Tutorial - WWW 2011idoguy
 
Discovering social learning_ss
Discovering social learning_ssDiscovering social learning_ss
Discovering social learning_ssAshley Griffin
 
Beyond "Web 2.0" as Buzzword: Engaging Users to Contribute Online
Beyond "Web 2.0" as Buzzword: Engaging Users to Contribute OnlineBeyond "Web 2.0" as Buzzword: Engaging Users to Contribute Online
Beyond "Web 2.0" as Buzzword: Engaging Users to Contribute OnlineManinder Kahlon
 
ScienceOpen: Rethinking Peer Review / Young Academy of Scotland
ScienceOpen: Rethinking Peer Review / Young Academy of ScotlandScienceOpen: Rethinking Peer Review / Young Academy of Scotland
ScienceOpen: Rethinking Peer Review / Young Academy of ScotlandScienceOpen
 
Iwmw11 using activity data to support your users
Iwmw11   using activity data to support your usersIwmw11   using activity data to support your users
Iwmw11 using activity data to support your usersTomFranklin
 

Similaire à Jtel 2010 na li (20)

Ithet
IthetIthet
Ithet
 
Session2
Session2Session2
Session2
 
Social Network Analysis (SNA) and its implications for knowledge discovery in...
Social Network Analysis (SNA) and its implications for knowledge discovery in...Social Network Analysis (SNA) and its implications for knowledge discovery in...
Social Network Analysis (SNA) and its implications for knowledge discovery in...
 
Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...Invited talk at Future Networked Technologies / FIT-IT research calls opening...
Invited talk at Future Networked Technologies / FIT-IT research calls opening...
 
Overview of Social Networks
Overview of Social NetworksOverview of Social Networks
Overview of Social Networks
 
Osu ext2010 county-coordinators-11-9-2010
Osu ext2010 county-coordinators-11-9-2010Osu ext2010 county-coordinators-11-9-2010
Osu ext2010 county-coordinators-11-9-2010
 
Predicting Discussions on the Social Semantic Web
Predicting Discussions on the Social Semantic WebPredicting Discussions on the Social Semantic Web
Predicting Discussions on the Social Semantic Web
 
Show me the data! Actionable insight from open courses
Show me the data! Actionable insight from open coursesShow me the data! Actionable insight from open courses
Show me the data! Actionable insight from open courses
 
The changing nature of scholarly communication - What does this mean for rese...
The changing nature of scholarly communication - What does this mean for rese...The changing nature of scholarly communication - What does this mean for rese...
The changing nature of scholarly communication - What does this mean for rese...
 
September 23 2015 NISO Virtual Conference: Scholarly Communication Models: Ev...
September 23 2015 NISO Virtual Conference: Scholarly Communication Models: Ev...September 23 2015 NISO Virtual Conference: Scholarly Communication Models: Ev...
September 23 2015 NISO Virtual Conference: Scholarly Communication Models: Ev...
 
Fitsi web based tools presentation
Fitsi web based tools presentationFitsi web based tools presentation
Fitsi web based tools presentation
 
How to study trust online
How to study trust onlineHow to study trust online
How to study trust online
 
Open Courses and Informal Learning in a Web 2.0 World: A Research Agenda
Open Courses and Informal Learning in a Web 2.0 World: A Research AgendaOpen Courses and Informal Learning in a Web 2.0 World: A Research Agenda
Open Courses and Informal Learning in a Web 2.0 World: A Research Agenda
 
Norman Mendoza CPRS Edmonton
Norman Mendoza CPRS EdmontonNorman Mendoza CPRS Edmonton
Norman Mendoza CPRS Edmonton
 
Multichannel Self-Organized Learning and Research in Web 2.0 Environment
Multichannel Self-Organized Learning and Research in Web 2.0 EnvironmentMultichannel Self-Organized Learning and Research in Web 2.0 Environment
Multichannel Self-Organized Learning and Research in Web 2.0 Environment
 
Social Recommender Systems Tutorial - WWW 2011
Social Recommender Systems Tutorial - WWW 2011Social Recommender Systems Tutorial - WWW 2011
Social Recommender Systems Tutorial - WWW 2011
 
Discovering social learning_ss
Discovering social learning_ssDiscovering social learning_ss
Discovering social learning_ss
 
Beyond "Web 2.0" as Buzzword: Engaging Users to Contribute Online
Beyond "Web 2.0" as Buzzword: Engaging Users to Contribute OnlineBeyond "Web 2.0" as Buzzword: Engaging Users to Contribute Online
Beyond "Web 2.0" as Buzzword: Engaging Users to Contribute Online
 
ScienceOpen: Rethinking Peer Review / Young Academy of Scotland
ScienceOpen: Rethinking Peer Review / Young Academy of ScotlandScienceOpen: Rethinking Peer Review / Young Academy of Scotland
ScienceOpen: Rethinking Peer Review / Young Academy of Scotland
 
Iwmw11 using activity data to support your users
Iwmw11   using activity data to support your usersIwmw11   using activity data to support your users
Iwmw11 using activity data to support your users
 

Jtel 2010 na li

  • 1. Trust Modeling and Evaluation in Web 2.0 Collaborative Learning Social Software JTEL 2010 June 7-June 11 Na Li Swiss Federal Institute of Technology in Lausanne (EPFL)
  • 2. Outline Research Questions Current Progress Future Work
  • 3. Research Questions Lots of Web 2.0 learning environments bring about large amount of user-generated content What should we trust? Who should we trust? RSS Feeds Pictures Pictures Wiki Pages Documents Videos
  • 4. Research Questions Trust Measurement Evaluate quality of user-generated content Recommend useful resources Privacy management
  • 5. Current Progress Trust-based rating prediction Quality evaluation in open learning environment Filter helpful learning resources, people and group activities
  • 6.
  • 7. Trust-Based Rating Prediction Approach Trust measurement Multi-relational trust metric Build a “Web of Trust” for a particular user using heterogeneous types of relationships Trust How Much?
  • 8. Trust-Based Rating Prediction Approach Trust propagation Propagation distance (PD) Bob Commented by Article Rated by Sara Create Is Member Has Member French Learning Activity Luis Alice Rate Video Rated by Ben Created by Jack Propagate Propagate Propagate PD
  • 9. Trust-Based Rating Prediction Approach Rating prediction from a user to an item Using user’s “Web of Trust” People in “Web of Trust” are seen as trustable Average of all the rating scores given by trustable people, weighted by their trust value
  • 10. Evaluation and Results Using Remashed data set 50 users, 6000 items, 3000 tags and 450 ratings “Leave-one-out” method Compare “predicted score – actual score” deviation of trust-based prediction and simple average
  • 11. Evaluation and Results Change parameters Weights for relationships doesn’t make a significant difference in rating prediction Increasing size of trust network might add noise, lead to bigger prediction error
  • 12. Future Work Future deploy and evaluation will be conducted in a collaborative learning platform, namely Graaasp(graaasp.epfl.ch) Trust-based privacy management

Notes de l'éditeur

  1. Trust propagates layer by layer, until reaching the propagate distance we predefine.A “Web of Trust” is constructed in this way.
  2. Different weights and propagate distances are tried.On this test set, the change of trust weights for relationships doesn’t make a significant difference in the results of rating prediction.We get an optimal propagate distance value, which indicates that, instead of improving the prediction results, increasing the size of trust network might add noise, leading to bigger prediction error.
  3. Different weights and propagate distances are tried.On this test set, the change of trust weights for relationships doesn’t make a significant difference in the results of rating prediction.We get an optimal propagate distance value, which indicates that, instead of improving the prediction results, increasing the size of trust network might add noise, leading to bigger prediction error.