SlideShare une entreprise Scribd logo
1  sur  18
Télécharger pour lire hors ligne
Responsible
Recommendation
MICHAEL D. EKSTRAND
People and Information Research Team
Dept. of Computer Science, Boise State University
The Real World of
Technology
Ursula Franklin’s 1989 Massey
Lectures
Technology is not just artifacts.
• It is process
• It affects people
• It was designed by human
action
Key Questions
Who is involved in designing and
evaluating our systems?
What is these systems’ impact?
UserInput
Recommender
Who Benefits from
Recommendations?
Whose voices are in the design process?
Example: Meeting User
Information Needs
Problem: naïve statistics over user base emphasizes
largest group of users
 Minority groups might get worse results!
Solution: measure results for each group
Mehrotra et al., 2016 – Microsoft Bing
Example: Limits of
Behavioral Observation
Neil Hunt, RecSys ‘14 keynote:
NetFlix’s metrics cannot distinguish between
an enriched life and addiction.
Intention-Behavior Gap
Problem: users say one thing and do another
Old problem: Paul in 1st century said ‘What I want to do, I
don’t do; what I don’t want to do, I do.’
• They do not truly understand their desires.
• They are not satisfied with their actions.
Which is true?
Opportunities for
Recommenders
If we know a user’s goals and their behavior, maybe
the recommender can help!
• Find ‘baby steps’ that are:
• Likely to be adopted (behavior helps here!)
• Closer to user’s goals (their input necessary here!)
• Persuasive computing has how, but recsys can do
more for what.
Difficulty
Rasch Scale
easier harder
Bicycle by Andrew Jones on The Noun Project. Used under CC-BY.
Reciprocity (Franklin, 1989)
Broadcast … … or conversation?
Giving Users a Voice
Participatory design provides a framework for
incorporating user voices into the design process.
How do we scale it?
How does it apply to advanced algorithms?
Transparency lets users know whose voices are
being incorporated and how.
Promote Clickbait
Crash by Myly from Noun Project
Neck Turn by Gan Khoon Lay from Noun Project
Analogy by Ev Williams, contextualized by Bibblio.org https://goo.gl/AIZNIy
Reinforce Biases
Does the system propagate
existing social biases?
How does this affect users?
Or content creators?
Fajitas, by stu_spivack. CC-BY-SA 2.0.Rob Speer; https://goo.gl/13Ss1p
What’s Missing?
A lot of work to do!
• How do we measure these things?
• How can we scale participatory design?
• What does participatory design of algorithms even
look like?
• How can we use intention-behavior gap to build
compelling recommender experiences?
• How can we provide meaningful control over the
recommendation process to users?
What We Get
What is the impact of your system?
What will you do about it?
https://goo.gl/G1DK38
Michael D. Ekstrand

Contenu connexe

Tendances

Enabling Community Participation of Senior Citizens
Enabling Community Participation of Senior CitizensEnabling Community Participation of Senior Citizens
Enabling Community Participation of Senior CitizensCristhian Parra
 
Virtual Communication in Educational Institutions
Virtual Communication in Educational InstitutionsVirtual Communication in Educational Institutions
Virtual Communication in Educational InstitutionsTanya Joosten
 
Prototyping as a resource to investigate future states of the system 3
Prototyping as a resource to investigate future states of the system 3Prototyping as a resource to investigate future states of the system 3
Prototyping as a resource to investigate future states of the system 3rsd6
 
Stop the Juggling Act: Why Workplace Meetings Must Improve
Stop the Juggling Act: Why Workplace Meetings Must ImproveStop the Juggling Act: Why Workplace Meetings Must Improve
Stop the Juggling Act: Why Workplace Meetings Must ImproveBlueJeans Network
 
Using Social Media (to reach people who aren't online)
Using Social Media (to reach people who aren't online) Using Social Media (to reach people who aren't online)
Using Social Media (to reach people who aren't online) Jenovate
 
Technology and Enablement in the Social Age
Technology and Enablement in the Social AgeTechnology and Enablement in the Social Age
Technology and Enablement in the Social AgeKemp Edmonds
 
Proactive Displays, UW DUB group, 16 July 2008
Proactive Displays, UW DUB group, 16 July 2008Proactive Displays, UW DUB group, 16 July 2008
Proactive Displays, UW DUB group, 16 July 2008Joe McCarthy
 
Social Computing as Social Computation
Social Computing as Social ComputationSocial Computing as Social Computation
Social Computing as Social ComputationThomas Erickson
 
Curriculum and Actor Network Theory
Curriculum and Actor Network TheoryCurriculum and Actor Network Theory
Curriculum and Actor Network TheoryMichael Carroll
 
Social Information Processing (Tin180 Com)
Social Information Processing (Tin180 Com)Social Information Processing (Tin180 Com)
Social Information Processing (Tin180 Com)Tin180 VietNam
 
ICA 2011: Social media for public policy - the AdvanceMI case
ICA 2011: Social media for public policy - the AdvanceMI caseICA 2011: Social media for public policy - the AdvanceMI case
ICA 2011: Social media for public policy - the AdvanceMI caseCliff Lampe
 
The Impact of a Geographically Distributed Team on Labour Social Network
The Impact of a Geographically Distributed Team on Labour Social NetworkThe Impact of a Geographically Distributed Team on Labour Social Network
The Impact of a Geographically Distributed Team on Labour Social NetworkFederico Díaz Aguirre
 
Social Information Architecture Workshop
Social Information Architecture WorkshopSocial Information Architecture Workshop
Social Information Architecture Workshopgsmith
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...ijceronline
 
Digitally Engaging and Empowering Employees for Energy Demand Reduction: A Ne...
Digitally Engaging and Empowering Employees for Energy Demand Reduction: A Ne...Digitally Engaging and Empowering Employees for Energy Demand Reduction: A Ne...
Digitally Engaging and Empowering Employees for Energy Demand Reduction: A Ne...Nottingham Trent University
 
Design for Social Sharing Workshop
Design for Social Sharing WorkshopDesign for Social Sharing Workshop
Design for Social Sharing WorkshopRashmi Sinha
 

Tendances (19)

Enabling Community Participation of Senior Citizens
Enabling Community Participation of Senior CitizensEnabling Community Participation of Senior Citizens
Enabling Community Participation of Senior Citizens
 
Virtual Communication in Educational Institutions
Virtual Communication in Educational InstitutionsVirtual Communication in Educational Institutions
Virtual Communication in Educational Institutions
 
Community as an Asset
Community as an AssetCommunity as an Asset
Community as an Asset
 
Prototyping as a resource to investigate future states of the system 3
Prototyping as a resource to investigate future states of the system 3Prototyping as a resource to investigate future states of the system 3
Prototyping as a resource to investigate future states of the system 3
 
Stop the Juggling Act: Why Workplace Meetings Must Improve
Stop the Juggling Act: Why Workplace Meetings Must ImproveStop the Juggling Act: Why Workplace Meetings Must Improve
Stop the Juggling Act: Why Workplace Meetings Must Improve
 
Ppdd copy
Ppdd copyPpdd copy
Ppdd copy
 
Using Social Media (to reach people who aren't online)
Using Social Media (to reach people who aren't online) Using Social Media (to reach people who aren't online)
Using Social Media (to reach people who aren't online)
 
Technology and Enablement in the Social Age
Technology and Enablement in the Social AgeTechnology and Enablement in the Social Age
Technology and Enablement in the Social Age
 
Proactive Displays, UW DUB group, 16 July 2008
Proactive Displays, UW DUB group, 16 July 2008Proactive Displays, UW DUB group, 16 July 2008
Proactive Displays, UW DUB group, 16 July 2008
 
Social Computing as Social Computation
Social Computing as Social ComputationSocial Computing as Social Computation
Social Computing as Social Computation
 
Curriculum and Actor Network Theory
Curriculum and Actor Network TheoryCurriculum and Actor Network Theory
Curriculum and Actor Network Theory
 
Social Information Processing (Tin180 Com)
Social Information Processing (Tin180 Com)Social Information Processing (Tin180 Com)
Social Information Processing (Tin180 Com)
 
ICA 2011: Social media for public policy - the AdvanceMI case
ICA 2011: Social media for public policy - the AdvanceMI caseICA 2011: Social media for public policy - the AdvanceMI case
ICA 2011: Social media for public policy - the AdvanceMI case
 
The Impact of a Geographically Distributed Team on Labour Social Network
The Impact of a Geographically Distributed Team on Labour Social NetworkThe Impact of a Geographically Distributed Team on Labour Social Network
The Impact of a Geographically Distributed Team on Labour Social Network
 
Social Information Architecture Workshop
Social Information Architecture WorkshopSocial Information Architecture Workshop
Social Information Architecture Workshop
 
After Work
After WorkAfter Work
After Work
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
 
Digitally Engaging and Empowering Employees for Energy Demand Reduction: A Ne...
Digitally Engaging and Empowering Employees for Energy Demand Reduction: A Ne...Digitally Engaging and Empowering Employees for Energy Demand Reduction: A Ne...
Digitally Engaging and Empowering Employees for Energy Demand Reduction: A Ne...
 
Design for Social Sharing Workshop
Design for Social Sharing WorkshopDesign for Social Sharing Workshop
Design for Social Sharing Workshop
 

Similaire à Responsible Recommendation Systems

Using Smart Technology to Improve Global Health Initiatives
Using Smart Technology to Improve Global Health InitiativesUsing Smart Technology to Improve Global Health Initiatives
Using Smart Technology to Improve Global Health Initiativesguestfddc18
 
Mediaspaces: Life After Convergence / Presentation at EBU Multimedia Forum 5....
Mediaspaces: Life After Convergence / Presentation at EBU Multimedia Forum 5....Mediaspaces: Life After Convergence / Presentation at EBU Multimedia Forum 5....
Mediaspaces: Life After Convergence / Presentation at EBU Multimedia Forum 5....Kari-Hans Kommonen
 
Social machines: theory design and incentives
Social machines: theory design and incentivesSocial machines: theory design and incentives
Social machines: theory design and incentivesElena Simperl
 
Designing Interactions Downloadable PDF Doc
Designing Interactions Downloadable PDF DocDesigning Interactions Downloadable PDF Doc
Designing Interactions Downloadable PDF DocConnie Malamed
 
Usability Testing: Making it fast, good, and cheap
Usability Testing: Making it fast, good, and cheapUsability Testing: Making it fast, good, and cheap
Usability Testing: Making it fast, good, and cheapWhitney Quesenbery
 
The crowd and the library
The crowd and the libraryThe crowd and the library
The crowd and the libraryTrevor Owens
 
Introduction to HCI (UCC)
Introduction to HCI (UCC)Introduction to HCI (UCC)
Introduction to HCI (UCC)apppsych
 
Web Science Session 2: Social Media
Web Science Session 2: Social MediaWeb Science Session 2: Social Media
Web Science Session 2: Social MediaStefanie Panke
 
Future opportunities in social communications
Future opportunities in social communicationsFuture opportunities in social communications
Future opportunities in social communicationsPawan Gupta
 
The machine in the ghost: a socio-technical perspective...
The machine in the ghost: a socio-technical perspective...The machine in the ghost: a socio-technical perspective...
The machine in the ghost: a socio-technical perspective...Cliff Lampe
 
Alex wright mons_workshop_051214
Alex wright mons_workshop_051214Alex wright mons_workshop_051214
Alex wright mons_workshop_051214LeMundaneum
 
Analytics for Virtual Worlds
Analytics for Virtual WorldsAnalytics for Virtual Worlds
Analytics for Virtual WorldsHilary Mason
 
The (R)evolution of Social Media in Software Engineering
The (R)evolution of Social Media in Software EngineeringThe (R)evolution of Social Media in Software Engineering
The (R)evolution of Social Media in Software EngineeringMargaret-Anne Storey
 
20240104 HICSS Panel on AI and Legal Ethical 20240103 v7.pptx
20240104 HICSS  Panel on AI and Legal Ethical 20240103 v7.pptx20240104 HICSS  Panel on AI and Legal Ethical 20240103 v7.pptx
20240104 HICSS Panel on AI and Legal Ethical 20240103 v7.pptxISSIP
 
Data-driven UX: What it really takes and how to get there
Data-driven UX: What it really takes and how to get thereData-driven UX: What it really takes and how to get there
Data-driven UX: What it really takes and how to get thereEmmanuelle Boloix, Ph.D.
 

Similaire à Responsible Recommendation Systems (20)

Socially-Aware Multimedia Authoring
Socially-Aware Multimedia AuthoringSocially-Aware Multimedia Authoring
Socially-Aware Multimedia Authoring
 
Using Smart Technology to Improve Global Health Initiatives
Using Smart Technology to Improve Global Health InitiativesUsing Smart Technology to Improve Global Health Initiatives
Using Smart Technology to Improve Global Health Initiatives
 
Mediaspaces: Life After Convergence / Presentation at EBU Multimedia Forum 5....
Mediaspaces: Life After Convergence / Presentation at EBU Multimedia Forum 5....Mediaspaces: Life After Convergence / Presentation at EBU Multimedia Forum 5....
Mediaspaces: Life After Convergence / Presentation at EBU Multimedia Forum 5....
 
Social machines: theory design and incentives
Social machines: theory design and incentivesSocial machines: theory design and incentives
Social machines: theory design and incentives
 
Designing Interactions Downloadable PDF Doc
Designing Interactions Downloadable PDF DocDesigning Interactions Downloadable PDF Doc
Designing Interactions Downloadable PDF Doc
 
Usability Testing: Making it fast, good, and cheap
Usability Testing: Making it fast, good, and cheapUsability Testing: Making it fast, good, and cheap
Usability Testing: Making it fast, good, and cheap
 
The crowd and the library
The crowd and the libraryThe crowd and the library
The crowd and the library
 
SMAG Evaluation
SMAG EvaluationSMAG Evaluation
SMAG Evaluation
 
Introduction to HCI (UCC)
Introduction to HCI (UCC)Introduction to HCI (UCC)
Introduction to HCI (UCC)
 
Web Science Session 2: Social Media
Web Science Session 2: Social MediaWeb Science Session 2: Social Media
Web Science Session 2: Social Media
 
Future opportunities in social communications
Future opportunities in social communicationsFuture opportunities in social communications
Future opportunities in social communications
 
The machine in the ghost: a socio-technical perspective...
The machine in the ghost: a socio-technical perspective...The machine in the ghost: a socio-technical perspective...
The machine in the ghost: a socio-technical perspective...
 
Alex wright mons_workshop_051214
Alex wright mons_workshop_051214Alex wright mons_workshop_051214
Alex wright mons_workshop_051214
 
Analytics for Virtual Worlds
Analytics for Virtual WorldsAnalytics for Virtual Worlds
Analytics for Virtual Worlds
 
The (R)evolution of Social Media in Software Engineering
The (R)evolution of Social Media in Software EngineeringThe (R)evolution of Social Media in Software Engineering
The (R)evolution of Social Media in Software Engineering
 
Nfais social discovery-v5
Nfais social discovery-v5Nfais social discovery-v5
Nfais social discovery-v5
 
Work 2.0 Tech Best Practices Aenc
Work 2.0   Tech Best Practices   AencWork 2.0   Tech Best Practices   Aenc
Work 2.0 Tech Best Practices Aenc
 
20240104 HICSS Panel on AI and Legal Ethical 20240103 v7.pptx
20240104 HICSS  Panel on AI and Legal Ethical 20240103 v7.pptx20240104 HICSS  Panel on AI and Legal Ethical 20240103 v7.pptx
20240104 HICSS Panel on AI and Legal Ethical 20240103 v7.pptx
 
Diff6b eng
Diff6b engDiff6b eng
Diff6b eng
 
Data-driven UX: What it really takes and how to get there
Data-driven UX: What it really takes and how to get thereData-driven UX: What it really takes and how to get there
Data-driven UX: What it really takes and how to get there
 

Plus de IntoTheMinds

Voilà à quoi ressemblera la reprise
Voilà à quoi ressemblera la repriseVoilà à quoi ressemblera la reprise
Voilà à quoi ressemblera la repriseIntoTheMinds
 
The advertising campaigns run in Belgium during the Covid-19 crisis
The advertising campaigns run in Belgium during the Covid-19 crisisThe advertising campaigns run in Belgium during the Covid-19 crisis
The advertising campaigns run in Belgium during the Covid-19 crisisIntoTheMinds
 
Presentation Christian Radler at EBU Conference "data in the newsroom"
Presentation Christian Radler at EBU Conference "data in the newsroom"Presentation Christian Radler at EBU Conference "data in the newsroom"
Presentation Christian Radler at EBU Conference "data in the newsroom"IntoTheMinds
 
Presentation Sabino Metta at EBU Conference "data in the newsroom"
Presentation Sabino Metta at EBU Conference "data in the newsroom"Presentation Sabino Metta at EBU Conference "data in the newsroom"
Presentation Sabino Metta at EBU Conference "data in the newsroom"IntoTheMinds
 
Presentation Stéphane Saulnier at EBU Conference "data in the newsroom"
Presentation Stéphane Saulnier at EBU Conference "data in the newsroom"Presentation Stéphane Saulnier at EBU Conference "data in the newsroom"
Presentation Stéphane Saulnier at EBU Conference "data in the newsroom"IntoTheMinds
 
Presentation Kristofer Sjoholm at EBU Conference "data in the newsroom"
Presentation Kristofer Sjoholm at EBU Conference "data in the newsroom"Presentation Kristofer Sjoholm at EBU Conference "data in the newsroom"
Presentation Kristofer Sjoholm at EBU Conference "data in the newsroom"IntoTheMinds
 
Purchase drivers for iconic products in the luxury sector
Purchase drivers for iconic products in the luxury sectorPurchase drivers for iconic products in the luxury sector
Purchase drivers for iconic products in the luxury sectorIntoTheMinds
 
A robot called Voitto
A robot called VoittoA robot called Voitto
A robot called VoittoIntoTheMinds
 
presentation Newsbridge by Philippe Petitpont at Media Fast Forward 2018
presentation Newsbridge by Philippe Petitpont at Media Fast Forward 2018presentation Newsbridge by Philippe Petitpont at Media Fast Forward 2018
presentation Newsbridge by Philippe Petitpont at Media Fast Forward 2018IntoTheMinds
 
Artworks personalization on Netflix
Artworks personalization on Netflix Artworks personalization on Netflix
Artworks personalization on Netflix IntoTheMinds
 
Privacy Calculus in the Sharing Economy
Privacy Calculus in the Sharing EconomyPrivacy Calculus in the Sharing Economy
Privacy Calculus in the Sharing EconomyIntoTheMinds
 
Toon borré presentation at Meetup Big Data and Ethics at DigitYser Brussels 1...
Toon borré presentation at Meetup Big Data and Ethics at DigitYser Brussels 1...Toon borré presentation at Meetup Big Data and Ethics at DigitYser Brussels 1...
Toon borré presentation at Meetup Big Data and Ethics at DigitYser Brussels 1...IntoTheMinds
 
Leenke De Donder presentation at Meetup Big Data and Ethics at DigitYser Brus...
Leenke De Donder presentation at Meetup Big Data and Ethics at DigitYser Brus...Leenke De Donder presentation at Meetup Big Data and Ethics at DigitYser Brus...
Leenke De Donder presentation at Meetup Big Data and Ethics at DigitYser Brus...IntoTheMinds
 
Jochanen eynikel presentation at Meetup Big Data and Ethics at DigitYser Brus...
Jochanen eynikel presentation at Meetup Big Data and Ethics at DigitYser Brus...Jochanen eynikel presentation at Meetup Big Data and Ethics at DigitYser Brus...
Jochanen eynikel presentation at Meetup Big Data and Ethics at DigitYser Brus...IntoTheMinds
 
Thomas carette presentation at Meetup Big Data and Ethics at DigitYser Brusse...
Thomas carette presentation at Meetup Big Data and Ethics at DigitYser Brusse...Thomas carette presentation at Meetup Big Data and Ethics at DigitYser Brusse...
Thomas carette presentation at Meetup Big Data and Ethics at DigitYser Brusse...IntoTheMinds
 
Presentatie big data (Dag van de verkoper, Cevora)
Presentatie big data (Dag van de verkoper, Cevora) Presentatie big data (Dag van de verkoper, Cevora)
Presentatie big data (Dag van de verkoper, Cevora) IntoTheMinds
 
Presentatie big data in verkoop (cevora) gent 16 Mei 2017
Presentatie big data in verkoop (cevora) gent 16 Mei 2017Presentatie big data in verkoop (cevora) gent 16 Mei 2017
Presentatie big data in verkoop (cevora) gent 16 Mei 2017IntoTheMinds
 
Slides pierre nicolas schwab DISummit 2017 (Big Data, Brussels)
Slides pierre nicolas schwab DISummit 2017 (Big Data, Brussels)Slides pierre nicolas schwab DISummit 2017 (Big Data, Brussels)
Slides pierre nicolas schwab DISummit 2017 (Big Data, Brussels)IntoTheMinds
 
"Building Trust" discussion panel at EBU Big Data conference 2017 (Pierre-Nic...
"Building Trust" discussion panel at EBU Big Data conference 2017 (Pierre-Nic..."Building Trust" discussion panel at EBU Big Data conference 2017 (Pierre-Nic...
"Building Trust" discussion panel at EBU Big Data conference 2017 (Pierre-Nic...IntoTheMinds
 
Presentation by Steven Bourke at the EBU Big Data and Society workshop
Presentation by Steven Bourke at the EBU Big Data and Society workshopPresentation by Steven Bourke at the EBU Big Data and Society workshop
Presentation by Steven Bourke at the EBU Big Data and Society workshopIntoTheMinds
 

Plus de IntoTheMinds (20)

Voilà à quoi ressemblera la reprise
Voilà à quoi ressemblera la repriseVoilà à quoi ressemblera la reprise
Voilà à quoi ressemblera la reprise
 
The advertising campaigns run in Belgium during the Covid-19 crisis
The advertising campaigns run in Belgium during the Covid-19 crisisThe advertising campaigns run in Belgium during the Covid-19 crisis
The advertising campaigns run in Belgium during the Covid-19 crisis
 
Presentation Christian Radler at EBU Conference "data in the newsroom"
Presentation Christian Radler at EBU Conference "data in the newsroom"Presentation Christian Radler at EBU Conference "data in the newsroom"
Presentation Christian Radler at EBU Conference "data in the newsroom"
 
Presentation Sabino Metta at EBU Conference "data in the newsroom"
Presentation Sabino Metta at EBU Conference "data in the newsroom"Presentation Sabino Metta at EBU Conference "data in the newsroom"
Presentation Sabino Metta at EBU Conference "data in the newsroom"
 
Presentation Stéphane Saulnier at EBU Conference "data in the newsroom"
Presentation Stéphane Saulnier at EBU Conference "data in the newsroom"Presentation Stéphane Saulnier at EBU Conference "data in the newsroom"
Presentation Stéphane Saulnier at EBU Conference "data in the newsroom"
 
Presentation Kristofer Sjoholm at EBU Conference "data in the newsroom"
Presentation Kristofer Sjoholm at EBU Conference "data in the newsroom"Presentation Kristofer Sjoholm at EBU Conference "data in the newsroom"
Presentation Kristofer Sjoholm at EBU Conference "data in the newsroom"
 
Purchase drivers for iconic products in the luxury sector
Purchase drivers for iconic products in the luxury sectorPurchase drivers for iconic products in the luxury sector
Purchase drivers for iconic products in the luxury sector
 
A robot called Voitto
A robot called VoittoA robot called Voitto
A robot called Voitto
 
presentation Newsbridge by Philippe Petitpont at Media Fast Forward 2018
presentation Newsbridge by Philippe Petitpont at Media Fast Forward 2018presentation Newsbridge by Philippe Petitpont at Media Fast Forward 2018
presentation Newsbridge by Philippe Petitpont at Media Fast Forward 2018
 
Artworks personalization on Netflix
Artworks personalization on Netflix Artworks personalization on Netflix
Artworks personalization on Netflix
 
Privacy Calculus in the Sharing Economy
Privacy Calculus in the Sharing EconomyPrivacy Calculus in the Sharing Economy
Privacy Calculus in the Sharing Economy
 
Toon borré presentation at Meetup Big Data and Ethics at DigitYser Brussels 1...
Toon borré presentation at Meetup Big Data and Ethics at DigitYser Brussels 1...Toon borré presentation at Meetup Big Data and Ethics at DigitYser Brussels 1...
Toon borré presentation at Meetup Big Data and Ethics at DigitYser Brussels 1...
 
Leenke De Donder presentation at Meetup Big Data and Ethics at DigitYser Brus...
Leenke De Donder presentation at Meetup Big Data and Ethics at DigitYser Brus...Leenke De Donder presentation at Meetup Big Data and Ethics at DigitYser Brus...
Leenke De Donder presentation at Meetup Big Data and Ethics at DigitYser Brus...
 
Jochanen eynikel presentation at Meetup Big Data and Ethics at DigitYser Brus...
Jochanen eynikel presentation at Meetup Big Data and Ethics at DigitYser Brus...Jochanen eynikel presentation at Meetup Big Data and Ethics at DigitYser Brus...
Jochanen eynikel presentation at Meetup Big Data and Ethics at DigitYser Brus...
 
Thomas carette presentation at Meetup Big Data and Ethics at DigitYser Brusse...
Thomas carette presentation at Meetup Big Data and Ethics at DigitYser Brusse...Thomas carette presentation at Meetup Big Data and Ethics at DigitYser Brusse...
Thomas carette presentation at Meetup Big Data and Ethics at DigitYser Brusse...
 
Presentatie big data (Dag van de verkoper, Cevora)
Presentatie big data (Dag van de verkoper, Cevora) Presentatie big data (Dag van de verkoper, Cevora)
Presentatie big data (Dag van de verkoper, Cevora)
 
Presentatie big data in verkoop (cevora) gent 16 Mei 2017
Presentatie big data in verkoop (cevora) gent 16 Mei 2017Presentatie big data in verkoop (cevora) gent 16 Mei 2017
Presentatie big data in verkoop (cevora) gent 16 Mei 2017
 
Slides pierre nicolas schwab DISummit 2017 (Big Data, Brussels)
Slides pierre nicolas schwab DISummit 2017 (Big Data, Brussels)Slides pierre nicolas schwab DISummit 2017 (Big Data, Brussels)
Slides pierre nicolas schwab DISummit 2017 (Big Data, Brussels)
 
"Building Trust" discussion panel at EBU Big Data conference 2017 (Pierre-Nic...
"Building Trust" discussion panel at EBU Big Data conference 2017 (Pierre-Nic..."Building Trust" discussion panel at EBU Big Data conference 2017 (Pierre-Nic...
"Building Trust" discussion panel at EBU Big Data conference 2017 (Pierre-Nic...
 
Presentation by Steven Bourke at the EBU Big Data and Society workshop
Presentation by Steven Bourke at the EBU Big Data and Society workshopPresentation by Steven Bourke at the EBU Big Data and Society workshop
Presentation by Steven Bourke at the EBU Big Data and Society workshop
 

Dernier

High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...soniya singh
 
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024thyngster
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfBoston Institute of Analytics
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...dajasot375
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsappssapnasaifi408
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfgstagge
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfJohn Sterrett
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdfHuman37
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...limedy534
 
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSINGmarianagonzalez07
 
How we prevented account sharing with MFA
How we prevented account sharing with MFAHow we prevented account sharing with MFA
How we prevented account sharing with MFAAndrei Kaleshka
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样vhwb25kk
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptxthyngster
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryJeremy Anderson
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Sapana Sha
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanMYRABACSAFRA2
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsVICTOR MAESTRE RAMIREZ
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改yuu sss
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一F sss
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfchwongval
 

Dernier (20)

High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
 
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdf
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdf
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
 
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
 
How we prevented account sharing with MFA
How we prevented account sharing with MFAHow we prevented account sharing with MFA
How we prevented account sharing with MFA
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data Story
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population Mean
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business Professionals
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdf
 

Responsible Recommendation Systems

  • 1. Responsible Recommendation MICHAEL D. EKSTRAND People and Information Research Team Dept. of Computer Science, Boise State University
  • 2. The Real World of Technology Ursula Franklin’s 1989 Massey Lectures Technology is not just artifacts. • It is process • It affects people • It was designed by human action
  • 3.
  • 4. Key Questions Who is involved in designing and evaluating our systems? What is these systems’ impact?
  • 6. Who Benefits from Recommendations? Whose voices are in the design process?
  • 7. Example: Meeting User Information Needs Problem: naïve statistics over user base emphasizes largest group of users  Minority groups might get worse results! Solution: measure results for each group Mehrotra et al., 2016 – Microsoft Bing
  • 8. Example: Limits of Behavioral Observation Neil Hunt, RecSys ‘14 keynote: NetFlix’s metrics cannot distinguish between an enriched life and addiction.
  • 9. Intention-Behavior Gap Problem: users say one thing and do another Old problem: Paul in 1st century said ‘What I want to do, I don’t do; what I don’t want to do, I do.’ • They do not truly understand their desires. • They are not satisfied with their actions. Which is true?
  • 10. Opportunities for Recommenders If we know a user’s goals and their behavior, maybe the recommender can help! • Find ‘baby steps’ that are: • Likely to be adopted (behavior helps here!) • Closer to user’s goals (their input necessary here!) • Persuasive computing has how, but recsys can do more for what.
  • 11. Difficulty Rasch Scale easier harder Bicycle by Andrew Jones on The Noun Project. Used under CC-BY.
  • 12. Reciprocity (Franklin, 1989) Broadcast … … or conversation?
  • 13. Giving Users a Voice Participatory design provides a framework for incorporating user voices into the design process. How do we scale it? How does it apply to advanced algorithms? Transparency lets users know whose voices are being incorporated and how.
  • 14. Promote Clickbait Crash by Myly from Noun Project Neck Turn by Gan Khoon Lay from Noun Project Analogy by Ev Williams, contextualized by Bibblio.org https://goo.gl/AIZNIy
  • 15. Reinforce Biases Does the system propagate existing social biases? How does this affect users? Or content creators?
  • 16. Fajitas, by stu_spivack. CC-BY-SA 2.0.Rob Speer; https://goo.gl/13Ss1p
  • 17. What’s Missing? A lot of work to do! • How do we measure these things? • How can we scale participatory design? • What does participatory design of algorithms even look like? • How can we use intention-behavior gap to build compelling recommender experiences? • How can we provide meaningful control over the recommendation process to users?
  • 18. What We Get What is the impact of your system? What will you do about it? https://goo.gl/G1DK38 Michael D. Ekstrand