Ce diaporama a bien été signalé.

Interactive Recommender Systems with Netflix and Spotify

202

Partager

•
16 sept. 2015
• 202 j’aime • 104 822 vues
Prochain SlideShare
Interactive Recommender Systems
Interactive Recommender Systems
Chargement dans…3
×
1 sur 100
1 sur 100

Interactive Recommender Systems with Netflix and Spotify

16 sept. 2015
• 202 j’aime • 104 822 vues

202

Partager

Télécharger pour lire hors ligne

Description

Interactive recommender systems enable the user to steer the received recommendations in the desired direction through explicit interaction with the system. In the larger ecosystem of recommender systems used on a website, it is positioned between a lean-back recommendation experience and an active search for a specific piece of content. Besides this aspect, we will discuss several parts that are especially important for interactive recommender systems, including the following: design of the user interface and its tight integration with the algorithm in the back-end; computational efficiency of the recommender algorithm; as well as choosing the right balance between exploiting the feedback from the user as to provide relevant recommendations, and enabling the user to explore the catalog and steer the recommendations in the desired direction.

In particular, we will explore the field of interactive video and music recommendations and their application at Netflix and Spotify. We outline some of the user-experiences built, and discuss the approaches followed to tackle the various aspects of interactive recommendations. We present our insights from user studies and A/B tests.

The tutorial targets researchers and practitioners in the field of recommender systems, and will give the participants a unique opportunity to learn about the various aspects of interactive recommender systems in the video and music domain. The tutorial assumes familiarity with the common methods of recommender systems.

Transcription

  1. Interactive Recommender Systems RecSys 2015 Harald Steck Netflix Inc. hsteck@netflix.com Roelof van Zwol Netflix Inc. roelofvanzwol@netflix.com Chris Johnson Spotify Inc. cjohnson@spotify.com
  2. Outline Introduction Use cases Netflix Spotify Challenges Deep Dive Netflix Spotify Insights Discussion
  3. Introduction
  4. Section name 4
  5. What are Interactive RSs? Define Interactive: Influencing or having an effect on each other. Allowing a two-way flow of information Responding to a user’s input Forms of Interaction Implicit vs explicit feedback User experiences SearchBrowse Interactive RS
  6. Need for Interactive RSs? To better serve the user’s (entertainment) needs Fill the gap between browse and search Lean-back vs precise need To establish trust and credibility Instant gratification
  7. Interactive RS in practice? Most online services offer different levels of personalization Video: Netflix, YouTube, Hulu, Amazon Video, HBO, … Browse (homepage/genre) and search Music: Spotify, Pandora, Apple Music, Google Music, … Browse, Radio, Search Books/Apps/Shopping: Amazon, Apple, Google (Video and Image) Search: Google, Bing, Yahoo Left rail suggestions (explore), search completion Travel: Booking.com, Kayak, Orbitz, Expedia, … Guided experience: Pick destination —> pick flight and hotel, arrange local transport, plan activities, go dining and sightseeing…
  8. Research on Interactive RS “A successful recommender system must balance the needs to explore user preferences and to exploit this information for recommendation.” Exploration in Interactive Personalized Music Recommendation: A Reinforcement Learning Approach. X. Wang, Y. Wang, D. Hsu, Y. Wang (2013) Active learning / Multi-Armed Bandits (𝜀-greedy, UCB, Thompson sampling) Papers at RecSys this year and in the past :) When do explicit taste preferences trump play data? When we have insufficient knowledge about the user When context changes TasteWeights: A Visual Interactive Hybrid Recommender System. S. Bostandjiev, J. O’Donovan, T. Höllerer (RecSys 2012) When the user has a vague idea of what they want IntRS: Workshop on Interfaces and Human Decision Making for Recommender Systems
  9. Use-case:
  10. Section name 10
  11. Section name 11
  12. Section name 12
  13. Section name 13
  14. Interactive RSs @ Netflix Help user’s find a great video to watch as an alternative to browse and search. Address browse fatigue; failed search experience; or user has vague notion of what to watch; watching with friends Not for everyone, not all the time… Max - Rating Game Select a topic, rate some videos, get recommendations Hot-or-Cold Tell us what you’re into, one video at a time Discover Select one or more videos of interest to explore other similar options
  15. Max - Rating Game
  16. Hot or Cold Game
  17. Discover App
  18. Use-case:
  19. Section name 19
  20. Spotify in Numbers Started in 2006, now available in 58 markets 75+ million active users, 20 million paying subscribers 30+ million songs, 20,000 new songs added per day 1.5 billion playlists 1 TB user data logged per day 1k node Hadoop cluster 10,000+ Hadoop jobs run every day
  21. Challenge: 20 Million songs... how do we recommend music to users?
  22. Discover Weekly
  23. Discover
  24. Related Artists
  25. Radio
  26. Radio as an Interactive RS User has a vague idea of what they would like to listen to User starts a radio station seeded by an Artist, Album, Song, Playlist, or Genre Generally a lean back experience, but with the ability to tune recommendations with (+) and (-) feedback ( )
  27. Section name 27 SmartBox: fully interactive radio experience
  28. Challenges
  29. Challenges Understanding when to present interactive experience - Binging, trying to find something new, experiencing browse fatigue X User Interaction Design - UI affordance - Messaging task - Efficient mechanism to collect user input - Instant gratification - Choice penalty - Navigation options (user control) X X
  30. Challenges Workflow and Algorithmic Design - Computational efficient - Balancing relevancy, diversity and popularity of the recommendations - Support user navigation - Allow for both exploration and exploitation, e.g. avoid overfitting based on limited input from the user X X
  31. Deep Dive: Discover
  32. Discover: Understanding the user
  33. Meeting the users expectations Introducing interactive RS as a full page experience or integrate with other rows on the homepage?
  34. Meeting the users expectations Introducing interactive RS as a full page experience or integrate with other rows on the homepage? Avoid conflict: browse vs discovery mode Browsing on the homepage is a lean-back experience Discover, is interactive… that means work
  35. Understanding the user’s need Introducing Discover feature as a new destination Allow users to quickly navigate to feature
  36. Understanding the user’s need Introducing Discover feature as a new destination Help users find new feature through messaging at top of homepage At session start After scrolling X rows down After 45 secs
  37. Understanding the user’s need Introducing Discover feature as a new destination Help users find new feature through: messaging at top of homepage invitation in row on homepage
  38. Understanding the user’s need Introducing Discover feature as a new destination Help users find new feature through: messaging at top of homepage invitation in row row-based invitation In position of Nth row or as last row on homepage
  39. Understanding the user’s need Context is crucial for the success of the integration of interactive experiences into the product Never interrupt a user that knows what they want Message at start of user session Showing the invitation at the right moment (and place) is crucial Allow the user to explore options on the homepage first Challenge is to find the right trade-off between rate at which user tries the interactive experience, versus success Success rate can vary from 30-70% Not a goal to reach all users, just need to reach those who need help
  40. Discover: Inside the interactive RS
  41. Section name 41
  42. Section name 42
  43. Interaction Workflow for Discover Init - At start of new session, create an initial seed of videos to show to the user See Suggestions - After receiving input from the user (selected videos), compute recommendations
  44. Interaction Workflow for Discover Need to find balance between relevancy, diversity and popularity of the videos shown to the user
  45. Videos in a Latent Space Representation normalized item-vectors
  46. Videos in a Latent Space Representation user-vector in same space
  47. Relevance Score
  48. Diversity Score note:
  49. Popularity Score
  50. “See Suggestions” step Score of item i: , for adjusting the balance score(i) determined by “closest” item j in S “diminishing returns”
  51. “See Suggestions” step Greedy computation of recommendation set S:
  52. Interaction Workflow for Discover See Suggestions - After receiving input from the user (selected videos), compute recommendations What if the selected videos cover more than 1 genre?
  53. User may select diverse set of videos Challenge: Recommendations should reflect all genres of the shows selected by user Solution: Multiple user-vectors, one per selected group of similar shows (clustering) Compute recommendations for each user vector Display clusters in separate rows, or combine via reciprocal rank aggregation
  54. Interaction Workflow for Discover Init - At start of new session, create an initial seed of videos to show to the user Show diverse set of recognizable videos that are familiar to the user, and which is fresh across sessions
  55. Producing the initial set of videos Objective: Show diverse set of recognizable videos that are familiar to the user, and which is fresh across sessions How? Sample videos from user’s play history score: no popularity & relevance component Sample shows from catalog with popularity bias score: no relevance component Randomize initial set for freshness
  56. Learning the Latent Vectors
  57. Learning the Latent Vectors Use implicit feedback data Compute item-item similarity matrix: covariance matrix transition matrix … Train (spectral) matrix factorization model
  58. Graph Cut—Simplistic Example
  59. Graph Cut—Simplistic Example
  60. Graph Cut—Simplistic Example Cut  here …not   similar  to   Ballerina   any  more new  similar
 of  Ballerina:
  61. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  62. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  63. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  64. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  (largely)  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  65. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  (largely)  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  66. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  (largely)  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors  (remove  remaining  popularity)   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  67. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  (largely)  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors  (remove  remaining  popularity)   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  68. Example: Django Movies similar to: Viennese-born Christoph Waltz won Oscar for best supporting role only play-data used, no content information
  69. Similar to Django via basic MF
  70. Similar to Django via spectral MF
  71. Example: Hercules in New York Movies similar to: Austrian-born Arnold Schwarzenegger’s debut movie only play-data used, no content information
  72. Similar to Hercules in NY via basic MF
  73. Similar to Hercules in NY via spectral MF
  74. Deep Dive: Radio
  75. Radio as an Interactive RS User has a vague idea of what they would like to listen to User starts a radio station seeded by an Artist, Album, Song, Playlist, or Genre Generally a lean back experience, but with the ability to tune recommendations with (+) and (-) feedback ( )
  76. Overview of Radio Dataflow
  77. Step 1: Train batch recommendation models
  78. Implicit Matrix Factorization [1] 78 1 0 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 1 0 0 0 1 1 0 1 0 0 0 1 0 0 0 0 1 0 0 1 0 0 1 0 0 0 1 0 0 1 •Aggregate all (user, track) streams into a large matrix •Goal: Approximate binary preference matrix by inner product of 2 smaller matrices by minimizing the weighted RMSE (root mean squared error) using a function of plays, context, and recency as weight X YUsers Songs • = bias for user • = bias for item • = regularization parameter • = 1 if user streamed track else 0 • • = user latent factor vector • = item latent factor vector [1] Hu Y. & Koren Y. & Volinsky C. (2008) Collaborative Filtering for Implicit Feedback Datasets 8th IEEE International Conference on Data Mining
  79. Can also use Logistic Loss! [2] 79 1 0 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 1 0 0 0 1 1 0 1 0 0 0 1 0 0 0 0 1 0 0 1 0 0 1 0 0 0 1 0 0 1 •Aggregate all (user, track) streams into a large matrix •Goal: Model probability of user playing a song as logistic, then maximize log likelihood of binary preference matrix, weighting positive observations by a function of plays, context, and recency X YUsers Songs • = bias for user • = bias for item • = regularization parameter • = user latent factor vector • = item latent factor vector [2] Johnson C. (2014) Logistic Matrix Factorization for Implicit Feedback Data NIPS Workshop on Distributed Matrix Computations
  80. NLP models on News, Blogs, and Text 80
  81. 81 NLP models also work on playlists! Playlist itself is a document Songs in playlist are words
  82. 82 Deep Learning on Audio [3] [3] http://benanne.github.io/2014/08/05/spotify-cnns.html
  83. Songs in a Latent Space Representation normalized item-vectors
  84. Songs in a Latent Space Representation user-vector in same space
  85. Step 2: Ensemble of batch models using explicit thumbs data
  86. Ensemble of Batch Models
  87. Explicit feedback at the expense of presentation bias…
  88. Augment explicit feedback with random negatives
  89. Thumbs also carry a subjective bias… Thumbs used to personally tune a user’s station But with enough data, they’re a pretty good signal
  90. Interesting fact… Ratio of to does not always correlate with user engagement!
  91. Step 3: Static song pools adaptively personalized as user interacts
  92. Should be Simple, fast, and instantly gratifying
  93. Adaptive personalization Probability of choosing song given user , station , at time = global rank of track in song pool = relevancy to user based on implicit CF vector = relevancy to user based on explicit thumbs = diversity of artist and album within radio session
  94. Step 4: Radio thumbs feed back into ensemble!
  95. Interactive feedback loop
  96. Key Take Aways Implicit feedback used to train batch recommendation models Explicit feedback is augmented with random negatives and used as training data to combine batch models (feedback loop) Adaptive shuffling is a function of song pool rank, user’s implicit CF relevancy, user’s thumbs relevancy, and diversity of artist and album Interaction needs to be simple, fast, and instantly gratifying to the user
  97. Insights
  98. Insights - User perspective Positioning of interactive RS in a product is crucial to success Natural transition from browse and search to interaction Interactive RS needs to be lightweight.. Most users prefer lean-back experience Interaction means work —> instant gratification Evidence helps build trust and transparency Choice penalty How much input is needed and how many results to return
  99. Insights - Algorithmic perspective Need to balance popularity, relevancy, and diversity of the recommendations during different phases of the interactive workflow. Real-time scoring vs offline computation of recommendations Video and music domain share many algorithmic characteristics, yet the application requires vastly different implementation On using implicit vs explicit feedback: What users say they like is not always what they watch/ listen
  100. Section name 100 Discussion
Logiciels Technologie

Description

Interactive recommender systems enable the user to steer the received recommendations in the desired direction through explicit interaction with the system. In the larger ecosystem of recommender systems used on a website, it is positioned between a lean-back recommendation experience and an active search for a specific piece of content. Besides this aspect, we will discuss several parts that are especially important for interactive recommender systems, including the following: design of the user interface and its tight integration with the algorithm in the back-end; computational efficiency of the recommender algorithm; as well as choosing the right balance between exploiting the feedback from the user as to provide relevant recommendations, and enabling the user to explore the catalog and steer the recommendations in the desired direction.

In particular, we will explore the field of interactive video and music recommendations and their application at Netflix and Spotify. We outline some of the user-experiences built, and discuss the approaches followed to tackle the various aspects of interactive recommendations. We present our insights from user studies and A/B tests.

The tutorial targets researchers and practitioners in the field of recommender systems, and will give the participants a unique opportunity to learn about the various aspects of interactive recommender systems in the video and music domain. The tutorial assumes familiarity with the common methods of recommender systems.

Transcription

  1. Interactive Recommender Systems RecSys 2015 Harald Steck Netflix Inc. hsteck@netflix.com Roelof van Zwol Netflix Inc. roelofvanzwol@netflix.com Chris Johnson Spotify Inc. cjohnson@spotify.com
  2. Outline Introduction Use cases Netflix Spotify Challenges Deep Dive Netflix Spotify Insights Discussion
  3. Introduction
  4. Section name 4
  5. What are Interactive RSs? Define Interactive: Influencing or having an effect on each other. Allowing a two-way flow of information Responding to a user’s input Forms of Interaction Implicit vs explicit feedback User experiences SearchBrowse Interactive RS
  6. Need for Interactive RSs? To better serve the user’s (entertainment) needs Fill the gap between browse and search Lean-back vs precise need To establish trust and credibility Instant gratification
  7. Interactive RS in practice? Most online services offer different levels of personalization Video: Netflix, YouTube, Hulu, Amazon Video, HBO, … Browse (homepage/genre) and search Music: Spotify, Pandora, Apple Music, Google Music, … Browse, Radio, Search Books/Apps/Shopping: Amazon, Apple, Google (Video and Image) Search: Google, Bing, Yahoo Left rail suggestions (explore), search completion Travel: Booking.com, Kayak, Orbitz, Expedia, … Guided experience: Pick destination —> pick flight and hotel, arrange local transport, plan activities, go dining and sightseeing…
  8. Research on Interactive RS “A successful recommender system must balance the needs to explore user preferences and to exploit this information for recommendation.” Exploration in Interactive Personalized Music Recommendation: A Reinforcement Learning Approach. X. Wang, Y. Wang, D. Hsu, Y. Wang (2013) Active learning / Multi-Armed Bandits (𝜀-greedy, UCB, Thompson sampling) Papers at RecSys this year and in the past :) When do explicit taste preferences trump play data? When we have insufficient knowledge about the user When context changes TasteWeights: A Visual Interactive Hybrid Recommender System. S. Bostandjiev, J. O’Donovan, T. Höllerer (RecSys 2012) When the user has a vague idea of what they want IntRS: Workshop on Interfaces and Human Decision Making for Recommender Systems
  9. Use-case:
  10. Section name 10
  11. Section name 11
  12. Section name 12
  13. Section name 13
  14. Interactive RSs @ Netflix Help user’s find a great video to watch as an alternative to browse and search. Address browse fatigue; failed search experience; or user has vague notion of what to watch; watching with friends Not for everyone, not all the time… Max - Rating Game Select a topic, rate some videos, get recommendations Hot-or-Cold Tell us what you’re into, one video at a time Discover Select one or more videos of interest to explore other similar options
  15. Max - Rating Game
  16. Hot or Cold Game
  17. Discover App
  18. Use-case:
  19. Section name 19
  20. Spotify in Numbers Started in 2006, now available in 58 markets 75+ million active users, 20 million paying subscribers 30+ million songs, 20,000 new songs added per day 1.5 billion playlists 1 TB user data logged per day 1k node Hadoop cluster 10,000+ Hadoop jobs run every day
  21. Challenge: 20 Million songs... how do we recommend music to users?
  22. Discover Weekly
  23. Discover
  24. Related Artists
  25. Radio
  26. Radio as an Interactive RS User has a vague idea of what they would like to listen to User starts a radio station seeded by an Artist, Album, Song, Playlist, or Genre Generally a lean back experience, but with the ability to tune recommendations with (+) and (-) feedback ( )
  27. Section name 27 SmartBox: fully interactive radio experience
  28. Challenges
  29. Challenges Understanding when to present interactive experience - Binging, trying to find something new, experiencing browse fatigue X User Interaction Design - UI affordance - Messaging task - Efficient mechanism to collect user input - Instant gratification - Choice penalty - Navigation options (user control) X X
  30. Challenges Workflow and Algorithmic Design - Computational efficient - Balancing relevancy, diversity and popularity of the recommendations - Support user navigation - Allow for both exploration and exploitation, e.g. avoid overfitting based on limited input from the user X X
  31. Deep Dive: Discover
  32. Discover: Understanding the user
  33. Meeting the users expectations Introducing interactive RS as a full page experience or integrate with other rows on the homepage?
  34. Meeting the users expectations Introducing interactive RS as a full page experience or integrate with other rows on the homepage? Avoid conflict: browse vs discovery mode Browsing on the homepage is a lean-back experience Discover, is interactive… that means work
  35. Understanding the user’s need Introducing Discover feature as a new destination Allow users to quickly navigate to feature
  36. Understanding the user’s need Introducing Discover feature as a new destination Help users find new feature through messaging at top of homepage At session start After scrolling X rows down After 45 secs
  37. Understanding the user’s need Introducing Discover feature as a new destination Help users find new feature through: messaging at top of homepage invitation in row on homepage
  38. Understanding the user’s need Introducing Discover feature as a new destination Help users find new feature through: messaging at top of homepage invitation in row row-based invitation In position of Nth row or as last row on homepage
  39. Understanding the user’s need Context is crucial for the success of the integration of interactive experiences into the product Never interrupt a user that knows what they want Message at start of user session Showing the invitation at the right moment (and place) is crucial Allow the user to explore options on the homepage first Challenge is to find the right trade-off between rate at which user tries the interactive experience, versus success Success rate can vary from 30-70% Not a goal to reach all users, just need to reach those who need help
  40. Discover: Inside the interactive RS
  41. Section name 41
  42. Section name 42
  43. Interaction Workflow for Discover Init - At start of new session, create an initial seed of videos to show to the user See Suggestions - After receiving input from the user (selected videos), compute recommendations
  44. Interaction Workflow for Discover Need to find balance between relevancy, diversity and popularity of the videos shown to the user
  45. Videos in a Latent Space Representation normalized item-vectors
  46. Videos in a Latent Space Representation user-vector in same space
  47. Relevance Score
  48. Diversity Score note:
  49. Popularity Score
  50. “See Suggestions” step Score of item i: , for adjusting the balance score(i) determined by “closest” item j in S “diminishing returns”
  51. “See Suggestions” step Greedy computation of recommendation set S:
  52. Interaction Workflow for Discover See Suggestions - After receiving input from the user (selected videos), compute recommendations What if the selected videos cover more than 1 genre?
  53. User may select diverse set of videos Challenge: Recommendations should reflect all genres of the shows selected by user Solution: Multiple user-vectors, one per selected group of similar shows (clustering) Compute recommendations for each user vector Display clusters in separate rows, or combine via reciprocal rank aggregation
  54. Interaction Workflow for Discover Init - At start of new session, create an initial seed of videos to show to the user Show diverse set of recognizable videos that are familiar to the user, and which is fresh across sessions
  55. Producing the initial set of videos Objective: Show diverse set of recognizable videos that are familiar to the user, and which is fresh across sessions How? Sample videos from user’s play history score: no popularity & relevance component Sample shows from catalog with popularity bias score: no relevance component Randomize initial set for freshness
  56. Learning the Latent Vectors
  57. Learning the Latent Vectors Use implicit feedback data Compute item-item similarity matrix: covariance matrix transition matrix … Train (spectral) matrix factorization model
  58. Graph Cut—Simplistic Example
  59. Graph Cut—Simplistic Example
  60. Graph Cut—Simplistic Example Cut  here …not   similar  to   Ballerina   any  more new  similar
 of  Ballerina:
  61. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  62. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  63. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  64. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  (largely)  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  65. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  (largely)  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  66. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  (largely)  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors  (remove  remaining  popularity)   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  67. Graph Cut à Spectral Clustering 1. Graph à Affinity Matrix A   2.      Laplacian:     L =     D …  diagonal  matrix,    D = sum (A ) popularity  (largely)  removed  prior  to  factorization   3.      factorize  the  Laplacian  L 4.      normalize  the  latent  vectors  (remove  remaining  popularity)   5.      (kmeans)  clustering  of  latent  vectors   ii j ij
  68. Example: Django Movies similar to: Viennese-born Christoph Waltz won Oscar for best supporting role only play-data used, no content information
  69. Similar to Django via basic MF
  70. Similar to Django via spectral MF
  71. Example: Hercules in New York Movies similar to: Austrian-born Arnold Schwarzenegger’s debut movie only play-data used, no content information
  72. Similar to Hercules in NY via basic MF
  73. Similar to Hercules in NY via spectral MF
  74. Deep Dive: Radio
  75. Radio as an Interactive RS User has a vague idea of what they would like to listen to User starts a radio station seeded by an Artist, Album, Song, Playlist, or Genre Generally a lean back experience, but with the ability to tune recommendations with (+) and (-) feedback ( )
  76. Overview of Radio Dataflow
  77. Step 1: Train batch recommendation models
  78. Implicit Matrix Factorization [1] 78 1 0 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 1 0 0 0 1 1 0 1 0 0 0 1 0 0 0 0 1 0 0 1 0 0 1 0 0 0 1 0 0 1 •Aggregate all (user, track) streams into a large matrix •Goal: Approximate binary preference matrix by inner product of 2 smaller matrices by minimizing the weighted RMSE (root mean squared error) using a function of plays, context, and recency as weight X YUsers Songs • = bias for user • = bias for item • = regularization parameter • = 1 if user streamed track else 0 • • = user latent factor vector • = item latent factor vector [1] Hu Y. & Koren Y. & Volinsky C. (2008) Collaborative Filtering for Implicit Feedback Datasets 8th IEEE International Conference on Data Mining
  79. Can also use Logistic Loss! [2] 79 1 0 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 1 0 0 0 1 1 0 1 0 0 0 1 0 0 0 0 1 0 0 1 0 0 1 0 0 0 1 0 0 1 •Aggregate all (user, track) streams into a large matrix •Goal: Model probability of user playing a song as logistic, then maximize log likelihood of binary preference matrix, weighting positive observations by a function of plays, context, and recency X YUsers Songs • = bias for user • = bias for item • = regularization parameter • = user latent factor vector • = item latent factor vector [2] Johnson C. (2014) Logistic Matrix Factorization for Implicit Feedback Data NIPS Workshop on Distributed Matrix Computations
  80. NLP models on News, Blogs, and Text 80
  81. 81 NLP models also work on playlists! Playlist itself is a document Songs in playlist are words
  82. 82 Deep Learning on Audio [3] [3] http://benanne.github.io/2014/08/05/spotify-cnns.html
  83. Songs in a Latent Space Representation normalized item-vectors
  84. Songs in a Latent Space Representation user-vector in same space
  85. Step 2: Ensemble of batch models using explicit thumbs data
  86. Ensemble of Batch Models
  87. Explicit feedback at the expense of presentation bias…
  88. Augment explicit feedback with random negatives
  89. Thumbs also carry a subjective bias… Thumbs used to personally tune a user’s station But with enough data, they’re a pretty good signal
  90. Interesting fact… Ratio of to does not always correlate with user engagement!
  91. Step 3: Static song pools adaptively personalized as user interacts
  92. Should be Simple, fast, and instantly gratifying
  93. Adaptive personalization Probability of choosing song given user , station , at time = global rank of track in song pool = relevancy to user based on implicit CF vector = relevancy to user based on explicit thumbs = diversity of artist and album within radio session
  94. Step 4: Radio thumbs feed back into ensemble!
  95. Interactive feedback loop
  96. Key Take Aways Implicit feedback used to train batch recommendation models Explicit feedback is augmented with random negatives and used as training data to combine batch models (feedback loop) Adaptive shuffling is a function of song pool rank, user’s implicit CF relevancy, user’s thumbs relevancy, and diversity of artist and album Interaction needs to be simple, fast, and instantly gratifying to the user
  97. Insights
  98. Insights - User perspective Positioning of interactive RS in a product is crucial to success Natural transition from browse and search to interaction Interactive RS needs to be lightweight.. Most users prefer lean-back experience Interaction means work —> instant gratification Evidence helps build trust and transparency Choice penalty How much input is needed and how many results to return
  99. Insights - Algorithmic perspective Need to balance popularity, relevancy, and diversity of the recommendations during different phases of the interactive workflow. Real-time scoring vs offline computation of recommendations Video and music domain share many algorithmic characteristics, yet the application requires vastly different implementation On using implicit vs explicit feedback: What users say they like is not always what they watch/ listen
  100. Section name 100 Discussion
Logiciels Technologie

Suggestions

Plus De Contenu Connexe

Diaporamas pour vous

Recommendation and Information Retrieval: Two Sides of the Same Coin?
Arjen de Vries
Music Recommendations at Scale with Spark
Chris Johnson
Recommender Systems
T212
Collaborative Filtering
Tayfun Sen
Collaborative filtering
Kishor Datta Gupta
Recommender systems using collaborative filtering
D Yogendra Rao
Recommender Systems! @ASAI 2011
Ernesto Mislej
Recommender system a-introduction
zh3f
[Final]collaborative filtering and recommender systems
Falitokiniaina Rabearison
Recommender Systems
Federico Cargnelutti
Content - Based Recommendations Enhanced with Collaborative Information
Alessandro Liparoti
Recommender Systems from A to Z – Real-Time Deployment
Crossing Minds
Item Based Collaborative Filtering Recommendation Algorithms
nextlib
Movie Recommendation engine
Jayesh Lahori
Recommender Systems from A to Z – The Right Dataset
Crossing Minds
Recommendation systems
Badr Hirchoua
Recommendation engines
Georgian Micsa
Recommender systems for E-commerce
Alexander Konduforov
Project Progress Report - Recommender Systems for Social Networks
amirhhz

Similaire à Interactive Recommender Systems with Netflix and Spotify

Tutorial on Deep Learning in Recommender System, Lars summer school 2019
Anoop Deoras
Ronny lempelyahooindiabigthinkerapril2013
Muthusamy Chelliah
Building Data Pipelines for Music Recommendations at Spotify
Vidhya Murali
Recommender Systems
Girish Khanzode
Recommender Systems In Industry
Xavier Amatriain
Big & Personal: the data and the models behind Netflix recommendations by Xa...
BigMine
Btp 1st
Dinesh Yadav
Recommender Systems
Carlos Castillo (ChaTo)
Tutorial recommender systems
Aravindharamanan S
Highlights from the 8th ACM Conference on Recommender Systems (RecSys 2014)
David Zibriczky
New Directions in Mahout's Recommenders
sscdotopen
iRIS: A Large-Scale Food and Recipe Recommendation System Using Spark-(Joohyu...
Spark Summit
Recsys 2018 overview and highlights
Sandra Garcia
Computational Advertising-The LinkedIn Way
yingfeng
Music recommendations @ MLConf 2014
Erik Bernhardsson
Overview of recommender system
Stanley Wang
ESSIR 2013 Recommender Systems tutorial
Alexandros Karatzoglou
Large scale Click-streaming and tranaction log mining
itstuff
Netflix Recommendations - Beyond the 5 Stars
Xavier Amatriain
Extending Recommendation Systems With Semantics And Context Awareness
Victor Codina

À la une

What to Upload to SlideShare
SlideShare
Be A Great Product Leader (Amplify, Oct 2019)
Adam Nash
Trillion Dollar Coach Book (Bill Campbell)
Eric Schmidt
APIdays Paris 2019 - Innovation @ scale, APIs as Digital Factories' New Machi...
apidays
A few thoughts on work life-balance
Wim Vanderbauwhede
Is vc still a thing final
Mark Suster
The GaryVee Content Model
Gary Vaynerchuk
Mammalian Brain Chemistry Explains Everything
Loretta Breuning, PhD
Blockchain + AI + Crypto Economics Are We Creating a Code Tsunami?
Dinis Guarda
The AI Rush
Jean-Baptiste Dumont
AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017
Carol Smith
10 facts about jobs in the future
Pew Research Center's Internet & American Life Project
Harry Surden - Artificial Intelligence and Law Overview
Harry Surden
Inside Google's Numbers in 2017
Rand Fishkin
Pinot: Realtime Distributed OLAP datastore
Kishore Gopalakrishna
How to Become a Thought Leader in Your Niche
Leslie Samuel
Visual Design with Data
Seth Familian
Designing Teams for Emerging Challenges
Aaron Irizarry
UX, ethnography and possibilities: for Libraries, Museums and Archives
Ned Potter
Winners and Losers - All the (Russian) President's Men
Ian Bremmer

Livres associés

Gratuit avec un essai de 30 jours de Scribd

Tout voir
L'Art de la guerre: Traité de stratégie en 13 chapitres (texte intégral) Sun Tzu
(3/5)
Gratuit
La vie des abeilles: Prix Nobel de littérature Maurice Maeterlinck
(0/5)
Gratuit
Comprendre la mécanique Yannick Rossi
(4.5/5)
Gratuit
Stratégie d'Investissement en Crypto-monnaie: Comment Devenir Riche Avec les Crypto-monnaies Sato Akira
(3.5/5)
Gratuit
De la Stratégie en général Carl von Clausewitz
(5/5)
Gratuit
Programmer en Java Troy Dimes
(5/5)
Gratuit
L'analyse fondamentale facile à apprendre: Le guide d'introduction aux techniques et stratégies d'analyse fondamentale pour anticiper les événements qui font bouger les marchés Stefano Calicchio
(0/5)
Gratuit
Secrets du Marketing des Médias Sociaux 2021: Conseils et Stratégies Extrêmement Efficaces votre Facebook (Stimulez votre Engagement et Gagnez des Clients Fidèles) Russ Norman
(4/5)
Gratuit
Maison Intelligente: Conception et réalisation d'une maison intelligente Alaa Gaied
(4.5/5)
Gratuit
Le B.A.-Ba de la communication: Comment convaincre, informer, séduire ? Pierre Guilbert
(3/5)
Gratuit
Savoir réparer et entretenir sa voiture Yannick Rossi
(4/5)
Gratuit
Programmer en JavaScript Preston Prescott
(4.5/5)
Gratuit
Dans l'esprit des grand investisseurs: Un voyage à la découverte de la psychologie utilisée par les plus grands investisseurs de tous les temps à travers des analyses opérationnell Stefano Calicchio
(4.5/5)
Gratuit
Scrum - Le Guide Ultime des Méthodes Agiles Essentielles de Scrum! The Blokehead
(0/5)
Gratuit
Les Essentiels du Piratage Informatique Adidas Wilson
(2/5)
Gratuit
Les protections électriques (HT) Gérard Leveque
(3/5)
Gratuit

Livres audio associés

Gratuit avec un essai de 30 jours de Scribd

Tout voir
CRYPTO AUTONOMIE - BLOCKCHAIN ET CRYPTOMONNAIE: Devenir Autonome, Comprendre et Gagner de l'argent en Investissant dans Bitcoin, Ethereum, NFT & etc. - Guide Complet pour Débutants 2022 et au-delà Herman Gross
(0/5)
Gratuit
Agriculture Urbaine Mohammed Mouhssine
(0/5)
Gratuit
L'histoire de l'automobile Anne-Marie Deraspe
(5/5)
Gratuit
L'APICULTURE POUR LES DÉBUTANTS - S'occuper des abeilles comme un pro: Construisez rapidement votre propre colonie et produisez du miel de qualité, en respectant l'environnement (calendrier inclus) Animal World
(0/5)
Gratuit

×