SlideShare a Scribd company logo
1 of 30
Neal Lathia
University College London
web: personalisation is everywhere




offline: where are user preferences?
Mining Public Transport Usage for
Personalised Intelligent Transport Systems

            Neal Lathia1, Jon Froehlich2, Licia Capra1
    1
      Dept of Computer Science, University College London
 2
  Computer Science and Engineering, University of Washington
               IEEE ICDM 2010, Sydney, Australia

                         @neal_lathia
                    n.lathia@cs.ucl.ac.uk
mobility and sustainable transport
           is both aided and encouraged with
           info systems:

           why are they not personalised?


traveller information systems
why personalise?

                   a wide range of people, with different
                   needs, preferences, constraints

                   only 46-62% of the travel time is spent
                   sitting on trains

                   majority of notifications, updates, &
                   events are irrelevant to travellers
why personalise?

                   a wide range of people, with different
                   needs, preferences, constraints

                   only 46-62% of the travel time is spent
                   sitting on trains

                   majority of notifications, updates, &
                   events are irrelevant to travellers
using                to infer

dataset: <user, origin, destination, date, start, end>


what can we learn about user preferences from
fare collection systems?

what sort of personalised systems can be built?

what prediction/ranking algorithms can we use?
2 x ~300,000 travellers (5%), ~7,000,0000
tube trips: aggregate
2 x ~300,000 travellers (5%), ~7,000,0000
tube trips: aggregate
transport research focuses on
what this data tells us about the
system:

demand modelling
service reliability measurements
average travel time estimation
station transfer analysis

what does it tell us about the
travellers?
2 x ~300,000 travellers (5%), ~7,000,0000
tube trips: hierarchical clustering
2 x ~300,000 travellers (5%), ~7,000,0000
tube trips: hierarchical clustering
2 x ~300,000 travellers (5%), ~7,000,0000
tube trips: hierarchical clustering
2 x ~300,000 travellers (5%),
~7,000,0000 tube trips
hierarchical clustering




         the data shows:
         a huge diversity of travellers

         measurable ranges of habits and
         preferences: when & where to
         travel, how long travel takes..

         next step?
using                to build

        what applications?


        personalised travel time: how long
        will it take me to get there?

        personalised notifications: which
        stations' events are relevant to me?

        ...and more in our future work
using                to build

        what applications?


        personalised travel time: how long
        will it take me to get there?

        personalised notifications: which
        stations' events are relevant to me?

        ...and more in our future work
personalised trip time – 3 methods


     self-similarity: implicitly capture route
     choices, walk time
     (weighted geometric mean of traveller's history)
personalised trip time – 3 methods


                       self-similarity: implicitly capture route
                       choices, walk time




familiarity: similar users
(neighbourhood model of travellers who are
similarly familiar)
personalised trip time – 3 methods


                    self-similarity: implicitly capture route
                    choices, walk time




familiarity: similar users




                             context: implicitly capture
                             historical trends in current trip
                             (two-sided sliding window moving average
                             model)
personalised trip time –
          evaluation




evaluation

split data:
74 day training set (90%)
9 day test set (10%)

metrics:
mean absolute error (MAE)
mean absolute percentage error (MAPE)
personalised
evaluation (MAE)                     trip time –
            evaluation
global mean – 11.45 mins
zone mean – 8.56 mins
journey planner – 6 mins (preliminary)


trip mean – 3.109 mins
familiarity – 2.989 mins
context – 2.986 mins
self-similarity – 2.924 mins

combined – 2.922 mins
personalised
evaluation (MAE)                     trip time –
            evaluation
global mean – 11.45 mins                   error ~ trip time
zone mean – 8.56 mins
journey planner – 6 mins (preliminary)     error highest for people
                                           who only travel on
trip mean – 3.109 mins                     weekends
familiarity – 2.989 mins
context – 2.986 mins                       more trips reduces error
self-similarity – 2.924 mins

combined – 2.922 mins
using                to build

        what applications?


        personalised travel time: how long
        will it take me to get there?

        personalised notifications: which
        stations' events are relevant to me?

        ...and more in our future work
station interest ranking


predict (and rank) the stations that
travellers will visit in their future trips
for personalised notifications

current system: free travel alerts –
manually set up by traveller
station interest ranking


can we automate this?

baseline: rank by visit popularity

proposal: station similarity
neighbourhood (visit co-occurrence)
and traveller trip history
station interest ranking


1. begin with baseline ranking

2. add proportional weighting for
stations user has visited in the past

3. transform dataset into station-
station co-occurrence matrix, increase
weight of similar stations

metric: percentile ranking
station interest ranking
without knowing who travellers are, the
network topology, train schedule,
disruptions and closures, we designed


   personalised information services

                            for intelligent transport systems
2 x ~300,000 travellers (5%),
~7,000,0000 tube trips
hierarchical clustering
         what next?

         larger, multi-modal datasets to
         investigate and improve the
         algorithms we evaluate here;

         implementations for mobile
         devices to study these
         applications in the field;

         examine other facets of travel
         behaviour (e.g., ticket purchasing)
Mining Public Transport Usage for
Personalised Intelligent Transport Systems



   We are hiring! interested? get in touch!

                 @neal_lathia
            n.lathia@cs.ucl.ac.uk

More Related Content

Viewers also liked

Instalaciones eléctricas
Instalaciones eléctricasInstalaciones eléctricas
Instalaciones eléctricasYazmin Venegas
 
Prestación final de instalaciones electricas monofásicas y normativas efi
Prestación final de instalaciones electricas monofásicas y normativas efiPrestación final de instalaciones electricas monofásicas y normativas efi
Prestación final de instalaciones electricas monofásicas y normativas efiNéstor Daniel Chicas Monroy
 
Taller Mecánico Automotriz - Gerencia de Servicios
Taller Mecánico Automotriz  - Gerencia de ServiciosTaller Mecánico Automotriz  - Gerencia de Servicios
Taller Mecánico Automotriz - Gerencia de Servicioswladdy66
 
Elementos básicos de una instalacion eléctrica y características de una vivie...
Elementos básicos de una instalacion eléctrica y características de una vivie...Elementos básicos de una instalacion eléctrica y características de una vivie...
Elementos básicos de una instalacion eléctrica y características de una vivie...PaquiRP
 
PROYECTO TALLER SENA
PROYECTO TALLER  SENAPROYECTO TALLER  SENA
PROYECTO TALLER SENAguestcd2f3254
 
Diseño de instalaciones para un taller de mecánica rápida de vehículos
Diseño de instalaciones para un taller de mecánica rápida de vehículosDiseño de instalaciones para un taller de mecánica rápida de vehículos
Diseño de instalaciones para un taller de mecánica rápida de vehículosErik Demian Díaz Kaas-Nielsen
 
Instalaciones eléctricas
Instalaciones eléctricas Instalaciones eléctricas
Instalaciones eléctricas Espoch
 
Tema 2. instalaciones eléctricas en viviendas
Tema 2. instalaciones eléctricas en viviendasTema 2. instalaciones eléctricas en viviendas
Tema 2. instalaciones eléctricas en viviendasmabr36
 
Instalaciones en viviendas y edificios
Instalaciones en viviendas y edificiosInstalaciones en viviendas y edificios
Instalaciones en viviendas y edificiosKoldo Parra
 
Instalación de relés en circuitos de control
Instalación de relés en circuitos de controlInstalación de relés en circuitos de control
Instalación de relés en circuitos de controlUtp arequipa
 
Instalación eléctrica semivisible con tubos de pvc
Instalación eléctrica semivisible con tubos de pvcInstalación eléctrica semivisible con tubos de pvc
Instalación eléctrica semivisible con tubos de pvcUtp arequipa
 
Manual de-instalaciones-electricas-en-bt-2009
Manual de-instalaciones-electricas-en-bt-2009Manual de-instalaciones-electricas-en-bt-2009
Manual de-instalaciones-electricas-en-bt-2009Edinson Sánchez
 
Manual de-instalaciones-electricas-mod. 3
Manual de-instalaciones-electricas-mod. 3Manual de-instalaciones-electricas-mod. 3
Manual de-instalaciones-electricas-mod. 3Noni Gus
 
INSTALACIONES ELECTRICAS UTEC
INSTALACIONES ELECTRICAS UTECINSTALACIONES ELECTRICAS UTEC
INSTALACIONES ELECTRICAS UTECDavis Alfaro
 
Instalaciones Electricas
Instalaciones  ElectricasInstalaciones  Electricas
Instalaciones ElectricasDavis Alfaro
 
Exposicion instalaciones electricas
Exposicion instalaciones electricasExposicion instalaciones electricas
Exposicion instalaciones electricasAndru GuarniiZo
 

Viewers also liked (20)

Instalaciones eléctricas
Instalaciones eléctricasInstalaciones eléctricas
Instalaciones eléctricas
 
Prestación final de instalaciones electricas monofásicas y normativas efi
Prestación final de instalaciones electricas monofásicas y normativas efiPrestación final de instalaciones electricas monofásicas y normativas efi
Prestación final de instalaciones electricas monofásicas y normativas efi
 
Alcances y objetivos inst. electricas
Alcances y objetivos inst. electricasAlcances y objetivos inst. electricas
Alcances y objetivos inst. electricas
 
Taller Mecánico Automotriz - Gerencia de Servicios
Taller Mecánico Automotriz  - Gerencia de ServiciosTaller Mecánico Automotriz  - Gerencia de Servicios
Taller Mecánico Automotriz - Gerencia de Servicios
 
Elementos básicos de una instalacion eléctrica y características de una vivie...
Elementos básicos de una instalacion eléctrica y características de una vivie...Elementos básicos de una instalacion eléctrica y características de una vivie...
Elementos básicos de una instalacion eléctrica y características de una vivie...
 
PROYECTO TALLER SENA
PROYECTO TALLER  SENAPROYECTO TALLER  SENA
PROYECTO TALLER SENA
 
Diseño de instalaciones para un taller de mecánica rápida de vehículos
Diseño de instalaciones para un taller de mecánica rápida de vehículosDiseño de instalaciones para un taller de mecánica rápida de vehículos
Diseño de instalaciones para un taller de mecánica rápida de vehículos
 
Instalaciones eléctricas
Instalaciones eléctricas Instalaciones eléctricas
Instalaciones eléctricas
 
Tema 2. instalaciones eléctricas en viviendas
Tema 2. instalaciones eléctricas en viviendasTema 2. instalaciones eléctricas en viviendas
Tema 2. instalaciones eléctricas en viviendas
 
Alcance y limitaciones del proyecto
Alcance y limitaciones del proyectoAlcance y limitaciones del proyecto
Alcance y limitaciones del proyecto
 
Instalaciones en viviendas y edificios
Instalaciones en viviendas y edificiosInstalaciones en viviendas y edificios
Instalaciones en viviendas y edificios
 
Instalación de relés en circuitos de control
Instalación de relés en circuitos de controlInstalación de relés en circuitos de control
Instalación de relés en circuitos de control
 
Presentacio2
Presentacio2Presentacio2
Presentacio2
 
Presentacion1
Presentacion1Presentacion1
Presentacion1
 
Instalación eléctrica semivisible con tubos de pvc
Instalación eléctrica semivisible con tubos de pvcInstalación eléctrica semivisible con tubos de pvc
Instalación eléctrica semivisible con tubos de pvc
 
Manual de-instalaciones-electricas-en-bt-2009
Manual de-instalaciones-electricas-en-bt-2009Manual de-instalaciones-electricas-en-bt-2009
Manual de-instalaciones-electricas-en-bt-2009
 
Manual de-instalaciones-electricas-mod. 3
Manual de-instalaciones-electricas-mod. 3Manual de-instalaciones-electricas-mod. 3
Manual de-instalaciones-electricas-mod. 3
 
INSTALACIONES ELECTRICAS UTEC
INSTALACIONES ELECTRICAS UTECINSTALACIONES ELECTRICAS UTEC
INSTALACIONES ELECTRICAS UTEC
 
Instalaciones Electricas
Instalaciones  ElectricasInstalaciones  Electricas
Instalaciones Electricas
 
Exposicion instalaciones electricas
Exposicion instalaciones electricasExposicion instalaciones electricas
Exposicion instalaciones electricas
 

Similar to Mining Public Transport for Personalised Intelligent Transport Systems

A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...University of Piraeus
 
Comparative framework for activity-travel diary collection systems
Comparative framework for activity-travel diary collection systemsComparative framework for activity-travel diary collection systems
Comparative framework for activity-travel diary collection systemsAdrian C. Prelipcean
 
Anomaly Detection - Catch me if you can
Anomaly Detection - Catch me if you canAnomaly Detection - Catch me if you can
Anomaly Detection - Catch me if you canYousef Fadila
 
4.5_poster_STIC_OmarDib_AB
4.5_poster_STIC_OmarDib_AB4.5_poster_STIC_OmarDib_AB
4.5_poster_STIC_OmarDib_ABOmar Dib
 
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...Deja Lewis
 
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...Adrian C. Prelipcean
 
Travel route scheduling based on user’s preferences using simulated annealing
Travel route scheduling based on user’s preferences using simulated annealingTravel route scheduling based on user’s preferences using simulated annealing
Travel route scheduling based on user’s preferences using simulated annealingIJECEIAES
 
School Bus Alerting System for parents .pptx
School Bus Alerting System for parents .pptxSchool Bus Alerting System for parents .pptx
School Bus Alerting System for parents .pptxNagraj Tondchore
 
T drive enhancing driving directions with taxi drivers’ intelligence
T drive enhancing driving directions with taxi drivers’ intelligenceT drive enhancing driving directions with taxi drivers’ intelligence
T drive enhancing driving directions with taxi drivers’ intelligenceIEEEFINALYEARPROJECTS
 
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...IEEEGLOBALSOFTTECHNOLOGIES
 
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)Future Cities Project
 
IRJET - Driving Safety Risk Analysis using Naturalistic Driving Data
IRJET - Driving Safety Risk Analysis using Naturalistic Driving DataIRJET - Driving Safety Risk Analysis using Naturalistic Driving Data
IRJET - Driving Safety Risk Analysis using Naturalistic Driving DataIRJET Journal
 
IRJET- Fuzzy Logic based Route Choice Behaviour Modelling
IRJET-  	  Fuzzy Logic based Route Choice Behaviour ModellingIRJET-  	  Fuzzy Logic based Route Choice Behaviour Modelling
IRJET- Fuzzy Logic based Route Choice Behaviour ModellingIRJET Journal
 
A New Perspective Of Traffic Assignment A Game Theoretical Approach
A New Perspective Of Traffic Assignment  A Game Theoretical ApproachA New Perspective Of Traffic Assignment  A Game Theoretical Approach
A New Perspective Of Traffic Assignment A Game Theoretical ApproachAnita Miller
 
Bertrand Fontaine - Deep Learning for driver/passenger detection of car trips
Bertrand Fontaine - Deep Learning for driver/passenger detection of car tripsBertrand Fontaine - Deep Learning for driver/passenger detection of car trips
Bertrand Fontaine - Deep Learning for driver/passenger detection of car tripsHendrik D'Oosterlinck
 
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...Vasileios Komianos
 
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...University of Piraeus
 
Hybrid recommendation technique for automated personalized poi selection
Hybrid recommendation technique for automated personalized poi selectionHybrid recommendation technique for automated personalized poi selection
Hybrid recommendation technique for automated personalized poi selectionIAEME Publication
 

Similar to Mining Public Transport for Personalised Intelligent Transport Systems (20)

Ticketing Application
Ticketing ApplicationTicketing Application
Ticketing Application
 
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
 
Comparative framework for activity-travel diary collection systems
Comparative framework for activity-travel diary collection systemsComparative framework for activity-travel diary collection systems
Comparative framework for activity-travel diary collection systems
 
Anomaly Detection - Catch me if you can
Anomaly Detection - Catch me if you canAnomaly Detection - Catch me if you can
Anomaly Detection - Catch me if you can
 
4.5_poster_STIC_OmarDib_AB
4.5_poster_STIC_OmarDib_AB4.5_poster_STIC_OmarDib_AB
4.5_poster_STIC_OmarDib_AB
 
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...
Application Of Long Short Term Memory Networks For Long- And Short-Term Bus T...
 
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...
Lessons from a trial of MEILI a smartphone based semi-automatic activity-trav...
 
Travel route scheduling based on user’s preferences using simulated annealing
Travel route scheduling based on user’s preferences using simulated annealingTravel route scheduling based on user’s preferences using simulated annealing
Travel route scheduling based on user’s preferences using simulated annealing
 
School Bus Alerting System for parents .pptx
School Bus Alerting System for parents .pptxSchool Bus Alerting System for parents .pptx
School Bus Alerting System for parents .pptx
 
T drive enhancing driving directions with taxi drivers’ intelligence
T drive enhancing driving directions with taxi drivers’ intelligenceT drive enhancing driving directions with taxi drivers’ intelligence
T drive enhancing driving directions with taxi drivers’ intelligence
 
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...
JAVA 2013 IEEE DATAMINING PROJECT T drive enhancing driving directions with t...
 
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)
Workshop on Sustainable Mobility in Future Cities - Rui Carreira (FEUP)
 
IRJET - Driving Safety Risk Analysis using Naturalistic Driving Data
IRJET - Driving Safety Risk Analysis using Naturalistic Driving DataIRJET - Driving Safety Risk Analysis using Naturalistic Driving Data
IRJET - Driving Safety Risk Analysis using Naturalistic Driving Data
 
IRJET- Fuzzy Logic based Route Choice Behaviour Modelling
IRJET-  	  Fuzzy Logic based Route Choice Behaviour ModellingIRJET-  	  Fuzzy Logic based Route Choice Behaviour Modelling
IRJET- Fuzzy Logic based Route Choice Behaviour Modelling
 
Travel cost model warawut
Travel cost model warawutTravel cost model warawut
Travel cost model warawut
 
A New Perspective Of Traffic Assignment A Game Theoretical Approach
A New Perspective Of Traffic Assignment  A Game Theoretical ApproachA New Perspective Of Traffic Assignment  A Game Theoretical Approach
A New Perspective Of Traffic Assignment A Game Theoretical Approach
 
Bertrand Fontaine - Deep Learning for driver/passenger detection of car trips
Bertrand Fontaine - Deep Learning for driver/passenger detection of car tripsBertrand Fontaine - Deep Learning for driver/passenger detection of car trips
Bertrand Fontaine - Deep Learning for driver/passenger detection of car trips
 
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...
Constrained Interest-base Tour Recommendations in Large Scale Cultural Herita...
 
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
A Route Selection Scheme for supporting Virtual Tours in Sites with Cultural ...
 
Hybrid recommendation technique for automated personalized poi selection
Hybrid recommendation technique for automated personalized poi selectionHybrid recommendation technique for automated personalized poi selection
Hybrid recommendation technique for automated personalized poi selection
 

More from Neal Lathia

Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)Neal Lathia
 
Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)Neal Lathia
 
Using language models to supercharge Monzo’s customer support
 Using language models to supercharge Monzo’s customer support Using language models to supercharge Monzo’s customer support
Using language models to supercharge Monzo’s customer supportNeal Lathia
 
Making Better Decisions Faster
Making Better Decisions FasterMaking Better Decisions Faster
Making Better Decisions FasterNeal Lathia
 
Machine Learning, Faster
Machine Learning, FasterMachine Learning, Faster
Machine Learning, FasterNeal Lathia
 
AI & Personalised Experiences
AI & Personalised ExperiencesAI & Personalised Experiences
AI & Personalised ExperiencesNeal Lathia
 
Opportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised TravelOpportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised TravelNeal Lathia
 
Bootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation EngineBootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation EngineNeal Lathia
 
Machine Learning for Product Managers
Machine Learning for Product ManagersMachine Learning for Product Managers
Machine Learning for Product ManagersNeal Lathia
 
Mining Smartphone Data (with Python)
Mining Smartphone Data (with Python)Mining Smartphone Data (with Python)
Mining Smartphone Data (with Python)Neal Lathia
 
Happier and Healthier with Smartphone Data
Happier and Healthier with Smartphone DataHappier and Healthier with Smartphone Data
Happier and Healthier with Smartphone DataNeal Lathia
 
Data Science in Digital Health
Data Science in Digital HealthData Science in Digital Health
Data Science in Digital HealthNeal Lathia
 
Using Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily LifeUsing Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily LifeNeal Lathia
 
Analysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone DataAnalysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone DataNeal Lathia
 
Cambridge Quantified Self Meetup
Cambridge Quantified Self MeetupCambridge Quantified Self Meetup
Cambridge Quantified Self MeetupNeal Lathia
 
Data Science in #mHealth
Data Science in #mHealthData Science in #mHealth
Data Science in #mHealthNeal Lathia
 
Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport Neal Lathia
 
Emotion Sense: From Design to Deployment
Emotion Sense: From Design to DeploymentEmotion Sense: From Design to Deployment
Emotion Sense: From Design to DeploymentNeal Lathia
 
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...Neal Lathia
 
Using Smartphones to Research Daily Life
Using Smartphones to Research Daily LifeUsing Smartphones to Research Daily Life
Using Smartphones to Research Daily LifeNeal Lathia
 

More from Neal Lathia (20)

Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)Everything around the NLP (London.AI Feb 2021)
Everything around the NLP (London.AI Feb 2021)
 
Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)Using machine learning for customer service (Data Talks Club)
Using machine learning for customer service (Data Talks Club)
 
Using language models to supercharge Monzo’s customer support
 Using language models to supercharge Monzo’s customer support Using language models to supercharge Monzo’s customer support
Using language models to supercharge Monzo’s customer support
 
Making Better Decisions Faster
Making Better Decisions FasterMaking Better Decisions Faster
Making Better Decisions Faster
 
Machine Learning, Faster
Machine Learning, FasterMachine Learning, Faster
Machine Learning, Faster
 
AI & Personalised Experiences
AI & Personalised ExperiencesAI & Personalised Experiences
AI & Personalised Experiences
 
Opportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised TravelOpportunities & Challenges in Personalised Travel
Opportunities & Challenges in Personalised Travel
 
Bootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation EngineBootstrapping a Destination Recommendation Engine
Bootstrapping a Destination Recommendation Engine
 
Machine Learning for Product Managers
Machine Learning for Product ManagersMachine Learning for Product Managers
Machine Learning for Product Managers
 
Mining Smartphone Data (with Python)
Mining Smartphone Data (with Python)Mining Smartphone Data (with Python)
Mining Smartphone Data (with Python)
 
Happier and Healthier with Smartphone Data
Happier and Healthier with Smartphone DataHappier and Healthier with Smartphone Data
Happier and Healthier with Smartphone Data
 
Data Science in Digital Health
Data Science in Digital HealthData Science in Digital Health
Data Science in Digital Health
 
Using Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily LifeUsing Smartphones to Measure (and Intervene in) Daily Life
Using Smartphones to Measure (and Intervene in) Daily Life
 
Analysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone DataAnalysing Daily Behaviours with Large-Scale Smartphone Data
Analysing Daily Behaviours with Large-Scale Smartphone Data
 
Cambridge Quantified Self Meetup
Cambridge Quantified Self MeetupCambridge Quantified Self Meetup
Cambridge Quantified Self Meetup
 
Data Science in #mHealth
Data Science in #mHealthData Science in #mHealth
Data Science in #mHealth
 
Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport Tube Star: Crowd-Sourced Experiences on Public Transport
Tube Star: Crowd-Sourced Experiences on Public Transport
 
Emotion Sense: From Design to Deployment
Emotion Sense: From Design to DeploymentEmotion Sense: From Design to Deployment
Emotion Sense: From Design to Deployment
 
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
Opportunities and Challenges of Using Smartphones for Health Monitoring and I...
 
Using Smartphones to Research Daily Life
Using Smartphones to Research Daily LifeUsing Smartphones to Research Daily Life
Using Smartphones to Research Daily Life
 

Recently uploaded

From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 

Recently uploaded (20)

From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 

Mining Public Transport for Personalised Intelligent Transport Systems

  • 2. web: personalisation is everywhere offline: where are user preferences?
  • 3. Mining Public Transport Usage for Personalised Intelligent Transport Systems Neal Lathia1, Jon Froehlich2, Licia Capra1 1 Dept of Computer Science, University College London 2 Computer Science and Engineering, University of Washington IEEE ICDM 2010, Sydney, Australia @neal_lathia n.lathia@cs.ucl.ac.uk
  • 4. mobility and sustainable transport is both aided and encouraged with info systems: why are they not personalised? traveller information systems
  • 5. why personalise? a wide range of people, with different needs, preferences, constraints only 46-62% of the travel time is spent sitting on trains majority of notifications, updates, & events are irrelevant to travellers
  • 6. why personalise? a wide range of people, with different needs, preferences, constraints only 46-62% of the travel time is spent sitting on trains majority of notifications, updates, & events are irrelevant to travellers
  • 7. using to infer dataset: <user, origin, destination, date, start, end> what can we learn about user preferences from fare collection systems? what sort of personalised systems can be built? what prediction/ranking algorithms can we use?
  • 8. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips: aggregate
  • 9. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips: aggregate
  • 10. transport research focuses on what this data tells us about the system: demand modelling service reliability measurements average travel time estimation station transfer analysis what does it tell us about the travellers?
  • 11. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips: hierarchical clustering
  • 12. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips: hierarchical clustering
  • 13. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips: hierarchical clustering
  • 14. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips hierarchical clustering the data shows: a huge diversity of travellers measurable ranges of habits and preferences: when & where to travel, how long travel takes.. next step?
  • 15. using to build what applications? personalised travel time: how long will it take me to get there? personalised notifications: which stations' events are relevant to me? ...and more in our future work
  • 16. using to build what applications? personalised travel time: how long will it take me to get there? personalised notifications: which stations' events are relevant to me? ...and more in our future work
  • 17. personalised trip time – 3 methods self-similarity: implicitly capture route choices, walk time (weighted geometric mean of traveller's history)
  • 18. personalised trip time – 3 methods self-similarity: implicitly capture route choices, walk time familiarity: similar users (neighbourhood model of travellers who are similarly familiar)
  • 19. personalised trip time – 3 methods self-similarity: implicitly capture route choices, walk time familiarity: similar users context: implicitly capture historical trends in current trip (two-sided sliding window moving average model)
  • 20. personalised trip time – evaluation evaluation split data: 74 day training set (90%) 9 day test set (10%) metrics: mean absolute error (MAE) mean absolute percentage error (MAPE)
  • 21. personalised evaluation (MAE) trip time – evaluation global mean – 11.45 mins zone mean – 8.56 mins journey planner – 6 mins (preliminary) trip mean – 3.109 mins familiarity – 2.989 mins context – 2.986 mins self-similarity – 2.924 mins combined – 2.922 mins
  • 22. personalised evaluation (MAE) trip time – evaluation global mean – 11.45 mins error ~ trip time zone mean – 8.56 mins journey planner – 6 mins (preliminary) error highest for people who only travel on trip mean – 3.109 mins weekends familiarity – 2.989 mins context – 2.986 mins more trips reduces error self-similarity – 2.924 mins combined – 2.922 mins
  • 23. using to build what applications? personalised travel time: how long will it take me to get there? personalised notifications: which stations' events are relevant to me? ...and more in our future work
  • 24. station interest ranking predict (and rank) the stations that travellers will visit in their future trips for personalised notifications current system: free travel alerts – manually set up by traveller
  • 25. station interest ranking can we automate this? baseline: rank by visit popularity proposal: station similarity neighbourhood (visit co-occurrence) and traveller trip history
  • 26. station interest ranking 1. begin with baseline ranking 2. add proportional weighting for stations user has visited in the past 3. transform dataset into station- station co-occurrence matrix, increase weight of similar stations metric: percentile ranking
  • 28. without knowing who travellers are, the network topology, train schedule, disruptions and closures, we designed personalised information services for intelligent transport systems
  • 29. 2 x ~300,000 travellers (5%), ~7,000,0000 tube trips hierarchical clustering what next? larger, multi-modal datasets to investigate and improve the algorithms we evaluate here; implementations for mobile devices to study these applications in the field; examine other facets of travel behaviour (e.g., ticket purchasing)
  • 30. Mining Public Transport Usage for Personalised Intelligent Transport Systems We are hiring! interested? get in touch! @neal_lathia n.lathia@cs.ucl.ac.uk