SlideShare une entreprise Scribd logo
1  sur  30
Télécharger pour lire hors ligne
FINDING PATTERNS
IN TEMPORAL DATA
                                                   osium!
                                       CI   L Symp
KRIST WONGSUPHASAWAT             27th H 010!
                                        , 2
                                 May 27
TAOWEI DAVID WANG
CATHERINE PLAISANT
BEN SHNEIDERMAN

HUMAN-COMPUTER INTERACTION LAB
UNIVERSITY OF MARYLAND
FINDING PATTERNS
IN TEMPORAL DATA
                                                   osium!
                                       CI   L Symp
KRIST WONGSUPHASAWAT             27th H 010!
                                        , 2
                                 May 27
TAOWEI DAVID WANG
CATHERINE PLAISANT
BEN SHNEIDERMAN

HUMAN-COMPUTER INTERACTION LAB
UNIVERSITY OF MARYLAND
TEMPORAL CATEGORICAL DATA
•  A type of time series
                              Event!           Category!         Event!
        Numerical!
      Stock: Microsoft                   Patient ID: 45851737
 $'#")#"$!$&!$($$   &0!B$0&            !"#$"#"$$%&!'(")    &*++,-./&
 $'#")#"$!$&!$(!;   &0!B$!&            !"#$"#"$$%&!'(0)    &123+43567&
 $'#")#"$!$&!$(0$   &0!B$"&            !"#$"#"$$%&""(''    &89:&
 $'#")#"$!$&!$(';   &0!B$%&            !"#$;#"$$%&$;($<    &=/>>+&
 $'#")#"$!$&!!($$   &0!B!)&            !"#!'#"$$%&$)(!?    &1@,A&
                                       &           Time
                                          Arrival
                                           Emergency
                                                  ICU
                                                        Floor
                                                                  Exit
TEMPORAL CATEGORICAL DATA




Electronic Health Records: symptoms, treatment, lab test"
Traffic incident logs: arrival/departure time of each unit"
Student records: course, paper, proposal, defense, etc."
"
Others: web logs, usability study logs, etc."
10+ years work on temporal visualization
      (mostly on Electronic Health Records)
LIFELINES


            D
SINGLE RECOR




                        [Plaisant et al. 1998]
                http://www.cs.umd.edu/hcil/lifelines
LifeLines – Single Patient
working with physicians at
WASHINGTON HOSPITAL CENTER
EXAMPLE DATA
•  Patient transfers

       ARRIVAL         Arrive the hospital
       EMERGENCY       Emergency room
       ICU             Intensive Care Unit
       INTERMEDIATE    Intermediate Medical Care
       FLOOR           Normal room
       EXIT-ALIVE      Leave the hospital alive
       EXIT-DEAD       Leave the hospital dead
TASKS
•  Example: Finding “Bounce backs”

              ICU      Floor      ICU



                         within 2 days
LIFELINES 2
RECORD

       D
R ECOR
    RECORD


    RECORD

  RECORD
                   [Wang et al. 2008, 2009]
             http://www.cs.umd.edu/hcil/lifelines2
Multiple Records   ARF (Align-Rank-Filter)
                                 Framework




             Temporal Summary




LifeLines2 – Search and Visualize
ALIGNMENT
•  Sentinel events as reference points

                              Time

                      June      July        August
  Patient #45851737      Arrival
                         Emergency
                               ICU
                                          Floor
                                                   Exit
  Patient #43244997                    Arrival
                                       Emergency
                                             ICU
                                                          Floor
                                                                  Exit
ALIGNMENT (2)
•  Time shifting

                               Time

                       0         1M      2M
   Patient #45851737       Admit
                           Emergency
                                ICU
                                       Floor
                                               Exit
   Patient #43244997       Admit
                           Emergency
                                ICU
                                       Floor
                                               Exit
SIMILAN
RECORD

       D
R ECOR
    RECORD


    RECORD

  RECORD
             [Wongsuphasawat & Shneiderman 2009]
               http://www.cs.umd.edu/hcil/similan
Similan – Search by Similarity
Similan – Search by Similarity
FINDING “BOUNCE BACKS”
   Before                             After




  •  Much faster to specify new query
  •  Visualizing the results gives better understanding
USER STUDIES: SEARCH
LifeLines2            Similan
    Exact!          Similarity-based!
MUST have A, B, C    SHOULD have A, B, C


      Query                Query


    Record#2              Record#2

                                           more
    Record#1              Record#1
                                           similar

    Record#3              Record#3
USER STUDIES: SEARCH
    LifeLines2            Similan
        Exact!          Similarity-based!
    MUST have A, B, C    SHOULD have A, B, C


          Query                Query



1       Record#2              Record#2

                                               more
        Record#1              Record#1
                                               similar

        Record#3              Record#3
NEW STUFF
Needs for an overview -> LifeFlow!!
TASKS
•  Example: Finding “Bounce backs”

              ICU       Floor        ICU



                            within 2 days

•  Other questions
                     Arrival
                                            ?
                      ICU

             ?                          ?
LIFEFLOW
    RECORD
       D                                                 VISUALIZE
R ECOR
           RECO                                     Display the aggregation
               RD
   RECORD


RECORD
           RECORD
RECORD

RECORD                      AGGREGATE
                      Merge multiple records into tree
AGGREGATE
•  Aggregate by prefix

     #1

     #2

     #3

     #4




               Example with 4 records
AGGREGATE
•  Aggregate by prefix

     #1

     #2

     #3

     #4
VISUALIZE
•  Inspired by the Icicle tree [Fekete 2004]




        Number of files!
VISUALIZE (2)
•  Use horizontal axis to represent time
•  Video
DEMO – LIFEFLOW
When the lines are combined into flow!
FUTURE WORK
•  Comparison
                               ICU
    ICU         Intermediate               Intermediate




          Jan-Mar 2008               April-June 2008
Floor
TAKE-AWAY MESSAGE
Information visualization is a powerful way
to explore temporal patterns.

         You can work with us
         on new case studies.

Contenu connexe

Plus de Krist Wongsuphasawat

A Narrative Display for Sports Tournament Recap
A Narrative Display for Sports Tournament RecapA Narrative Display for Sports Tournament Recap
A Narrative Display for Sports Tournament Recap
Krist Wongsuphasawat
 

Plus de Krist Wongsuphasawat (20)

Navigating the Wide World of Data Visualization Libraries
Navigating the Wide World of Data Visualization LibrariesNavigating the Wide World of Data Visualization Libraries
Navigating the Wide World of Data Visualization Libraries
 
Encodable: Configurable Grammar for Visualization Components
Encodable: Configurable Grammar for Visualization ComponentsEncodable: Configurable Grammar for Visualization Components
Encodable: Configurable Grammar for Visualization Components
 
6 things to expect when you are visualizing (2020 Edition)
6 things to expect when you are visualizing (2020 Edition)6 things to expect when you are visualizing (2020 Edition)
6 things to expect when you are visualizing (2020 Edition)
 
Increasing the Impact of Visualization Research
Increasing the Impact of Visualization ResearchIncreasing the Impact of Visualization Research
Increasing the Impact of Visualization Research
 
6 things to expect when you are visualizing
6 things to expect when you are visualizing6 things to expect when you are visualizing
6 things to expect when you are visualizing
 
What to expect when you are visualizing (v.2)
What to expect when you are visualizing (v.2)What to expect when you are visualizing (v.2)
What to expect when you are visualizing (v.2)
 
ร้อยเรื่องราวจากข้อมูล / Storytelling with Data
ร้อยเรื่องราวจากข้อมูล / Storytelling with Dataร้อยเรื่องราวจากข้อมูล / Storytelling with Data
ร้อยเรื่องราวจากข้อมูล / Storytelling with Data
 
Reveal the talking points of every episode of Game of Thrones from fans' conv...
Reveal the talking points of every episode of Game of Thrones from fans' conv...Reveal the talking points of every episode of Game of Thrones from fans' conv...
Reveal the talking points of every episode of Game of Thrones from fans' conv...
 
What to expect when you are visualizing
What to expect when you are visualizingWhat to expect when you are visualizing
What to expect when you are visualizing
 
Adventure in Data: A tour of visualization projects at Twitter
Adventure in Data: A tour of visualization projects at TwitterAdventure in Data: A tour of visualization projects at Twitter
Adventure in Data: A tour of visualization projects at Twitter
 
Logs & Visualizations at Twitter
Logs & Visualizations at TwitterLogs & Visualizations at Twitter
Logs & Visualizations at Twitter
 
d3Kit
d3Kitd3Kit
d3Kit
 
Data Visualization: A Quick Tour for Data Science Enthusiasts
Data Visualization: A Quick Tour for Data Science EnthusiastsData Visualization: A Quick Tour for Data Science Enthusiasts
Data Visualization: A Quick Tour for Data Science Enthusiasts
 
Using Visualizations to Monitor Changes and Harvest Insights from a Global-sc...
Using Visualizations to Monitor Changes and Harvest Insights from a Global-sc...Using Visualizations to Monitor Changes and Harvest Insights from a Global-sc...
Using Visualizations to Monitor Changes and Harvest Insights from a Global-sc...
 
Data Visualization at Twitter
Data Visualization at TwitterData Visualization at Twitter
Data Visualization at Twitter
 
Making Sense of Millions of Thoughts: Finding Patterns in the Tweets
Making Sense of Millions of Thoughts: Finding Patterns in the TweetsMaking Sense of Millions of Thoughts: Finding Patterns in the Tweets
Making Sense of Millions of Thoughts: Finding Patterns in the Tweets
 
From Data to Visualization, what happens in between?
From Data to Visualization, what happens in between?From Data to Visualization, what happens in between?
From Data to Visualization, what happens in between?
 
A Narrative Display for Sports Tournament Recap
A Narrative Display for Sports Tournament RecapA Narrative Display for Sports Tournament Recap
A Narrative Display for Sports Tournament Recap
 
Visualization for Event Sequences Exploration
Visualization for Event Sequences ExplorationVisualization for Event Sequences Exploration
Visualization for Event Sequences Exploration
 
Usability of Google Docs
Usability of Google DocsUsability of Google Docs
Usability of Google Docs
 

Dernier

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 

Dernier (20)

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 

Finding Patterns in Temporal Data

  • 1. FINDING PATTERNS IN TEMPORAL DATA osium! CI L Symp KRIST WONGSUPHASAWAT 27th H 010! , 2 May 27 TAOWEI DAVID WANG CATHERINE PLAISANT BEN SHNEIDERMAN HUMAN-COMPUTER INTERACTION LAB UNIVERSITY OF MARYLAND
  • 2. FINDING PATTERNS IN TEMPORAL DATA osium! CI L Symp KRIST WONGSUPHASAWAT 27th H 010! , 2 May 27 TAOWEI DAVID WANG CATHERINE PLAISANT BEN SHNEIDERMAN HUMAN-COMPUTER INTERACTION LAB UNIVERSITY OF MARYLAND
  • 3. TEMPORAL CATEGORICAL DATA •  A type of time series Event! Category! Event! Numerical! Stock: Microsoft Patient ID: 45851737 $'#")#"$!$&!$($$ &0!B$0& !"#$"#"$$%&!'(") &*++,-./& $'#")#"$!$&!$(!; &0!B$!& !"#$"#"$$%&!'(0) &123+43567& $'#")#"$!$&!$(0$ &0!B$"& !"#$"#"$$%&""('' &89:& $'#")#"$!$&!$('; &0!B$%& !"#$;#"$$%&$;($< &=/>>+& $'#")#"$!$&!!($$ &0!B!)& !"#!'#"$$%&$)(!? &1@,A& & Time Arrival Emergency ICU Floor Exit
  • 4. TEMPORAL CATEGORICAL DATA Electronic Health Records: symptoms, treatment, lab test" Traffic incident logs: arrival/departure time of each unit" Student records: course, paper, proposal, defense, etc." " Others: web logs, usability study logs, etc."
  • 5. 10+ years work on temporal visualization (mostly on Electronic Health Records)
  • 6. LIFELINES D SINGLE RECOR [Plaisant et al. 1998] http://www.cs.umd.edu/hcil/lifelines
  • 8. working with physicians at WASHINGTON HOSPITAL CENTER
  • 9. EXAMPLE DATA •  Patient transfers ARRIVAL Arrive the hospital EMERGENCY Emergency room ICU Intensive Care Unit INTERMEDIATE Intermediate Medical Care FLOOR Normal room EXIT-ALIVE Leave the hospital alive EXIT-DEAD Leave the hospital dead
  • 10. TASKS •  Example: Finding “Bounce backs” ICU Floor ICU within 2 days
  • 11. LIFELINES 2 RECORD D R ECOR RECORD RECORD RECORD [Wang et al. 2008, 2009] http://www.cs.umd.edu/hcil/lifelines2
  • 12. Multiple Records ARF (Align-Rank-Filter) Framework Temporal Summary LifeLines2 – Search and Visualize
  • 13. ALIGNMENT •  Sentinel events as reference points Time June July August Patient #45851737 Arrival Emergency ICU Floor Exit Patient #43244997 Arrival Emergency ICU Floor Exit
  • 14. ALIGNMENT (2) •  Time shifting Time 0 1M 2M Patient #45851737 Admit Emergency ICU Floor Exit Patient #43244997 Admit Emergency ICU Floor Exit
  • 15. SIMILAN RECORD D R ECOR RECORD RECORD RECORD [Wongsuphasawat & Shneiderman 2009] http://www.cs.umd.edu/hcil/similan
  • 16. Similan – Search by Similarity
  • 17. Similan – Search by Similarity
  • 18. FINDING “BOUNCE BACKS” Before After •  Much faster to specify new query •  Visualizing the results gives better understanding
  • 19. USER STUDIES: SEARCH LifeLines2 Similan Exact! Similarity-based! MUST have A, B, C SHOULD have A, B, C Query Query Record#2 Record#2 more Record#1 Record#1 similar Record#3 Record#3
  • 20. USER STUDIES: SEARCH LifeLines2 Similan Exact! Similarity-based! MUST have A, B, C SHOULD have A, B, C Query Query 1 Record#2 Record#2 more Record#1 Record#1 similar Record#3 Record#3
  • 21. NEW STUFF Needs for an overview -> LifeFlow!!
  • 22. TASKS •  Example: Finding “Bounce backs” ICU Floor ICU within 2 days •  Other questions Arrival ? ICU ? ?
  • 23. LIFEFLOW RECORD D VISUALIZE R ECOR RECO Display the aggregation RD RECORD RECORD RECORD RECORD RECORD AGGREGATE Merge multiple records into tree
  • 24. AGGREGATE •  Aggregate by prefix #1 #2 #3 #4 Example with 4 records
  • 25. AGGREGATE •  Aggregate by prefix #1 #2 #3 #4
  • 26. VISUALIZE •  Inspired by the Icicle tree [Fekete 2004] Number of files!
  • 27. VISUALIZE (2) •  Use horizontal axis to represent time •  Video
  • 28. DEMO – LIFEFLOW When the lines are combined into flow!
  • 29. FUTURE WORK •  Comparison ICU ICU Intermediate Intermediate Jan-Mar 2008 April-June 2008 Floor
  • 30. TAKE-AWAY MESSAGE Information visualization is a powerful way to explore temporal patterns. You can work with us on new case studies.