Designing Guidelines for Visual Analytics System to Augment Organizational Analytics
1. Designing Visual Analytics Systems for OrganizationalEnvironments A Framework and Its Guidelines Xiaoyu Wang Research Associate at UNC Charlotte Visiting Research Scientist at PARC
2. Motivation GTDVis IRSV What’s a systematic approach to design a user-centered visual analytics system in organizational environment? Taste Visual Analytics Systems Evaluations and Statistical Analysis Familiarity with Domain Users Computation and Automation Knowledge Management and Organizational learning OpsVis
4. Two-step Research Progression Second step: Top-down approach to create design framework that encapsulate the knowledge gained Utilize existing systems for external evidentsto verify and validate the framework Apply the framework to further design and research practices Resulted in A Two-stage Framework for Designing Visual Analytics System in Organizational Environment(to appear in IEEE VAST 2011 ) First step: Summarize design knowledge learnt from all my previous research activities Identify similarities and unique of each analytical domains and system design correspondingly Understand the analytical workflows Resulted in guidelines this paper
5. Collaborators and Settings Bridge Management Project Team: The US Department of Transportation & Civil Engineering Department Scope: Research on techniques for innovative bridge maintenance planning process Document Management Project Team: Palo Alto Research Center & Xerox Corporation Scope: Research on efficient visual abstraction for recalling and managing personal document activities Network Operation Management Project Team: Microsoft Research & Microsoft Cloud Service Team Scope: Research on effective methods for monitoring and responding to cloud service
6. Observation and Design stage Observation and Design Stage Domain Characterization and Analysis Generalization Domain Observation and Analysis Formative Evaluation Evaluation Metrics (key specifications for assessing the system) Fail Visual Analytics System Summative Evaluation Analysis Encapsulation and Visual Encoding Domain Analysis Dissemination Formative Evaluation Design Artifacts Specification Interaction Specification Visualization Specification Alternative Visualization/Interaction Combinations
35. User-centric Refinement Summative Evaluation Pass User-centric Refinement stage II Refine Analysis Focuses Customize Visualization Combination Update Data Model Analysis Evaluation and Knowledge Validation Documentation Support Installation System Deployment and User Training Usage Pattern Analysis and Customization
36. Usage Pattern and Customization Step Customize Visualization Combination Refine Analysis Focuses Update Data Model System Deployment and User Training Analysis Evaluation and Knowledge Validation
37. Interaction Logging and Capturing User’s Analysis Provenance * Empirical study can be found in Dou et al. (2010) : “Comparing different levels of interaction constraints for deriving visual problem isomorphs”
39. Usage Pattern and Customization Step Customize Visualization Combination Refine Analysis Focuses Update Data Model System Deployment and User Training Analysis Evaluation and Knowledge Validation
41. Annotation Example: DOT Web Instant Sharing with Colleagues Multiple Evidence Collections Freeform Selection and Graph Connection Detailed Annotation
42. Summary of Designing VA for Individual Analysis processes Visual Analytics System
43. Contributions Constructed a two-stage visual analytics design framework to incorporate both general domain analytical process and individual analysis approaches Generalize domain analytical workflows to present high-level problem-solving direction Bridge the gap between high-level design concepts and fine-grain implementation of such concepts Augment organizational information analyses through modeling domain users’ reasoning approaches
45. Future Work Continue working interactive learning from domain users’ interaction logs Machine learning Reactive (emotion) visualization Contribute to the evaluation foundation of visual analytics Create standard evaluation metrics Identify key measures for assessing knowledge-gain through using visual analytics
46. Questions Xiaoyu Wang Probably on Skype Now.. Charlotte Visualization Center http://webpages.uncc.edu/~xwang25 xwang25@uncc.edu
48. Summary of Observation and Design stage Domain observation and Analysis Generalization of Domain Analysis Processes Elements needs to be considered during observation and domain characterization Evaluation Metrics that are useful throughout the design as an assessment to the function Design artifacts Actionable knowledge is a fine-grain items to analytically examine the domain’s general analytical workflow Disseminate general task activities into design artifacts through actionable knowledge Design considerations that are generated based on design artifacts. Visual analytics design needs to follow these artifacts
Over the years, I have fun working on several visual analytics system design, participated in design user evaluations and studies, this gives me the idea of standard to evaluate a system, and a design and some exposures to machine learning and robotic, taught me not only thinking computations and automation, but also exploring possibilities to incorporate human in the process with computer. and finally, quite some effort in learning organization and other stuff that isn’t typically widely studied in computer science, worked with ontology etc. Where these lead me. The diversified visual analytics design and other analytical approaches lead to the question about what’s the general framework that can not only encapsulate domain users’ analytical processes, but also allow them to customize it.
This is the high-level process Need to work on the Goals!
context analysis is a useful method to analyze the environment in which a organization operates. On a broader scope, context analysis provides a constrain to ensure that all factors that may affect the usability of a product are considered. It also helps to ensure that user-based evaluation produces valid results, by specifying how important factors are handled in an evaluation, and by defining how well the evaluation reflects real world.The main goal for a context analysis in the design process is to analyze the organizational environments in order to acquire an overall characteristic of the domain. In developing a visual analytics system for organizational environments, the context analysis has been narrowed to understand the technical, analysis and collaboration settings where the visual analytics systems will be used.
Analytical methods to support a trade studyTrade studies are essentially decision-making exercises. In the FAA Systems Handbook (FAA 2004), the decision analysis matrix (aka Pugh's method) is suggested to support the activities, but this method can not support uncertainty, Explain a bit about what actionable knowledge is in actual
Work on objectives!!!!
While visual representations can aid problem solving significantly on their own, they gain even more power to model a problem when interaction is introduced. Interaction is increasingly seen as central to the process of reasoning with visualization
While visual representations can aid problem solving significantly on their own, they gain even more power to model a problem when interaction is introduced. Interaction is increasingly seen as central to the process of reasoning with visualization