SlideShare une entreprise Scribd logo
1  sur  1
Télécharger pour lire hors ligne
Abstract                                                                                                                               Systems Operations Data
                                                                                                                                                 Partner: System-Wide Safety
NASA and its partners produce staggering amounts of data:                                                                                        and Assurance Technologies
petabytes per day for both earth and space science, with some                                                                       Customer: Operations and Maintenance
missions producing over a petabyte/day individually. Examining all
the data by hand is clearly impossible; progress has been made
in automated discovery, but little has been done to enable
the user to search for potential items of interest
directly. The goal of our research is to                           Problem                Solution
address this gap.
                                                              No existing technology      Our approach is to adapt elements from
Strategic Alignment:                                                     adequately       several methods to address the problem.
OCT Roadmap TA11 (Intelligent                                                                                                                      • Search begins with
                                           supports a user who wants to search for
Data Understanding, Data                                                                                     • Relevance estimation                  prototype of anomaly
                                       data in today’s vast data sets:
Lifecycle elements)                                                                                            concepts from information             • System ranks
National Aero R&D Plan            • The strict query interpretation in                                              retrieval instead of strict          candidates by
(organization and mining            databases often over-         SEARCH                                               constraint application.            variation from
of safety data elements)            restricts or under-                                                                                                    prototype
Initial TRL: 3
                                    restricts the results.     METHODS FOR                                             • Multidimensional utility
                                                                                                                         function from utility theory.
                                                                                                                                                        • System
                                                                                                                              automatically
                            • Data mining does not
                              support ad hoc search
                              as it is not user directed.
                                                                    D
                                                           MULTIDIMENSIONAL DATA
                                                                    D
                                                                  ––––––––––––––––––––––––––––––––––––––
                                                                                                                       • Query refinement by data expands on user’s
                                                                                                                         mining explicit and implicit      initial specification.
                                                                                   Shawn Wolfe                           user feedback.
                               • Information retrieval is                        Nikunj Oza, PhD
                                                                                                                    • Multiattribute query
                                 applied to text, not data.                   Yi Zhang (UCSC), PhD
Martian Images                                                                                                        specifications from              Safety Reports
                                     As a result, the user                                                                 database                   Partner: Aviation Safety
Partner: Planetary Data
                                       misses important                                                                        systems.                      Reporting System
          System
Customer: Scientists                       items in the                Novelty/Contribution                                                        Customer: Safety Analysts
                                               data.
                                                                 • Decrease difficulty of finding important data
                                                                 • Utilize strengths from multiple technologies
                                                                 • Combine human and machine intelligence




                                                                                     Contact:
                                                                                 Shawn Wolfe
• Search for images by metadata                                                                           • Search over different field types (numbers, categories, text)
                                                                            Intelligent Systems (TI)
• Scientists enter desired values                                                                           • Fine-tune performance by data mining past queries and
                                                                                (650) 604-4760
• Tradeoffs over matching values are used to rank images                                                  results
                                                                          <Shawn.Wolfe@nasa.gov>
                                                                                                               • Users can also provide explicit feedback to refine results

Contenu connexe

Similaire à Search Methods for Multidimensional Data

Analytics and reporting context linkedin final
Analytics and reporting context linkedin finalAnalytics and reporting context linkedin final
Analytics and reporting context linkedin finalDennis Crow
 
Cloud Economics in Training and Simulation
Cloud Economics in Training and SimulationCloud Economics in Training and Simulation
Cloud Economics in Training and SimulationNane Kratzke
 
End user computing feri sulianta
End user computing   feri suliantaEnd user computing   feri sulianta
End user computing feri suliantaferisulianta.com
 
Final review m score
Final review m scoreFinal review m score
Final review m scoreazhar4010
 
Bonneau - Complex Networks/Foundations of Information Systems - Spring Review...
Bonneau - Complex Networks/Foundations of Information Systems - Spring Review...Bonneau - Complex Networks/Foundations of Information Systems - Spring Review...
Bonneau - Complex Networks/Foundations of Information Systems - Spring Review...The Air Force Office of Scientific Research
 
Supporting Privacy Protection in Personalized Web Search.pptx
Supporting Privacy Protection in Personalized Web Search.pptxSupporting Privacy Protection in Personalized Web Search.pptx
Supporting Privacy Protection in Personalized Web Search.pptxroopesh30
 
Crowd-Sourced Intelligence Built into Search over Hadoop
Crowd-Sourced Intelligence Built into Search over HadoopCrowd-Sourced Intelligence Built into Search over Hadoop
Crowd-Sourced Intelligence Built into Search over HadoopDataWorks Summit
 
Hadoop summit EU - Crowd Sourcing Reflected Intelligence
Hadoop summit EU - Crowd Sourcing Reflected IntelligenceHadoop summit EU - Crowd Sourcing Reflected Intelligence
Hadoop summit EU - Crowd Sourcing Reflected IntelligenceTed Dunning
 
Real Time Object Dectection using machine learning
Real Time Object Dectection using machine learningReal Time Object Dectection using machine learning
Real Time Object Dectection using machine learningpratik pratyay
 
Cloud Economics in Training and Simulation
Cloud Economics in Training and SimulationCloud Economics in Training and Simulation
Cloud Economics in Training and SimulationNane Kratzke
 
Unit 3 3 architectural design
Unit 3 3 architectural designUnit 3 3 architectural design
Unit 3 3 architectural designHiren Selani
 
Appistry WGDAS Presentation
Appistry WGDAS PresentationAppistry WGDAS Presentation
Appistry WGDAS Presentationelasticdave
 
OSC2012: Big Data Using Open Source: Netapp Project - Technical
OSC2012: Big Data Using Open Source: Netapp Project - TechnicalOSC2012: Big Data Using Open Source: Netapp Project - Technical
OSC2012: Big Data Using Open Source: Netapp Project - TechnicalAccenture the Netherlands
 
Object Detetcion using SSD-MobileNet
Object Detetcion using SSD-MobileNetObject Detetcion using SSD-MobileNet
Object Detetcion using SSD-MobileNetIRJET Journal
 
Application of machine learning in industrial applications
Application of machine learning in industrial applicationsApplication of machine learning in industrial applications
Application of machine learning in industrial applicationsAnish Das
 
Internet data mining 2006
Internet data mining   2006Internet data mining   2006
Internet data mining 2006raj_vij
 
Qiagram Slides 2011 05
Qiagram Slides 2011 05Qiagram Slides 2011 05
Qiagram Slides 2011 05bhughes26
 

Similaire à Search Methods for Multidimensional Data (20)

Analytics and reporting context linkedin final
Analytics and reporting context linkedin finalAnalytics and reporting context linkedin final
Analytics and reporting context linkedin final
 
Dm4
Dm4Dm4
Dm4
 
Cloud Economics in Training and Simulation
Cloud Economics in Training and SimulationCloud Economics in Training and Simulation
Cloud Economics in Training and Simulation
 
End user computing feri sulianta
End user computing   feri suliantaEnd user computing   feri sulianta
End user computing feri sulianta
 
Final review m score
Final review m scoreFinal review m score
Final review m score
 
Bonneau - Complex Networks/Foundations of Information Systems - Spring Review...
Bonneau - Complex Networks/Foundations of Information Systems - Spring Review...Bonneau - Complex Networks/Foundations of Information Systems - Spring Review...
Bonneau - Complex Networks/Foundations of Information Systems - Spring Review...
 
Supporting Privacy Protection in Personalized Web Search.pptx
Supporting Privacy Protection in Personalized Web Search.pptxSupporting Privacy Protection in Personalized Web Search.pptx
Supporting Privacy Protection in Personalized Web Search.pptx
 
Crowd-Sourced Intelligence Built into Search over Hadoop
Crowd-Sourced Intelligence Built into Search over HadoopCrowd-Sourced Intelligence Built into Search over Hadoop
Crowd-Sourced Intelligence Built into Search over Hadoop
 
Hadoop summit EU - Crowd Sourcing Reflected Intelligence
Hadoop summit EU - Crowd Sourcing Reflected IntelligenceHadoop summit EU - Crowd Sourcing Reflected Intelligence
Hadoop summit EU - Crowd Sourcing Reflected Intelligence
 
slide-171212080528.pptx
slide-171212080528.pptxslide-171212080528.pptx
slide-171212080528.pptx
 
Real Time Object Dectection using machine learning
Real Time Object Dectection using machine learningReal Time Object Dectection using machine learning
Real Time Object Dectection using machine learning
 
SECURE: Semantics Empowered resCUe enviRonmEnt
SECURE: Semantics Empowered resCUe enviRonmEntSECURE: Semantics Empowered resCUe enviRonmEnt
SECURE: Semantics Empowered resCUe enviRonmEnt
 
Cloud Economics in Training and Simulation
Cloud Economics in Training and SimulationCloud Economics in Training and Simulation
Cloud Economics in Training and Simulation
 
Unit 3 3 architectural design
Unit 3 3 architectural designUnit 3 3 architectural design
Unit 3 3 architectural design
 
Appistry WGDAS Presentation
Appistry WGDAS PresentationAppistry WGDAS Presentation
Appistry WGDAS Presentation
 
OSC2012: Big Data Using Open Source: Netapp Project - Technical
OSC2012: Big Data Using Open Source: Netapp Project - TechnicalOSC2012: Big Data Using Open Source: Netapp Project - Technical
OSC2012: Big Data Using Open Source: Netapp Project - Technical
 
Object Detetcion using SSD-MobileNet
Object Detetcion using SSD-MobileNetObject Detetcion using SSD-MobileNet
Object Detetcion using SSD-MobileNet
 
Application of machine learning in industrial applications
Application of machine learning in industrial applicationsApplication of machine learning in industrial applications
Application of machine learning in industrial applications
 
Internet data mining 2006
Internet data mining   2006Internet data mining   2006
Internet data mining 2006
 
Qiagram Slides 2011 05
Qiagram Slides 2011 05Qiagram Slides 2011 05
Qiagram Slides 2011 05
 

Plus de Chief Technologist Office

Molecular Rayleigh Scattering to Measure Fluctuations in Density, Velocity an...
Molecular Rayleigh Scattering to Measure Fluctuations in Density, Velocity an...Molecular Rayleigh Scattering to Measure Fluctuations in Density, Velocity an...
Molecular Rayleigh Scattering to Measure Fluctuations in Density, Velocity an...Chief Technologist Office
 
Health Monitoring of Vital Space and Aeronautic Composite
Health Monitoring of Vital Space and Aeronautic Composite Health Monitoring of Vital Space and Aeronautic Composite
Health Monitoring of Vital Space and Aeronautic Composite Chief Technologist Office
 
Softening of Rocks: Enabling Deeper Drilling with Lower Power
Softening of Rocks: Enabling Deeper Drilling with Lower Power Softening of Rocks: Enabling Deeper Drilling with Lower Power
Softening of Rocks: Enabling Deeper Drilling with Lower Power Chief Technologist Office
 
Force Sensors Based on Quantum Mechanical Tunneling
Force Sensors Based on Quantum Mechanical TunnelingForce Sensors Based on Quantum Mechanical Tunneling
Force Sensors Based on Quantum Mechanical TunnelingChief Technologist Office
 
Research and Technology Implications and Applications for Very Small
Research and Technology Implications and Applications for Very SmallResearch and Technology Implications and Applications for Very Small
Research and Technology Implications and Applications for Very SmallChief Technologist Office
 
Lessons Learned from Space Technology Development
Lessons Learned from Space Technology Development Lessons Learned from Space Technology Development
Lessons Learned from Space Technology Development Chief Technologist Office
 
A Strategy for Collaborative NASA Technology Development
A Strategy for Collaborative NASA Technology DevelopmentA Strategy for Collaborative NASA Technology Development
A Strategy for Collaborative NASA Technology DevelopmentChief Technologist Office
 

Plus de Chief Technologist Office (16)

Earthquake Forecasting System
Earthquake Forecasting System Earthquake Forecasting System
Earthquake Forecasting System
 
Subcritical Water Extractor
Subcritical Water Extractor Subcritical Water Extractor
Subcritical Water Extractor
 
Molecular Rayleigh Scattering to Measure Fluctuations in Density, Velocity an...
Molecular Rayleigh Scattering to Measure Fluctuations in Density, Velocity an...Molecular Rayleigh Scattering to Measure Fluctuations in Density, Velocity an...
Molecular Rayleigh Scattering to Measure Fluctuations in Density, Velocity an...
 
Nanoscale Vacuum Tubes
Nanoscale Vacuum Tubes Nanoscale Vacuum Tubes
Nanoscale Vacuum Tubes
 
Cellulose Paper Based Sensors
Cellulose Paper Based Sensors Cellulose Paper Based Sensors
Cellulose Paper Based Sensors
 
Life Support for a Lunar Garden
Life Support for a Lunar Garden Life Support for a Lunar Garden
Life Support for a Lunar Garden
 
Spectroscopy of Organics in Space
Spectroscopy of Organics in Space Spectroscopy of Organics in Space
Spectroscopy of Organics in Space
 
Health Monitoring of Vital Space and Aeronautic Composite
Health Monitoring of Vital Space and Aeronautic Composite Health Monitoring of Vital Space and Aeronautic Composite
Health Monitoring of Vital Space and Aeronautic Composite
 
Crowd Sorcery
Crowd Sorcery Crowd Sorcery
Crowd Sorcery
 
Softening of Rocks: Enabling Deeper Drilling with Lower Power
Softening of Rocks: Enabling Deeper Drilling with Lower Power Softening of Rocks: Enabling Deeper Drilling with Lower Power
Softening of Rocks: Enabling Deeper Drilling with Lower Power
 
Force Sensors Based on Quantum Mechanical Tunneling
Force Sensors Based on Quantum Mechanical TunnelingForce Sensors Based on Quantum Mechanical Tunneling
Force Sensors Based on Quantum Mechanical Tunneling
 
Technology Development at NASA
Technology Development at NASA Technology Development at NASA
Technology Development at NASA
 
Research and Technology Implications and Applications for Very Small
Research and Technology Implications and Applications for Very SmallResearch and Technology Implications and Applications for Very Small
Research and Technology Implications and Applications for Very Small
 
Lessons Learned from Space Technology Development
Lessons Learned from Space Technology Development Lessons Learned from Space Technology Development
Lessons Learned from Space Technology Development
 
A Strategy for Collaborative NASA Technology Development
A Strategy for Collaborative NASA Technology DevelopmentA Strategy for Collaborative NASA Technology Development
A Strategy for Collaborative NASA Technology Development
 
Small Spacecraft Mission Enterprise
Small Spacecraft Mission EnterpriseSmall Spacecraft Mission Enterprise
Small Spacecraft Mission Enterprise
 

Search Methods for Multidimensional Data

  • 1. Abstract Systems Operations Data Partner: System-Wide Safety NASA and its partners produce staggering amounts of data: and Assurance Technologies petabytes per day for both earth and space science, with some Customer: Operations and Maintenance missions producing over a petabyte/day individually. Examining all the data by hand is clearly impossible; progress has been made in automated discovery, but little has been done to enable the user to search for potential items of interest directly. The goal of our research is to Problem Solution address this gap. No existing technology Our approach is to adapt elements from Strategic Alignment: adequately several methods to address the problem. OCT Roadmap TA11 (Intelligent • Search begins with supports a user who wants to search for Data Understanding, Data • Relevance estimation prototype of anomaly data in today’s vast data sets: Lifecycle elements) concepts from information • System ranks National Aero R&D Plan • The strict query interpretation in retrieval instead of strict candidates by (organization and mining databases often over- SEARCH constraint application. variation from of safety data elements) restricts or under- prototype Initial TRL: 3 restricts the results. METHODS FOR • Multidimensional utility function from utility theory. • System automatically • Data mining does not support ad hoc search as it is not user directed. D MULTIDIMENSIONAL DATA D –––––––––––––––––––––––––––––––––––––– • Query refinement by data expands on user’s mining explicit and implicit initial specification. Shawn Wolfe user feedback. • Information retrieval is Nikunj Oza, PhD • Multiattribute query applied to text, not data. Yi Zhang (UCSC), PhD Martian Images specifications from Safety Reports As a result, the user database Partner: Aviation Safety Partner: Planetary Data misses important systems. Reporting System System Customer: Scientists items in the Novelty/Contribution Customer: Safety Analysts data. • Decrease difficulty of finding important data • Utilize strengths from multiple technologies • Combine human and machine intelligence Contact: Shawn Wolfe • Search for images by metadata • Search over different field types (numbers, categories, text) Intelligent Systems (TI) • Scientists enter desired values • Fine-tune performance by data mining past queries and (650) 604-4760 • Tradeoffs over matching values are used to rank images results <Shawn.Wolfe@nasa.gov> • Users can also provide explicit feedback to refine results