SlideShare une entreprise Scribd logo
1  sur  58
Learning to Search Henry Kautz University of Washington joint work with Dimitri Achlioptas, Carla Gomes, Eric Horvitz, Don Patterson, Yongshao Ruan, Bart Selman CORE – MSR, Cornell, UW
Speedup Learning ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
It failed. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
It succeeded. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Everyone got busy. ,[object Object],[object Object],[object Object],[object Object]
Another path ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Big Picture Problem Instances Solver static features runtime Learning / Analysis Predictive Model dynamic features resource allocation / reformulation control / policy
Case Study 1: Beyond 4.25 Problem Instances Solver static features runtime Learning / Analysis Predictive Model
Phase transitions & problem hardness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Quasigroup Completion Problem (QCP) ,[object Object],[object Object],[object Object]
Phase Transition Almost all unsolvable area Fraction of pre-assignment Fraction of unsolvable cases Almost all solvable area Phase transition   Underconstrained area Critically constrained area Overconstrained area Complexity Graph 42% 50% 20% 42% 50% 20%
Easy-Hard-Easy pattern in local search % holes Computational Cost “ Over” constrained area Underconstrained area Walksat Order 30, 33, 36
Are we ready to predict run times? ,[object Object],log scale
Deep structural features Hardness is also controlled by  structure  of constraints,  not just the fraction of holes Rectangular Pattern Aligned Pattern Balanced Pattern Tractable Very hard
Random versus balanced Balanced Random
Random versus balanced Balanced Random
Random vs. balanced (log scale) Balanced Random
Morphing balanced and random
Considering variance in hole pattern
Time on log scale
Effect of balance on hardness ,[object Object],[object Object],[object Object],[object Object],[object Object]
Intuitions ,[object Object],[object Object]
Are we done? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Case study 2: AutoWalksat Problem Instances Solver runtime Learning / Analysis Predictive Model dynamic features control / policy
Walksat ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
[object Object],[object Object],The Invariant Ratio 0 1 2 3 4 5 6 7 + 10% Mean of the objective function Std Deviation of the objective function
Automatic Noise Setting ,[object Object],[object Object],[object Object],[object Object],[object Object]
Hard random 3-SAT
3-SAT, probes 1, 2
3-SAT, probe 3
3-SAT, probe 4
3-SAT, probe 5
3-SAT, probe 6
3-SAT, probe 7
3-SAT, probe 8
3-SAT, probe 9
3-SAT, probe 10
Summary: random, circuit test, graph coloring, planning
Other features still lurking ,[object Object],[object Object],[object Object]
Case Study 3: Restart Policies Problem Instances Solver static features runtime Learning / Analysis Predictive Model dynamic features resource allocation / reformulation control / policy
Background ,[object Object],[object Object],[object Object],[object Object]
Cost Distributions ,[object Object],[object Object],[object Object],[object Object],Very short Very long
Randomized Restarts ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Effect of restarts on expected solution time (log scale)
How to determine restart policy ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Backtracking Problem Solvers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Formulation of Learning Problem ,[object Object],[object Object],[object Object],[object Object],Long Short Observation horizon Median run time 1000 choice points Observation horizon
Formulation of Learning Problem ,[object Object],[object Object],[object Object],[object Object],Observation horizon + Time expended Long Short Observation horizon Median run time 1000 choice points t 1 t 2 t 3
Formulation of Dynamic Features ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Dynamic Features
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Different formulations of task
Sample Results: CSP-QWH-Single ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
Learned Decision Tree ,[object Object],[object Object],[object Object],[object Object],[object Object]
Restart Policies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Ongoing work ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Conclusions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Contenu connexe

Similaire à Learning to Search Henry Kautz

Online Coreset Selection for Rehearsal-based Continual Learning
Online Coreset Selection for Rehearsal-based Continual LearningOnline Coreset Selection for Rehearsal-based Continual Learning
Online Coreset Selection for Rehearsal-based Continual LearningMLAI2
 
MetiTarski's menagerie of cooperating systems
MetiTarski's menagerie of cooperating systemsMetiTarski's menagerie of cooperating systems
MetiTarski's menagerie of cooperating systemsLawrence Paulson
 
Heuristic design of experiments w meta gradient search
Heuristic design of experiments w meta gradient searchHeuristic design of experiments w meta gradient search
Heuristic design of experiments w meta gradient searchGreg Makowski
 
Leveraging Feature Selection Within TreeNet
Leveraging Feature Selection Within TreeNetLeveraging Feature Selection Within TreeNet
Leveraging Feature Selection Within TreeNetagdavis
 
Power and sample size calculations for survival analysis webinar Slides
Power and sample size calculations for survival analysis webinar SlidesPower and sample size calculations for survival analysis webinar Slides
Power and sample size calculations for survival analysis webinar SlidesnQuery
 
Eswc2009
Eswc2009Eswc2009
Eswc2009fanizzi
 
A Hybrid Method of CART and Artificial Neural Network for Short Term Load For...
A Hybrid Method of CART and Artificial Neural Network for Short Term Load For...A Hybrid Method of CART and Artificial Neural Network for Short Term Load For...
A Hybrid Method of CART and Artificial Neural Network for Short Term Load For...Salford Systems
 
2007 Oral Preliminary Defense
2007 Oral Preliminary Defense2007 Oral Preliminary Defense
2007 Oral Preliminary DefenseJon Ernstberger
 
Group 9 genetic-algorithms (1)
Group 9 genetic-algorithms (1)Group 9 genetic-algorithms (1)
Group 9 genetic-algorithms (1)lakshmi.ec
 
K-Nearest Neighbor Classifier
K-Nearest Neighbor ClassifierK-Nearest Neighbor Classifier
K-Nearest Neighbor ClassifierNeha Kulkarni
 
Data Mining In Market Research
Data Mining In Market ResearchData Mining In Market Research
Data Mining In Market Researchjim
 
Data Mining in Market Research
Data Mining in Market ResearchData Mining in Market Research
Data Mining in Market Researchbutest
 
Data Mining In Market Research
Data Mining In Market ResearchData Mining In Market Research
Data Mining In Market Researchkevinlan
 
Machine Learning
Machine LearningMachine Learning
Machine Learningbutest
 
Ali Mousavi -- Event modeling
Ali Mousavi -- Event modeling Ali Mousavi -- Event modeling
Ali Mousavi -- Event modeling Anatoly Levenchuk
 
Evaluating Classification Algorithms Applied To Data Streams Esteban Donato
Evaluating Classification Algorithms Applied To Data Streams   Esteban DonatoEvaluating Classification Algorithms Applied To Data Streams   Esteban Donato
Evaluating Classification Algorithms Applied To Data Streams Esteban DonatoEsteban Donato
 
AI Data Summit 2019 Thompson Sampling - Thompson Sampling Tutorial “The redis...
AI Data Summit 2019 Thompson Sampling - Thompson Sampling Tutorial “The redis...AI Data Summit 2019 Thompson Sampling - Thompson Sampling Tutorial “The redis...
AI Data Summit 2019 Thompson Sampling - Thompson Sampling Tutorial “The redis...Hanan Shteingart
 

Similaire à Learning to Search Henry Kautz (20)

Online Coreset Selection for Rehearsal-based Continual Learning
Online Coreset Selection for Rehearsal-based Continual LearningOnline Coreset Selection for Rehearsal-based Continual Learning
Online Coreset Selection for Rehearsal-based Continual Learning
 
MetiTarski's menagerie of cooperating systems
MetiTarski's menagerie of cooperating systemsMetiTarski's menagerie of cooperating systems
MetiTarski's menagerie of cooperating systems
 
Heuristic design of experiments w meta gradient search
Heuristic design of experiments w meta gradient searchHeuristic design of experiments w meta gradient search
Heuristic design of experiments w meta gradient search
 
modeling.ppt
modeling.pptmodeling.ppt
modeling.ppt
 
Leveraging Feature Selection Within TreeNet
Leveraging Feature Selection Within TreeNetLeveraging Feature Selection Within TreeNet
Leveraging Feature Selection Within TreeNet
 
Power and sample size calculations for survival analysis webinar Slides
Power and sample size calculations for survival analysis webinar SlidesPower and sample size calculations for survival analysis webinar Slides
Power and sample size calculations for survival analysis webinar Slides
 
Eswc2009
Eswc2009Eswc2009
Eswc2009
 
CLIM: Transition Workshop - Activities and Progress in the “Parameter Optimiz...
CLIM: Transition Workshop - Activities and Progress in the “Parameter Optimiz...CLIM: Transition Workshop - Activities and Progress in the “Parameter Optimiz...
CLIM: Transition Workshop - Activities and Progress in the “Parameter Optimiz...
 
A Hybrid Method of CART and Artificial Neural Network for Short Term Load For...
A Hybrid Method of CART and Artificial Neural Network for Short Term Load For...A Hybrid Method of CART and Artificial Neural Network for Short Term Load For...
A Hybrid Method of CART and Artificial Neural Network for Short Term Load For...
 
2007 Oral Preliminary Defense
2007 Oral Preliminary Defense2007 Oral Preliminary Defense
2007 Oral Preliminary Defense
 
Group 9 genetic-algorithms (1)
Group 9 genetic-algorithms (1)Group 9 genetic-algorithms (1)
Group 9 genetic-algorithms (1)
 
K-Nearest Neighbor Classifier
K-Nearest Neighbor ClassifierK-Nearest Neighbor Classifier
K-Nearest Neighbor Classifier
 
Data Mining In Market Research
Data Mining In Market ResearchData Mining In Market Research
Data Mining In Market Research
 
Data Mining in Market Research
Data Mining in Market ResearchData Mining in Market Research
Data Mining in Market Research
 
Data Mining In Market Research
Data Mining In Market ResearchData Mining In Market Research
Data Mining In Market Research
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
 
Ali Mousavi -- Event modeling
Ali Mousavi -- Event modeling Ali Mousavi -- Event modeling
Ali Mousavi -- Event modeling
 
Exposé Ontology
Exposé OntologyExposé Ontology
Exposé Ontology
 
Evaluating Classification Algorithms Applied To Data Streams Esteban Donato
Evaluating Classification Algorithms Applied To Data Streams   Esteban DonatoEvaluating Classification Algorithms Applied To Data Streams   Esteban Donato
Evaluating Classification Algorithms Applied To Data Streams Esteban Donato
 
AI Data Summit 2019 Thompson Sampling - Thompson Sampling Tutorial “The redis...
AI Data Summit 2019 Thompson Sampling - Thompson Sampling Tutorial “The redis...AI Data Summit 2019 Thompson Sampling - Thompson Sampling Tutorial “The redis...
AI Data Summit 2019 Thompson Sampling - Thompson Sampling Tutorial “The redis...
 

Plus de butest

EL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBEEL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBEbutest
 
1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同butest
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALbutest
 
Timeline: The Life of Michael Jackson
Timeline: The Life of Michael JacksonTimeline: The Life of Michael Jackson
Timeline: The Life of Michael Jacksonbutest
 
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...butest
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALbutest
 
Com 380, Summer II
Com 380, Summer IICom 380, Summer II
Com 380, Summer IIbutest
 
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet JazzThe MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazzbutest
 
MICHAEL JACKSON.doc
MICHAEL JACKSON.docMICHAEL JACKSON.doc
MICHAEL JACKSON.docbutest
 
Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1butest
 
Facebook
Facebook Facebook
Facebook butest
 
Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...butest
 
Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...butest
 
NEWS ANNOUNCEMENT
NEWS ANNOUNCEMENTNEWS ANNOUNCEMENT
NEWS ANNOUNCEMENTbutest
 
C-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.docC-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.docbutest
 
MAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.docMAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.docbutest
 
Mac OS X Guide.doc
Mac OS X Guide.docMac OS X Guide.doc
Mac OS X Guide.docbutest
 
WEB DESIGN!
WEB DESIGN!WEB DESIGN!
WEB DESIGN!butest
 

Plus de butest (20)

EL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBEEL MODELO DE NEGOCIO DE YOUTUBE
EL MODELO DE NEGOCIO DE YOUTUBE
 
1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同1. MPEG I.B.P frame之不同
1. MPEG I.B.P frame之不同
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIAL
 
Timeline: The Life of Michael Jackson
Timeline: The Life of Michael JacksonTimeline: The Life of Michael Jackson
Timeline: The Life of Michael Jackson
 
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
Popular Reading Last Updated April 1, 2010 Adams, Lorraine The ...
 
LESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIALLESSONS FROM THE MICHAEL JACKSON TRIAL
LESSONS FROM THE MICHAEL JACKSON TRIAL
 
Com 380, Summer II
Com 380, Summer IICom 380, Summer II
Com 380, Summer II
 
PPT
PPTPPT
PPT
 
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet JazzThe MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
The MYnstrel Free Press Volume 2: Economic Struggles, Meet Jazz
 
MICHAEL JACKSON.doc
MICHAEL JACKSON.docMICHAEL JACKSON.doc
MICHAEL JACKSON.doc
 
Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1Social Networks: Twitter Facebook SL - Slide 1
Social Networks: Twitter Facebook SL - Slide 1
 
Facebook
Facebook Facebook
Facebook
 
Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...Executive Summary Hare Chevrolet is a General Motors dealership ...
Executive Summary Hare Chevrolet is a General Motors dealership ...
 
Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...Welcome to the Dougherty County Public Library's Facebook and ...
Welcome to the Dougherty County Public Library's Facebook and ...
 
NEWS ANNOUNCEMENT
NEWS ANNOUNCEMENTNEWS ANNOUNCEMENT
NEWS ANNOUNCEMENT
 
C-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.docC-2100 Ultra Zoom.doc
C-2100 Ultra Zoom.doc
 
MAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.docMAC Printing on ITS Printers.doc.doc
MAC Printing on ITS Printers.doc.doc
 
Mac OS X Guide.doc
Mac OS X Guide.docMac OS X Guide.doc
Mac OS X Guide.doc
 
hier
hierhier
hier
 
WEB DESIGN!
WEB DESIGN!WEB DESIGN!
WEB DESIGN!
 

Learning to Search Henry Kautz

Notes de l'éditeur

  1. Stochastic solver Sound, but not complete Governed by two key parameters “ Max Flips” “ Noise” Different variations of Walksat apply different heuristics in place of the red text This is the original variation sometimes called Walksat-SKC
  2. Per cent chance of Walksat finding a solution in 100000 flips
  3. Contribution: “ to turn the observation of the relationship of the invariant ratio into an effective procedure for estimating optimal noise level”
  4. 20 20 Incomplete nature of local search procedures: they can show consistency of a set of constraints and find a solution or model that satisfies those constraints but they cannot prove inconsistency, i.e., they cannot prove that a solution satisfying those constraints does not exist.
  5. 31
  6. Choice points are states in search procedures where the algorithm assigns value to variables where that assignment is not forced via propagation of previous set values, as occurs with unit propagation, backracking,, lookahad, or forward checking. These are points at which an assignment is chosen heuristically per the policies implemented in the problem solver.
  7. Choice points are states in search procedures where the algorithm assigns value to variables where that assignment is not forced via propagation of previous set values, as occurs with unit propagation, backtracking,, lookahead, or forward checking. These are points at which an assignment is chosen heuristically per the policies implemented in the problem solver.
  8. Even better restart policies should be achievable by considering a range of different statistical properties of the search space.