SlideShare une entreprise Scribd logo
1  sur  25
Mehrdad Shahabi, PhD
mshahabi@mix.wvu.edu
Why Reliability is important in Shortest Path Problems
Reliable Shortest Path Formulation
Outer Approximation Solution Algorithm
Computational Study
Conclusions and Other Applications
s t
35
45
STD DEV
MEAN TRAVEL COST
, 5
, 20
ORIGIN DESTINATION
Reliable and risk averse routing suggest taking
the path with least mean+std cost
TC=55
TC=50
C
A
s I
B
D
T
5,4
7,0
5,0
5,0
5,4 5,0
5,0
10,0
COST =20 + 32
BELLMAN PRINCIPLE OF OPTIMALITY DOES NOT HOLD
ORIGIN DESTINATION
MEAN TRAVEL COST
STD DEV
Directed Graph G=(V,E)
Origin Node r, Destination Node s
aij is the link between node i and node j
cov(aij, alk) is the covariance matrix
Given
Assumptions
Link Travel Cost Distribution is Available
One path with finite variance
𝒁 = 𝐌𝐢𝐧 𝒘 𝒄𝒊𝒋 𝒙𝒊𝒋
𝒓𝒔
+ (𝟏 − 𝒘) 𝝈𝒊𝒋
𝟐
𝒙𝒊𝒋
𝒓𝒔 𝟐
+ 𝒄𝒐𝒗 𝒂𝒊𝒋, 𝒂𝒍𝒌 𝒙𝒊𝒋
𝒓𝒔
𝒙𝒍𝒌
𝒓𝒔
𝒂 𝒍𝒌 ∈ 𝑬
𝒍,𝒌 ≠ 𝒊,𝒋
𝒂 𝒊𝒋 ∈ 𝑬𝒂 𝒊𝒋 ∈ 𝑬𝒔∈𝑺𝒂 𝒊𝒋 ∈ 𝑬
𝒔∈𝑺
𝒙𝒊𝒋
𝒓𝒔
− 𝒙𝒋𝒊
𝒓𝒔
=
𝟏 ∀ 𝒊 = 𝒓
𝟎 ∀ 𝒊 ≠ 𝒓, 𝒊 ≠ 𝒔
−𝟏 ∀ 𝒊 = 𝒔𝒋:𝒂 𝒋𝒊∈ 𝑬𝒋:𝒂 𝒊𝒋 ∈ 𝑬
𝒙𝒊𝒋
𝒓𝒔
∈ 𝟎, 𝟏 ∀𝒂𝒊𝒋 ∈ 𝑬, 𝒔 ∈ 𝑺
Mean Path Cost Standard Deviation of Path Cost
Given a transportation network, determine a path with minimum
mean plus standard deviation costs
Flow Balance
Constraint
𝒁 = 𝐌𝐢𝐧 𝒘 𝒄𝒊𝒋 𝒙𝒊𝒋
𝒓𝒔
+ (𝟏 − 𝒘) 𝒕
𝒓𝒔
𝒔∈𝑺𝒂 𝒊𝒋 ∈ 𝑬
𝒔∈𝑺
𝒙𝒊𝒋
𝒓𝒔
− 𝒙𝒋𝒊
𝒓𝒔
=
𝟏 ∀ 𝒊 = 𝒓
𝟎 ∀ 𝒊 ≠ 𝒓, 𝒊 ≠ 𝒔
−𝟏 ∀ 𝒊 = 𝒔𝒋:𝒂 𝒋𝒊∈ 𝑬𝒋:𝒂 𝒊𝒋 ∈ 𝑬
𝝈𝒊𝒋
𝟐
𝒙𝒊𝒋
𝒓𝒔 𝟐
+ 𝒄𝒐𝒗 𝒂𝒊𝒋, 𝒂𝒍𝒌 𝒙𝒊𝒋
𝒓𝒔
𝒙𝒍𝒌
𝒓𝒔
𝒂 𝒍𝒌 ∈ 𝑬
𝒍,𝒌 ≠ 𝒊,𝒋
𝒂 𝒊𝒋 ∈ 𝑬𝒂 𝒊𝒋 ∈ 𝑬
≤ 𝒕 𝒓𝒔
𝒙𝒊𝒋
𝒓𝒔
∈ 𝟎, 𝟏 , 𝒕 𝒓𝒔
≥ 𝟎 ∀𝒂𝒊𝒋 ∈ 𝑬, 𝒔 ∈ 𝑺
Mixed Integer Conic Quadratic Formulation
Cone
Constraint
𝝈𝒊𝒋
𝟐
𝒙𝒊𝒋
𝒓𝒔 𝟐
+ 𝒄𝒐𝒗 𝒂𝒊𝒋, 𝒂𝒍𝒌 𝒙𝒊𝒋
𝒓𝒔
𝒙𝒍𝒌
𝒓𝒔
𝒂 𝒍𝒌 ∈ 𝑬
𝒍,𝒌 ≠ 𝒊,𝒋
𝒂 𝒊𝒋 ∈ 𝑬𝒂 𝒊𝒋 ∈ 𝑬
≤ 𝒕 𝒓𝒔
Conic Formulation inefficient for Large Networks
Consider a network with 1000 links
1 million quadratic integer terms
 CQP computationally tractable due to their special Structure
 Can be solved by polynomial time interior point algorithms
 Solvers like CPLEX and MOSEK offering this capability
X2 + Y2 <= Z2
.
Minimize
Subject to
ii
T
iiii
dxcbxa 
i
T
i
xf
 Outer Approximation (OA)-Linearization and Decomposition
Method
 Delivers optimal solution for convex MINLP (Bonami et al.
2008)








ZyRx
yxg
yxf
yx
,
0),(toSubject
Minimize ),(
,
f and g are convex function
 Decompose integer and nonlinear part
 Solve alternating sequence of Master Problem
(MILP) & Subproblem (NLP)











Rx
yxg
y
y j
j
yx
j
xf
0),() toSubject
Minimize ),(
NLP(
,































ZRx
yy
xx
yxfyxf
yy
xx
yxgyxg
y
j
j
j
j
jjjj
jjjj
yx
,
),(),(
0),(),(toSubject
Minimize
,
MILP


Nonlinear Sub-
Problem (SP)
MILP Master
Problem (MP)
OA Steps
),( yx
SP Solution
Linear
Approximation
OA Cuts are stronger cuts compare to
other cuts such as Benders
Lemma 1.
Function is convex𝒁 𝒓𝒔
𝒙, 𝒕 = 𝒙𝒊𝒋
𝒓𝒔
𝒄𝒐𝒗(𝒂𝒊𝒋, 𝒂𝒍𝒌)
𝒍,𝒌 ∈ 𝑬
𝒙𝒍𝒌
𝒓𝒔
𝒊,𝒋 ∈ 𝑬
− 𝒕 𝒓𝒔
Implication
Outer Approximation Strategy guarantees globally
optimal solution
Given at iteration h, OA SP solutions are:
𝒕 𝒓𝒔 𝒉
= 𝒙𝒊𝒋
𝒓𝒔 𝒉
𝒄𝒐𝒗(𝒂𝒊𝒋, 𝒂𝒍𝒌)
𝒂𝒍𝒌 ∈ 𝑬
𝒙𝒍𝒌
𝒓𝒔 𝒉
𝒂𝒊𝒋∈ 𝑬
𝒁 𝒉
= 𝒘 𝒄𝒊𝒋 𝒙𝒊𝒋
𝒓𝒔 𝒉
+ (𝟏 − 𝒘) 𝒕 𝒓𝒔 𝒉
𝒔∈𝑺𝒂𝒊𝒋 ∈ 𝑬
𝒔∈𝑺
∀𝒔 ∈ 𝑺
∀𝒔 ∈ 𝑺
𝒙𝒊𝒋
𝒓𝒔 𝒉
The solution to the subproblem is obtained
analytically
No need to solve a NLP
Implication
Theorem1.
Given and at iteration h, the following cut can
linearly approximate the conic constraints:
𝒙𝒊𝒋
𝒓𝒔 𝒉
𝒕 𝒓𝒔 𝒉
𝝈𝒊𝒋
𝟐
𝒙𝒊𝒋
𝒓𝒔
(𝒙𝒊𝒋
𝒓𝒔
− 𝒙𝒊𝒋
𝒓𝒔 𝒉
)
𝒂 𝒊𝒋∈ 𝑬
+ 𝒄𝒐𝒗 𝒂𝒊𝒋, 𝒂𝒍𝒌 𝒙𝒊𝒋
𝒓𝒔 𝒉
(𝒙𝒊𝒋
𝒓𝒔
− 𝒙𝒊𝒋
𝒓𝒔 𝒉
)
𝒂 𝒍𝒌 ∈ 𝑬
𝒍,𝒌 ≠ 𝒊,𝒋
𝒂 𝒊𝒋∈ 𝑬
− 𝒕 𝒓𝒔 𝒉
𝒕 𝒓𝒔
− 𝒕 𝒓𝒔 𝒉
≤ 𝟎
Implication
Only those elements of the covariance matrix which
are constructing the shortest paths are included
OA-MP FORMULATION
𝒁 = 𝐌𝐢𝐧 𝒘 𝒄𝒊𝒋 𝒙𝒊𝒋
𝒓𝒔
+ (𝟏 − 𝒘) 𝒕
𝒓𝒔
𝒔∈𝑺𝒂 𝒊𝒋 ∈ 𝑬
𝒔∈𝑺
𝒙𝒊𝒋
𝒓𝒔
− 𝒙𝒋𝒊
𝒓𝒔
=
𝟏 ∀ 𝒊 = 𝒓
𝟎 ∀ 𝒊 ≠ 𝒓, 𝒊 ≠ 𝒔
−𝟏 ∀ 𝒊 = 𝒔𝒋:𝒂 𝒋𝒊∈ 𝑬𝒋:𝒂 𝒊𝒋 ∈ 𝑬
𝒙𝒊𝒋
𝒓𝒔
∈ 𝟎, 𝟏 , 𝒕 𝒓𝒔
≥ 𝟎 ∀𝒂𝒊𝒋 ∈ 𝑬, 𝒔 ∈ 𝑺
𝝈𝒊𝒋
𝟐
𝒙𝒊𝒋
𝒓𝒔
(𝒙𝒊𝒋
𝒓𝒔
− 𝒙𝒊𝒋
𝒓𝒔
)
𝒂 𝒊𝒋∈ 𝑬
+ 𝒄𝒐𝒗 𝒂𝒊𝒋, 𝒂𝒍𝒌 𝒙𝒍𝒌
𝒓𝒔
(𝒙𝒊𝒋
𝒓𝒔
− 𝒙𝒊𝒋
𝒓𝒔
)
𝒂 𝒍𝒌 ∈ 𝑬
𝒍,𝒌 ≠ 𝒊,𝒋
𝒂 𝒊𝒋∈ 𝑬
− 𝒕 𝒓𝒔
𝒕 𝒓𝒔
− 𝒕 𝒓𝒔
≤ 𝟎
∀𝒔 ∈ 𝑺,
𝒉 = 𝟏, . , 𝑯
Input: Convergence tolerance ε, Maximum Number of
Iteration H, Upperbound(UB)=+inf, Lowerbound (LB) =-
inf, h=1
Initialization: Solve One-all Shortest path problem
1: If (UB-LB) <=ε or then go to step 6
2: Solve the SP (Closed Form Equations)
3: If ( SP<UB), Update the UP and the best point
4: Add the OA inequalities and solve the MP
(No need to solve MP to optimality, Fletcher and Leyffer; 1994)
5: Update the LB, h=h+1, go to step 1
6:Report the Solutions and Algorithm Stops
Networks Number of Links(A) Number of Nodes (N)
SiouxFalls 76 24
Anaheim 914 416
Barcelona 2522 1020
Chicago Sketch 2250 933
Experiments Set up
OA-is coded in GAMS-C++/CPLEX
MILP MP is solved via CPLEX solver
MP is solved within 1% optimality gap
Covariance matrix is randomly generated
0
5
10
15
20
25
30
35
40
45
50
1 2 3
ConvergenceTolerance(%)
Number of Iterations
Sioux Falls Anaheim Chicago Sketch Barcelona
Maximum number of iterations is three for large
networks
0
20
40
60
80
100
120
140
160
180
0.5 0.6 0.8 1 1.5 2
RunningTime(Sec)
Master Problem Relative Optimality Gap(%)
Anaheim Sioux Falls Chicago Sketch Barcelona
Solution time is stable w.r.t. MP optimality gap
0
50
100
150
200
250
0 0.2 0.4 0.6 0.8 1
RunningTime(Sec)
Weight Associated with Mean Tavel Cost
Sioux Falls Anaheim Chicago Sketch Barcelona
Increase in weight on STD term increases the
solution time for larger networks
0.45 4.23
57.36
154.5
0.7 20.5
845.6
1235.6
0
200
400
600
800
1000
1200
1400
Sioux Falls Anaheim Chicago Sketch Barcelona
RunningTime(Sec)
Network
Outer Approximation MIQCP
OA outperforms the CPLEX solver
General Reliability Measures
[Shahabi, Unnikrishnan, and Boyles, 2014, 2015] show
application of OA to other forms of convex reliability metrics
Joint Inventory Location Problems
[Shahabi, Unnikrishnan, and Boyles, 2014] show that OA is
efficient in solving multi-echelon joint inventory location
problems with correlations in retailer demand
•A general efficient methodology for binary convex
mixed integer programs was presented
•Given the convexity assumption the method
guarantees the global optimality
•The sub-problem is analytically solved
•Minimizes the impact of large correlation matrices
and lead to savings in computational time
Linkedin_PowerPoint

Contenu connexe

Tendances

Spline interpolation numerical methods presentation
Spline interpolation numerical methods presentationSpline interpolation numerical methods presentation
Spline interpolation numerical methods presentationShohanur Nishad
 
Krylov Subspace Methods in Model Order Reduction
Krylov Subspace Methods in Model Order ReductionKrylov Subspace Methods in Model Order Reduction
Krylov Subspace Methods in Model Order ReductionMohammad Umar Rehman
 
5.3 dynamic programming 03
5.3 dynamic programming 035.3 dynamic programming 03
5.3 dynamic programming 03Krish_ver2
 
Application of parallel hierarchical matrices and low-rank tensors in spatial...
Application of parallel hierarchical matrices and low-rank tensors in spatial...Application of parallel hierarchical matrices and low-rank tensors in spatial...
Application of parallel hierarchical matrices and low-rank tensors in spatial...Alexander Litvinenko
 
Spline Interpolation
Spline InterpolationSpline Interpolation
Spline InterpolationaiQUANT
 
Lecture 8 dynamic programming
Lecture 8 dynamic programmingLecture 8 dynamic programming
Lecture 8 dynamic programmingOye Tu
 
Convex optmization in communications
Convex optmization in communicationsConvex optmization in communications
Convex optmization in communicationsDeepshika Reddy
 
multi threaded and distributed algorithms
multi threaded and distributed algorithms multi threaded and distributed algorithms
multi threaded and distributed algorithms Dr Shashikant Athawale
 
Lecture note4coordinatedescent
Lecture note4coordinatedescentLecture note4coordinatedescent
Lecture note4coordinatedescentXudong Sun
 
Dijkstra’s algorithm
Dijkstra’s algorithmDijkstra’s algorithm
Dijkstra’s algorithmfaisal2204
 
Lecture warshall floyd
Lecture warshall floydLecture warshall floyd
Lecture warshall floydDivya Ks
 
Signal Flow Graph
Signal Flow GraphSignal Flow Graph
Signal Flow GraphPreet_patel
 
Computing Information Flow Using Symbolic-Model-Checking_.pdf
Computing Information Flow Using Symbolic-Model-Checking_.pdfComputing Information Flow Using Symbolic-Model-Checking_.pdf
Computing Information Flow Using Symbolic-Model-Checking_.pdfPolytechnique Montréal
 

Tendances (20)

Cmb part3
Cmb part3Cmb part3
Cmb part3
 
DP
DPDP
DP
 
Absorbing Random Walk Centrality
Absorbing Random Walk CentralityAbsorbing Random Walk Centrality
Absorbing Random Walk Centrality
 
report
reportreport
report
 
Spline interpolation numerical methods presentation
Spline interpolation numerical methods presentationSpline interpolation numerical methods presentation
Spline interpolation numerical methods presentation
 
Krylov Subspace Methods in Model Order Reduction
Krylov Subspace Methods in Model Order ReductionKrylov Subspace Methods in Model Order Reduction
Krylov Subspace Methods in Model Order Reduction
 
OT
OTOT
OT
 
5.3 dynamic programming 03
5.3 dynamic programming 035.3 dynamic programming 03
5.3 dynamic programming 03
 
Application of parallel hierarchical matrices and low-rank tensors in spatial...
Application of parallel hierarchical matrices and low-rank tensors in spatial...Application of parallel hierarchical matrices and low-rank tensors in spatial...
Application of parallel hierarchical matrices and low-rank tensors in spatial...
 
Spline Interpolation
Spline InterpolationSpline Interpolation
Spline Interpolation
 
Tsp branch and bound
Tsp branch and boundTsp branch and bound
Tsp branch and bound
 
Lecture 8 dynamic programming
Lecture 8 dynamic programmingLecture 8 dynamic programming
Lecture 8 dynamic programming
 
Convex optmization in communications
Convex optmization in communicationsConvex optmization in communications
Convex optmization in communications
 
Time andspacecomplexity
Time andspacecomplexityTime andspacecomplexity
Time andspacecomplexity
 
multi threaded and distributed algorithms
multi threaded and distributed algorithms multi threaded and distributed algorithms
multi threaded and distributed algorithms
 
Lecture note4coordinatedescent
Lecture note4coordinatedescentLecture note4coordinatedescent
Lecture note4coordinatedescent
 
Dijkstra’s algorithm
Dijkstra’s algorithmDijkstra’s algorithm
Dijkstra’s algorithm
 
Lecture warshall floyd
Lecture warshall floydLecture warshall floyd
Lecture warshall floyd
 
Signal Flow Graph
Signal Flow GraphSignal Flow Graph
Signal Flow Graph
 
Computing Information Flow Using Symbolic-Model-Checking_.pdf
Computing Information Flow Using Symbolic-Model-Checking_.pdfComputing Information Flow Using Symbolic-Model-Checking_.pdf
Computing Information Flow Using Symbolic-Model-Checking_.pdf
 

Similaire à Linkedin_PowerPoint

Cycle’s topological optimizations and the iterative decoding problem on gener...
Cycle’s topological optimizations and the iterative decoding problem on gener...Cycle’s topological optimizations and the iterative decoding problem on gener...
Cycle’s topological optimizations and the iterative decoding problem on gener...Usatyuk Vasiliy
 
Efficient Solution of Two-Stage Stochastic Linear Programs Using Interior Poi...
Efficient Solution of Two-Stage Stochastic Linear Programs Using Interior Poi...Efficient Solution of Two-Stage Stochastic Linear Programs Using Interior Poi...
Efficient Solution of Two-Stage Stochastic Linear Programs Using Interior Poi...SSA KPI
 
MVPA with SpaceNet: sparse structured priors
MVPA with SpaceNet: sparse structured priorsMVPA with SpaceNet: sparse structured priors
MVPA with SpaceNet: sparse structured priorsElvis DOHMATOB
 
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHM
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHMADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHM
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHMWireilla
 
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHM
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHMADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHM
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHMijfls
 
Branch and bound technique
Branch and bound techniqueBranch and bound technique
Branch and bound techniqueishmecse13
 
Bag of Pursuits and Neural Gas for Improved Sparse Codin
Bag of Pursuits and Neural Gas for Improved Sparse CodinBag of Pursuits and Neural Gas for Improved Sparse Codin
Bag of Pursuits and Neural Gas for Improved Sparse CodinKarlos Svoboda
 
Gaps between the theory and practice of large-scale matrix-based network comp...
Gaps between the theory and practice of large-scale matrix-based network comp...Gaps between the theory and practice of large-scale matrix-based network comp...
Gaps between the theory and practice of large-scale matrix-based network comp...David Gleich
 
Numerical Solution of Linear algebraic Equation
Numerical Solution of Linear algebraic EquationNumerical Solution of Linear algebraic Equation
Numerical Solution of Linear algebraic Equationpayalpriyadarshinisa1
 
Paper study: Learning to solve circuit sat
Paper study: Learning to solve circuit satPaper study: Learning to solve circuit sat
Paper study: Learning to solve circuit satChenYiHuang5
 
Cycle’s topological optimizations and the iterative decoding problem on gener...
Cycle’s topological optimizations and the iterative decoding problem on gener...Cycle’s topological optimizations and the iterative decoding problem on gener...
Cycle’s topological optimizations and the iterative decoding problem on gener...Usatyuk Vasiliy
 
Sampling-Based Planning Algorithms for Multi-Objective Missions
Sampling-Based Planning Algorithms for Multi-Objective MissionsSampling-Based Planning Algorithms for Multi-Objective Missions
Sampling-Based Planning Algorithms for Multi-Objective MissionsMd Mahbubur Rahman
 
Episode 50 : Simulation Problem Solution Approaches Convergence Techniques S...
Episode 50 :  Simulation Problem Solution Approaches Convergence Techniques S...Episode 50 :  Simulation Problem Solution Approaches Convergence Techniques S...
Episode 50 : Simulation Problem Solution Approaches Convergence Techniques S...SAJJAD KHUDHUR ABBAS
 
lecture01_lecture01_lecture0001_ceva.pdf
lecture01_lecture01_lecture0001_ceva.pdflecture01_lecture01_lecture0001_ceva.pdf
lecture01_lecture01_lecture0001_ceva.pdfAnaNeacsu5
 
Design and Implementation of Parallel and Randomized Approximation Algorithms
Design and Implementation of Parallel and Randomized Approximation AlgorithmsDesign and Implementation of Parallel and Randomized Approximation Algorithms
Design and Implementation of Parallel and Randomized Approximation AlgorithmsAjay Bidyarthy
 
Modeling and quantification of uncertainties in numerical aerodynamics
Modeling and quantification of uncertainties in numerical aerodynamicsModeling and quantification of uncertainties in numerical aerodynamics
Modeling and quantification of uncertainties in numerical aerodynamicsAlexander Litvinenko
 
MSc Thesis Presentation
MSc Thesis PresentationMSc Thesis Presentation
MSc Thesis PresentationReem Sherif
 
Exact network reconstruction from consensus signals and one eigen value
Exact network reconstruction from consensus signals and one eigen valueExact network reconstruction from consensus signals and one eigen value
Exact network reconstruction from consensus signals and one eigen valueIJCNCJournal
 
Subproblem-Tree Calibration: A Unified Approach to Max-Product Message Passin...
Subproblem-Tree Calibration: A Unified Approach to Max-Product Message Passin...Subproblem-Tree Calibration: A Unified Approach to Max-Product Message Passin...
Subproblem-Tree Calibration: A Unified Approach to Max-Product Message Passin...Varad Meru
 

Similaire à Linkedin_PowerPoint (20)

Cycle’s topological optimizations and the iterative decoding problem on gener...
Cycle’s topological optimizations and the iterative decoding problem on gener...Cycle’s topological optimizations and the iterative decoding problem on gener...
Cycle’s topological optimizations and the iterative decoding problem on gener...
 
Efficient Solution of Two-Stage Stochastic Linear Programs Using Interior Poi...
Efficient Solution of Two-Stage Stochastic Linear Programs Using Interior Poi...Efficient Solution of Two-Stage Stochastic Linear Programs Using Interior Poi...
Efficient Solution of Two-Stage Stochastic Linear Programs Using Interior Poi...
 
MVPA with SpaceNet: sparse structured priors
MVPA with SpaceNet: sparse structured priorsMVPA with SpaceNet: sparse structured priors
MVPA with SpaceNet: sparse structured priors
 
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHM
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHMADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHM
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHM
 
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHM
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHMADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHM
ADAPTIVE FUZZY KERNEL CLUSTERING ALGORITHM
 
Branch and bound technique
Branch and bound techniqueBranch and bound technique
Branch and bound technique
 
Bag of Pursuits and Neural Gas for Improved Sparse Codin
Bag of Pursuits and Neural Gas for Improved Sparse CodinBag of Pursuits and Neural Gas for Improved Sparse Codin
Bag of Pursuits and Neural Gas for Improved Sparse Codin
 
Gaps between the theory and practice of large-scale matrix-based network comp...
Gaps between the theory and practice of large-scale matrix-based network comp...Gaps between the theory and practice of large-scale matrix-based network comp...
Gaps between the theory and practice of large-scale matrix-based network comp...
 
Numerical Solution of Linear algebraic Equation
Numerical Solution of Linear algebraic EquationNumerical Solution of Linear algebraic Equation
Numerical Solution of Linear algebraic Equation
 
Paper study: Learning to solve circuit sat
Paper study: Learning to solve circuit satPaper study: Learning to solve circuit sat
Paper study: Learning to solve circuit sat
 
Cycle’s topological optimizations and the iterative decoding problem on gener...
Cycle’s topological optimizations and the iterative decoding problem on gener...Cycle’s topological optimizations and the iterative decoding problem on gener...
Cycle’s topological optimizations and the iterative decoding problem on gener...
 
G04123844
G04123844G04123844
G04123844
 
Sampling-Based Planning Algorithms for Multi-Objective Missions
Sampling-Based Planning Algorithms for Multi-Objective MissionsSampling-Based Planning Algorithms for Multi-Objective Missions
Sampling-Based Planning Algorithms for Multi-Objective Missions
 
Episode 50 : Simulation Problem Solution Approaches Convergence Techniques S...
Episode 50 :  Simulation Problem Solution Approaches Convergence Techniques S...Episode 50 :  Simulation Problem Solution Approaches Convergence Techniques S...
Episode 50 : Simulation Problem Solution Approaches Convergence Techniques S...
 
lecture01_lecture01_lecture0001_ceva.pdf
lecture01_lecture01_lecture0001_ceva.pdflecture01_lecture01_lecture0001_ceva.pdf
lecture01_lecture01_lecture0001_ceva.pdf
 
Design and Implementation of Parallel and Randomized Approximation Algorithms
Design and Implementation of Parallel and Randomized Approximation AlgorithmsDesign and Implementation of Parallel and Randomized Approximation Algorithms
Design and Implementation of Parallel and Randomized Approximation Algorithms
 
Modeling and quantification of uncertainties in numerical aerodynamics
Modeling and quantification of uncertainties in numerical aerodynamicsModeling and quantification of uncertainties in numerical aerodynamics
Modeling and quantification of uncertainties in numerical aerodynamics
 
MSc Thesis Presentation
MSc Thesis PresentationMSc Thesis Presentation
MSc Thesis Presentation
 
Exact network reconstruction from consensus signals and one eigen value
Exact network reconstruction from consensus signals and one eigen valueExact network reconstruction from consensus signals and one eigen value
Exact network reconstruction from consensus signals and one eigen value
 
Subproblem-Tree Calibration: A Unified Approach to Max-Product Message Passin...
Subproblem-Tree Calibration: A Unified Approach to Max-Product Message Passin...Subproblem-Tree Calibration: A Unified Approach to Max-Product Message Passin...
Subproblem-Tree Calibration: A Unified Approach to Max-Product Message Passin...
 

Linkedin_PowerPoint

  • 2. Why Reliability is important in Shortest Path Problems Reliable Shortest Path Formulation Outer Approximation Solution Algorithm Computational Study Conclusions and Other Applications
  • 3. s t 35 45 STD DEV MEAN TRAVEL COST , 5 , 20 ORIGIN DESTINATION Reliable and risk averse routing suggest taking the path with least mean+std cost TC=55 TC=50
  • 4. C A s I B D T 5,4 7,0 5,0 5,0 5,4 5,0 5,0 10,0 COST =20 + 32 BELLMAN PRINCIPLE OF OPTIMALITY DOES NOT HOLD ORIGIN DESTINATION MEAN TRAVEL COST STD DEV
  • 5. Directed Graph G=(V,E) Origin Node r, Destination Node s aij is the link between node i and node j cov(aij, alk) is the covariance matrix Given Assumptions Link Travel Cost Distribution is Available One path with finite variance
  • 6. 𝒁 = 𝐌𝐢𝐧 𝒘 𝒄𝒊𝒋 𝒙𝒊𝒋 𝒓𝒔 + (𝟏 − 𝒘) 𝝈𝒊𝒋 𝟐 𝒙𝒊𝒋 𝒓𝒔 𝟐 + 𝒄𝒐𝒗 𝒂𝒊𝒋, 𝒂𝒍𝒌 𝒙𝒊𝒋 𝒓𝒔 𝒙𝒍𝒌 𝒓𝒔 𝒂 𝒍𝒌 ∈ 𝑬 𝒍,𝒌 ≠ 𝒊,𝒋 𝒂 𝒊𝒋 ∈ 𝑬𝒂 𝒊𝒋 ∈ 𝑬𝒔∈𝑺𝒂 𝒊𝒋 ∈ 𝑬 𝒔∈𝑺 𝒙𝒊𝒋 𝒓𝒔 − 𝒙𝒋𝒊 𝒓𝒔 = 𝟏 ∀ 𝒊 = 𝒓 𝟎 ∀ 𝒊 ≠ 𝒓, 𝒊 ≠ 𝒔 −𝟏 ∀ 𝒊 = 𝒔𝒋:𝒂 𝒋𝒊∈ 𝑬𝒋:𝒂 𝒊𝒋 ∈ 𝑬 𝒙𝒊𝒋 𝒓𝒔 ∈ 𝟎, 𝟏 ∀𝒂𝒊𝒋 ∈ 𝑬, 𝒔 ∈ 𝑺 Mean Path Cost Standard Deviation of Path Cost Given a transportation network, determine a path with minimum mean plus standard deviation costs Flow Balance Constraint
  • 7. 𝒁 = 𝐌𝐢𝐧 𝒘 𝒄𝒊𝒋 𝒙𝒊𝒋 𝒓𝒔 + (𝟏 − 𝒘) 𝒕 𝒓𝒔 𝒔∈𝑺𝒂 𝒊𝒋 ∈ 𝑬 𝒔∈𝑺 𝒙𝒊𝒋 𝒓𝒔 − 𝒙𝒋𝒊 𝒓𝒔 = 𝟏 ∀ 𝒊 = 𝒓 𝟎 ∀ 𝒊 ≠ 𝒓, 𝒊 ≠ 𝒔 −𝟏 ∀ 𝒊 = 𝒔𝒋:𝒂 𝒋𝒊∈ 𝑬𝒋:𝒂 𝒊𝒋 ∈ 𝑬 𝝈𝒊𝒋 𝟐 𝒙𝒊𝒋 𝒓𝒔 𝟐 + 𝒄𝒐𝒗 𝒂𝒊𝒋, 𝒂𝒍𝒌 𝒙𝒊𝒋 𝒓𝒔 𝒙𝒍𝒌 𝒓𝒔 𝒂 𝒍𝒌 ∈ 𝑬 𝒍,𝒌 ≠ 𝒊,𝒋 𝒂 𝒊𝒋 ∈ 𝑬𝒂 𝒊𝒋 ∈ 𝑬 ≤ 𝒕 𝒓𝒔 𝒙𝒊𝒋 𝒓𝒔 ∈ 𝟎, 𝟏 , 𝒕 𝒓𝒔 ≥ 𝟎 ∀𝒂𝒊𝒋 ∈ 𝑬, 𝒔 ∈ 𝑺 Mixed Integer Conic Quadratic Formulation Cone Constraint
  • 8. 𝝈𝒊𝒋 𝟐 𝒙𝒊𝒋 𝒓𝒔 𝟐 + 𝒄𝒐𝒗 𝒂𝒊𝒋, 𝒂𝒍𝒌 𝒙𝒊𝒋 𝒓𝒔 𝒙𝒍𝒌 𝒓𝒔 𝒂 𝒍𝒌 ∈ 𝑬 𝒍,𝒌 ≠ 𝒊,𝒋 𝒂 𝒊𝒋 ∈ 𝑬𝒂 𝒊𝒋 ∈ 𝑬 ≤ 𝒕 𝒓𝒔 Conic Formulation inefficient for Large Networks Consider a network with 1000 links 1 million quadratic integer terms
  • 9.  CQP computationally tractable due to their special Structure  Can be solved by polynomial time interior point algorithms  Solvers like CPLEX and MOSEK offering this capability X2 + Y2 <= Z2 . Minimize Subject to ii T iiii dxcbxa  i T i xf
  • 10.  Outer Approximation (OA)-Linearization and Decomposition Method  Delivers optimal solution for convex MINLP (Bonami et al. 2008)         ZyRx yxg yxf yx , 0),(toSubject Minimize ),( , f and g are convex function  Decompose integer and nonlinear part  Solve alternating sequence of Master Problem (MILP) & Subproblem (NLP)
  • 11.            Rx yxg y y j j yx j xf 0),() toSubject Minimize ),( NLP( ,                                ZRx yy xx yxfyxf yy xx yxgyxg y j j j j jjjj jjjj yx , ),(),( 0),(),(toSubject Minimize , MILP   Nonlinear Sub- Problem (SP) MILP Master Problem (MP) OA Steps
  • 12. ),( yx SP Solution Linear Approximation OA Cuts are stronger cuts compare to other cuts such as Benders
  • 13. Lemma 1. Function is convex𝒁 𝒓𝒔 𝒙, 𝒕 = 𝒙𝒊𝒋 𝒓𝒔 𝒄𝒐𝒗(𝒂𝒊𝒋, 𝒂𝒍𝒌) 𝒍,𝒌 ∈ 𝑬 𝒙𝒍𝒌 𝒓𝒔 𝒊,𝒋 ∈ 𝑬 − 𝒕 𝒓𝒔 Implication Outer Approximation Strategy guarantees globally optimal solution
  • 14. Given at iteration h, OA SP solutions are: 𝒕 𝒓𝒔 𝒉 = 𝒙𝒊𝒋 𝒓𝒔 𝒉 𝒄𝒐𝒗(𝒂𝒊𝒋, 𝒂𝒍𝒌) 𝒂𝒍𝒌 ∈ 𝑬 𝒙𝒍𝒌 𝒓𝒔 𝒉 𝒂𝒊𝒋∈ 𝑬 𝒁 𝒉 = 𝒘 𝒄𝒊𝒋 𝒙𝒊𝒋 𝒓𝒔 𝒉 + (𝟏 − 𝒘) 𝒕 𝒓𝒔 𝒉 𝒔∈𝑺𝒂𝒊𝒋 ∈ 𝑬 𝒔∈𝑺 ∀𝒔 ∈ 𝑺 ∀𝒔 ∈ 𝑺 𝒙𝒊𝒋 𝒓𝒔 𝒉 The solution to the subproblem is obtained analytically No need to solve a NLP Implication
  • 15. Theorem1. Given and at iteration h, the following cut can linearly approximate the conic constraints: 𝒙𝒊𝒋 𝒓𝒔 𝒉 𝒕 𝒓𝒔 𝒉 𝝈𝒊𝒋 𝟐 𝒙𝒊𝒋 𝒓𝒔 (𝒙𝒊𝒋 𝒓𝒔 − 𝒙𝒊𝒋 𝒓𝒔 𝒉 ) 𝒂 𝒊𝒋∈ 𝑬 + 𝒄𝒐𝒗 𝒂𝒊𝒋, 𝒂𝒍𝒌 𝒙𝒊𝒋 𝒓𝒔 𝒉 (𝒙𝒊𝒋 𝒓𝒔 − 𝒙𝒊𝒋 𝒓𝒔 𝒉 ) 𝒂 𝒍𝒌 ∈ 𝑬 𝒍,𝒌 ≠ 𝒊,𝒋 𝒂 𝒊𝒋∈ 𝑬 − 𝒕 𝒓𝒔 𝒉 𝒕 𝒓𝒔 − 𝒕 𝒓𝒔 𝒉 ≤ 𝟎 Implication Only those elements of the covariance matrix which are constructing the shortest paths are included
  • 16. OA-MP FORMULATION 𝒁 = 𝐌𝐢𝐧 𝒘 𝒄𝒊𝒋 𝒙𝒊𝒋 𝒓𝒔 + (𝟏 − 𝒘) 𝒕 𝒓𝒔 𝒔∈𝑺𝒂 𝒊𝒋 ∈ 𝑬 𝒔∈𝑺 𝒙𝒊𝒋 𝒓𝒔 − 𝒙𝒋𝒊 𝒓𝒔 = 𝟏 ∀ 𝒊 = 𝒓 𝟎 ∀ 𝒊 ≠ 𝒓, 𝒊 ≠ 𝒔 −𝟏 ∀ 𝒊 = 𝒔𝒋:𝒂 𝒋𝒊∈ 𝑬𝒋:𝒂 𝒊𝒋 ∈ 𝑬 𝒙𝒊𝒋 𝒓𝒔 ∈ 𝟎, 𝟏 , 𝒕 𝒓𝒔 ≥ 𝟎 ∀𝒂𝒊𝒋 ∈ 𝑬, 𝒔 ∈ 𝑺 𝝈𝒊𝒋 𝟐 𝒙𝒊𝒋 𝒓𝒔 (𝒙𝒊𝒋 𝒓𝒔 − 𝒙𝒊𝒋 𝒓𝒔 ) 𝒂 𝒊𝒋∈ 𝑬 + 𝒄𝒐𝒗 𝒂𝒊𝒋, 𝒂𝒍𝒌 𝒙𝒍𝒌 𝒓𝒔 (𝒙𝒊𝒋 𝒓𝒔 − 𝒙𝒊𝒋 𝒓𝒔 ) 𝒂 𝒍𝒌 ∈ 𝑬 𝒍,𝒌 ≠ 𝒊,𝒋 𝒂 𝒊𝒋∈ 𝑬 − 𝒕 𝒓𝒔 𝒕 𝒓𝒔 − 𝒕 𝒓𝒔 ≤ 𝟎 ∀𝒔 ∈ 𝑺, 𝒉 = 𝟏, . , 𝑯
  • 17. Input: Convergence tolerance ε, Maximum Number of Iteration H, Upperbound(UB)=+inf, Lowerbound (LB) =- inf, h=1 Initialization: Solve One-all Shortest path problem 1: If (UB-LB) <=ε or then go to step 6 2: Solve the SP (Closed Form Equations) 3: If ( SP<UB), Update the UP and the best point 4: Add the OA inequalities and solve the MP (No need to solve MP to optimality, Fletcher and Leyffer; 1994) 5: Update the LB, h=h+1, go to step 1 6:Report the Solutions and Algorithm Stops
  • 18. Networks Number of Links(A) Number of Nodes (N) SiouxFalls 76 24 Anaheim 914 416 Barcelona 2522 1020 Chicago Sketch 2250 933 Experiments Set up OA-is coded in GAMS-C++/CPLEX MILP MP is solved via CPLEX solver MP is solved within 1% optimality gap Covariance matrix is randomly generated
  • 19. 0 5 10 15 20 25 30 35 40 45 50 1 2 3 ConvergenceTolerance(%) Number of Iterations Sioux Falls Anaheim Chicago Sketch Barcelona Maximum number of iterations is three for large networks
  • 20. 0 20 40 60 80 100 120 140 160 180 0.5 0.6 0.8 1 1.5 2 RunningTime(Sec) Master Problem Relative Optimality Gap(%) Anaheim Sioux Falls Chicago Sketch Barcelona Solution time is stable w.r.t. MP optimality gap
  • 21. 0 50 100 150 200 250 0 0.2 0.4 0.6 0.8 1 RunningTime(Sec) Weight Associated with Mean Tavel Cost Sioux Falls Anaheim Chicago Sketch Barcelona Increase in weight on STD term increases the solution time for larger networks
  • 22. 0.45 4.23 57.36 154.5 0.7 20.5 845.6 1235.6 0 200 400 600 800 1000 1200 1400 Sioux Falls Anaheim Chicago Sketch Barcelona RunningTime(Sec) Network Outer Approximation MIQCP OA outperforms the CPLEX solver
  • 23. General Reliability Measures [Shahabi, Unnikrishnan, and Boyles, 2014, 2015] show application of OA to other forms of convex reliability metrics Joint Inventory Location Problems [Shahabi, Unnikrishnan, and Boyles, 2014] show that OA is efficient in solving multi-echelon joint inventory location problems with correlations in retailer demand
  • 24. •A general efficient methodology for binary convex mixed integer programs was presented •Given the convexity assumption the method guarantees the global optimality •The sub-problem is analytically solved •Minimizes the impact of large correlation matrices and lead to savings in computational time

Notes de l'éditeur

  1. There are different ways to characterize reliability and risk taking behavior…One such metric is mean-std dev..this ppt is mainly going to focus on mean+std dev shortest path..
  2. CQP computationally tractable due to their special Structure Can be solved by polynomial time interior point algorithms Solvers like CPLEX and MOSEK offering this capability
  3. Nonlinear terms increase by number of O-D pairs
  4. Separates out the nonlinear and integer part…