The presentation shows a set of FME workbenches designed to improve (and make accessible) the display of relevant information to pipeline professionals. Dynamic Segmentation is more than displaying events on routes. It is the overlay, resolving, and mathematical processing of data stored in a complex and deep data models. FME has been instrumental in pulling the relevant data out of these databases and putting meaningful data into the hands of those who need and use it. Although this presentation focuses on pipelines it is highly relevant to any industry utilizing long thin transportation corridors such as roads, water and electric networks.
FME and Linear Referencing - Keeping the Product in the Pipelines
1. FME
and
Linear
Referencing
-‐
Keeping
the
Product
in
the
Pipelines
FME
World
Tour
2015
Peter
Veenstra
Willbros
Engineering
2. IntroducCon
&
Outline
• Peter
Veenstra
– Principal
GIS
Technologist
– Willbros
Engineering
• Outline
– Oil
and
Gas
Transmission
Pipelines
– Concepts
of
Linear
Referencing
– How
we
do
it
now
– Linear
Referencing
with
FME
– Lessons
Learned
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
Founded
in
1908
3. Oil
and
Gas
Transmission
Pipelines
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
4. Oil
and
Gas
Transmission
Pipelines
• Typical
pipelines
…
– Run
for
100’s
if
not
1000’s
of
miles
– Cross
mulCple
jurisdicCons
– MulCple
threats…
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
5. Oil
and
Gas
Transmission
Pipelines
• Huge
consequences
if
failure
occurs
…
– Loss
of
human
life
– Environmental
devastaCon
– Tarnished
corporate
reputaCon
– Revenue
and
profit
loss
– Stringent
regulaCons
– Regulatory
fines
– Increased
administraCon
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
6. Oil
and
Gas
Transmission
Pipelines
• Very
complex
‘standard’
data
models
…
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
7. Concepts
of
Linear
Referencing
• Routes
(MZ-‐Aware
Polylines
with
Unique
ID)
• Events
(Relate
to
Route,
Measured
PosiCon)
• PosiCon
is
determined
by
Measure
of
the
event
(for
point)
or
Begin/
End
Measure
(for
line)
• Many,
many,
many
tables
of
events
stacked
on
top
of
each
other
(BGM)
• Primarily
ESRI
(ArcGIS
Desktop)
soluCon
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
8. LR:
How
we
do
it
now
…
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
• A
table
can
store
a
Route
ID
and
Begin/End
Measure
value
for
linear
features.
These
features
can
be
symbolized
on
a
map.
• Another
table
can
store
a
Route
ID
and
a
Measure
value
for
point
features.
These
features
can
be
symbolized
on
a
map.
• Tabular
data
can
be
filtered,
ordered,
sorted
using
SQL
9. LR:
How
we
do
it
now
…
• ArcMap
DemonstraCon
• LimitaCons
of
the
soluCon
– Performance
– Events
as
Features
– Non-‐support
in
Web
for
Events
– Roads
&
Highways
and
new
ALRP
…
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
10. Linear
Referencing
with
FME
• Work
in
progress
–
exploraCon
…
• Two
Workbenches
– Events
to
Features
– Dynamic
SegmentaCon
• Linear
Referencing
Tools
• What
is
missing
(or
what
don’t
I
know
…)
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
11. FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
Events
to
Features
12. FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
Events
to
Features
13. FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
• Take
a
pipeline
route
with
an
ID=”12PL-‐A”
With
linear
referencing
using
tables
from
the
data
model
–
mulCple
layers
of
linear
and
point
events
can
be
added
to
the
map.
• Pipe
Segments
with
Wall
Thickness,
Outside
Diameter,
Grade,
Install
Date,
Seam
Type,
Manufacturer,
Join
Type
aiributes
• Primary
coaCng
with
install
date,
type
and
thickness
(Fusion
Bonded
Epoxy,
15mils)
• Secondary
coaCng
with
install
date,
type
and
thickness
(Concrete,
3")
• IsolaCon
Valves
• Flow
Rates,
OperaCng
Temperature,
OperaCng
Pressure
• Above
Water,
Below
Water
• ILI
Run
(Test
Date,
Tool
Type)
• Hydro
Test
(Test
Date,
Test
Pressure,
DuraCon)
• Design
Factor
• Visual
InspecCon
(Test
Date)
• CP
Reading
• Pipe
SecCons
(1-‐Topsides,
2-‐Export
Riser,
3-‐Export
Spoolpiece,
4-‐Seabed,
5-‐Import
Spoolpiece,
6-‐Import
Riser,
7-‐
Import
Topsides)
• Environmental
(Faults,
Seismic,
Slope
Stability)
Good
!
Bad
• Incident
History
(OperaCons,
Incidents)
Good
!
Bad
• Anomalies
(Dents,
Internal/External
Corrosion)
• Anomaly
Points
turned
to
Linear
Ranges
(Based
on
number
of
points
per
specified
length)
Dynamic
SegmentaCon
14. FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
Dynamic
SegmentaCon
15. FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
Dynamic
SegmentaCon
16. Linear
Referencing
with
FME
• Linear
Referencing
Tools
– LengthToPointCalculator
• Calculates
a
length
of
a
feature
to
a
point
on
that
feature
–
either
2D
or
3D
–
(calculated
not
assigned)
– MeasureExtractor
• Extracts
measure
from
geometries
and
puts
them
in
aiributes
(M
have
to
be
there,
not
all
tools
output
M)
– MeasureGenerator
• Calculates
measure
for
each
vertex
from
the
start
of
the
line
(based
on
distance
not
assigned
measure)
– MeasureRemover
• Removes
measures
from
a
feature’s
geometry
– MeasureSeier
• Sets
the
measure
to
points
(based
on
airibute)
or
to
vertexes
in
polyline
(from
airibute).
If
geometry
is
not
the
same
then
nothing
happens
– Snipper
• Creates
linear
features
based
on
a
distance
from
a
specified
point
(with
a
measure
value)
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
17. Linear
Referencing
with
FME
• Transformers
most
used…
– FeatureMergerSnipper
– TestFilter
– AiributeRenamer
– AiributeFilter
– LineOnLineOverlayer
– Sorter
– AiributeCreator
– AiributeRounder
– Tester
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
18. What
works!
• Feature
based
results
• Beier
error
checking
and
diagnosCcs
– Runs
with
errors,
indicates
errors
in
‘red’
– Log
file,
SQLite
DB
• More
formats
(both
in
and
out)
• Works
beier
with
web/cloud
integraCon
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
19. What
doesn’t!
• Tools
are
not
inherently
M-‐Aware
• Measures
need
to
be
preserved
• Locate
Events
along
Routes
– By
XY
posiCon
and
proximity
• Re-‐order
output
fields
• SHIFT/CTRL
scroll
in
Workbench
(not
ALT!)
• Diagnose
or
idenCfy
which
transformer
introduced
what
field
• Right
click
reader/writer
in
TOC
to
add
‘features
types’
• DocumentaCon
(show
some
pictures
…)
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
20. Future
Plans
• Data
loader
and
Route
Builder
• Gap/Overlap
QA/QC
• Overlap
Resolver
– SUM,
Min/Max,
Latest
• Self
DynSeg
• RISK
– Likelihood
x
Consequence
• Output
– KML,
JSON
!
D3.js
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
21. The
Moral
of
the
Story
(Redux)
“I am always learning that which I cannot do, in
order that I may learn how to do it.”
~Pablo Picasso
FME
World
Tour
2015
–
St.
Louis,
MO
–
04/15/2015
• Woulda,
coulda,
shoulda
…..
Training
• Review
progress
and
technique
with
Safe
Experts
• Test,
test,
test!
22. Thank
You
QuesCons?
Peter
Veenstra
Willbros
Engineering
(816)
820-‐7841
peter.veesnstra@willbros.com