2. This
framework
will
describe
any
IDC
• CluAered
marketplace
for
Internet
Data
Centers
(IDC)
• How
do
you
compare
colo
company
X
with
IDC
Y?
• Model
for
categorizing
any
IDC
• Very
helpful
abstrac+on
2
5. Real
Estate
• Physical
space
and
fire
suppression
systems
• Desirability
of
real
estate-‐NJ?
• Travel
incognito
story
– Rights
of
way
-‐
railroad
• Cost
per
sq
meter
• Ease
of
access
• Price
of
power
in
area
• Proximity
to
fiber
• Floor
loading
• Local
gov’t
support
..hundreds
of
selec+on
criteria
5
•
11. Power
systems
• Condi+oned
Power
– Reliable
Power
– Brownouts,
cutovers
• Generators
vs.
Flywheel
• UPS
• Power
Distribu+on
• Tradeoffs
/
religion
here
• Availability
and
price
are
key
11
12. HVAC
• Hea+ng,
Ven+ng,
Air
Condi+oning
(HVAC)
• Humidity
controlled
• Ambient
Temperature
• Stable
environment
for
equipment
(65˚-‐85˚F)
45%
rela+ve
humidity
Source:
IBM
• Economies
of
scale
12
13. We
expect
the
lights
will
stay
on
• No+fica+on
• Data
Center
Opera+ons
• Processes
and
people
• 111
8th
street
story
illustrates
this
13
14. The
111
8th
street
story
• New
York
City
• Major
Carrier
Hotel
• Power
outage
• Genset
failures
• What
happened?
14
15. The
111
8th
street
story
• What
happened?
• Automa+c
Transfer
Siwitch
Pressure
ncreasing
Fuel
tank
was
empty
–
fixed
polarity
and
upper
fuel
tanks
filled
up
• New
F
uel
Pump
irnstalled
Up
on
roof
– generators
not
unning
–
why?
• Fuel
pump
burned
out.
Starter
motors
tested:
– Went
across
town
tto
supply
store.
Replaced
starter
motors.
It
seemed
to
urn
on
– Up
omroof
–noise
not
star+ng
–
why?
It
n
ade
generators
• Polarity
wfilters
uel
filters
rom
sludge
at
boAom
of
tank
Fuel
clogged
f
as
reversed
enerators
up.
Replaced
f –
g
• Cascading
failure
ours
+
without
no+fica+ons
24
h
15
16. What
we
should
learn
from
this
outage
#1
Things
break
#2
Everyone
recognizes
#1
#3
How
the
IDC
keeps
par+cipants
informed
is
more
important
than
the
outage
16
17. Data
Center
+
Carrier
-‐>
Not
an
Island
Data
Center
Island
• Add
carrier(s)
– “Lit
building”
• Carrier-‐owned
– 1
carrier:
Carrier
POP
– 1
carrier
+
hos+ng:
Carrier
Hos+ng
Facility
• Carrier-‐Neutral
– Which
carriers
are
there
– Key
Selec+on
criteria
– Mul+ple
carriers:
carrier
Value
increases
neutral
coloca+on
17
18. The
Value
of
an
Internet
Exchange
• Network
Externality
• Economists
term
• Value
or
a
good
or
service
propor+onate
to
who
else
uses
the
good
or
service
18
19. Neutrality
• Qwest
won’t
POP
Level
3
Gateways
• Level
3
won’t
be
allowed
into
Qwest
Cyber
Centers
• Some
customers
won’t
POP
a
building
without
mul+ple
carriers
• Some
customers
won’t
POP
a
building
without
a
specific
carrier
being
present
• Terremark
acquired
by
Carrier
–
is
it
s+ll
carrier
neutral?
19
20. Connected
DC
+
ISP
=
Internet
Data
Center
• ISP-‐owned
Data
Center
– ISP
POP
if
for
self
– ISP
Hos+ng
Facility
if
it
hosts
others
• Carrier
and
ISP-‐Neutral
Data
Center
– Neutral
Coloca+on
Center
– “carrier-‐neutral”
• Why
is
neutrality
important?
Wholesale
data
center
space
–
sell
for
resale
“Telco
Hotel”
– Turkey
story.
20
21. Internet
Exchange
Points
• 2
Models
– European
Model
– US
Model
• Challenge:
– Axer
I
explain
the
difference,
tell
me
the
benefits
and
drawbacks
of
each
21
24. Challenge
• What
are
some
of
the
pro’s
and
con’s
of
the
U.S.
and
European
Internet
Exchange
Point
models?
• Why
are
these
differences
important?
24
25. Challenges
• Zaid
Telekom,
a
large
• This
data
center
is
best
telco,
opens
a
data
described
as
a
center
for
its
• A)
carrier-‐neutral
IXP?
customers.
They
claim
• B)
U.S.-‐model
IXP?
they
will
sell
to
anyone.
• C)
telco
hotel?
The
encourage
their
compe+tors
to
come
• D)
carrier
hos+ng
and
be
customers
facility
there.
25
26. Challenges
• Zig
Real
Estate
Holdings
• This
data
center
is
best
converts
a
very
large
described
as
a
building
into
a
mul+-‐ • A)
U.S.-‐model
IXP
floor
data
center.
They
• B)
ISP
POP
do
not
operate
a
• C)
telco
hotel
network
of
any
kind.
They
sell
only
floors
and
• D)
European-‐model
IXP
suites.
26
27. Challenges
• IXion
builds
data
• This
data
center
is
best
centers
across
Africa
described
as
a
and
does
not
own
a
• A)
European-‐model
IXP?
carrier
or
ISP
network.
• B)
carrier-‐neutral
They
encourage
carriers
coloca+on
center?
and
ISPs
to
build
in,
but
IXion
does
not
buy
any
• C)
U.S.-‐model
IXP?
services
from
them.
• D)
ISP
data
center
27
28. Challenges
• Central
Internet
• This
data
center
is
best
Facili+es
builds
data
described
as
a
centers
around
the
• A)
hos+ng
company?
world
and
purchases
• B)
carrier-‐neutral
bulk
Internet
Transit
for
coloca+on
center?
resale
inside
its
data
center
to
its
tenants.
• C)
U.S.-‐model
IXP?
• D)
carrier
POP
28
29. Challenges
• NIX
Centre
builds
a
• This
data
center
is
best
coloca+on
data
center
described
as
a
complete
with
a
peering
• A)
European
model
IXP?
fabric
in
Nigeria.
It
sells
• B)
carrier-‐neutral
rack
space
to
anyone
coloca+on
center?
but
markets
itself
to
the
ISP
community
as
a
• C)
U.S.-‐model
IXP?
peering
point.
It
does
• D)
carrier
POP
not
operate
a
network
and
does
not
buy
or
resell
any
network.
29
30. Challenges
• Ninter
operates
a
• This
data
center
is
best
shared
peering
fabric
described
as
a
across
mul+ple
• A)
European-‐model
IXP?
coloca+on
buildings.
• B)
carrier-‐neutral
Other
than
this
LAN,
it
coloca+on
center?
does
not
operate
a
network.
• C)
U.S.-‐model
IXP?
• D)
ISP
data
center
30