The document describes an enterprise architecture for a telecoms service provider that was struggling with scalability and system resilience issues. A previous consultancy had proposed a complex and expensive solution, but ThoughtWorks was tasked with delivering the same capabilities more cheaply. They prioritized building a storage manager service to offload storage responsibilities from the integration database. This improved performance and allowed other parts of the system to be simplified, delivering business value by resolving customers' issues.

1. The
Enterprise
Architecture
you
always
wanted
has
been
hiding
in
plain
sight
since
1991
Jim
Webber
h<p://jim.webber.name
Twi<er:
@jimwebber

2. Or:
A
Billion
TransacDons
Per
Month
Using
the
Web
for
Enterprise
Heavy
LiLing
Jim
Webber
h<p://jim.webber.name
Twi<er:
@jimwebber

4. Today’s
Enterprise
Architecture

6. “SOA:
Principles
of
Service
Design
underwent
a
thorough
technical
review
involving
over
60
reviewers
from
different
vendors,
organiza3ons,
and
professions
across
North
America,
Europe,
and
Asia.
The
book
has
been
formally
endorsed
by
members
of
major
SOA
vendors,
including
IBM,
MicrosoC,
Oracle,
BEA,
and
Intel.”
-­‐-­‐
Thomas
Erl

7. Tomorrow’s
Enterprise
Architecture
BPM
Services
Business
Service
Data
Service
Business
Service
Data
Service
Data
Service
Business
Service
Data
Service
Data
Service

8. Nirvana
Enterprise
Architecture,
or…
BPM
Service
Business
Service
Business
Service
ESB
Basic
Service
Basic
Service
Basic
Service
Basic
Service
Basic
Service
Business
Service

9. ESB
-­‐
Erroneous
SpagheU
Box?
Enterprise
Service
Bus

13. But
we
sDll
do
it.

14. Why?
Because
it’s
“less
risky”

15. Why?
Because
that’s
what
the
market
does

16. Why?
Because
we
need
the
-­‐iliDes

17. So
let’s
talk
about
those
-­‐iliDes

20. Web
Scale!

21. Tradi'onal
Enterprise
Security

22. !"#$%&'"!(
)*%%#+*(&"',*%%-$+(
.*/(0*"1-,*(2'+-,(
"*%'3",*%(
%*,3"-!4(
-$!*")*5-#"4(
%*"1-,*(
!"#$%&'"!(
)*%%#+*(&"',*%%-$+(
.*/(0*"1-,*(2'+-,(
"*%'3",*%(
%*"1-,*(
2'+-,#2(
&'-$!6!'6&'-$!(
)*%%#+*(!"#$%7*"(
%*,3"-!4(
-$!*")*5-#"4(
!"#$%&"' !"#$%&"'
()*+,-%).'!"&/#%*0'123"4'524*"6*'
)"&/#"'&24*"6*'
!%74"89"4&#0:*"8';)7'*#+4)<"#'
="4">9+;"48')"&/#%*0'&24*"6*'*23"4'
!"&/#%*0'123"4'!"#$%&"'
?@!A1#/)*B'
!%74"89"4&#0:*"8';)7'*#+4)<"#'
5+4&"-9"6:%#"')"&/#%*0'&24*"6*'*23"4'
End
to
End
Secure
Messaging
End
to
End
Secure
ConversaDons

23. !"#$%&'(' !"#$%&')'
*+',$-%.$/0'120.0&3$-4'
5+'62$&4702'401820'#044$90'
:0;8043&9'
402<%10'
:0;8043&9'
402<%10'
=.0&3/>'
?2"<%.02'@A6AB'
=.0&3/>'
C2"<%.02'@A6AB'
D+'E0/'6"F0&' G+',$-%.$/0'
120.0&3$-4'
!"#$%&'()*+,"-)!"%.&#")
/0!1*%$2'3)
4+5&#()
!"#$%&'()
*+,"-)
657&8)
657&8)
657&8)
!"#$%&'()*+,"-)!"%.&#")
/0!1*%$2'3)
4+5&#()
!"#$%&'()
*+,"-)
657&8)
657&8)
657&8)
!"#$%&'()*+,"-)!"%.&#")
/0!1*%$2'3)
4+5&#()
!"#$%&'()
*+,"-)
657&8)
657&8)
657&8)
Security
Tokens
and
claims
FederaDng
access
with
tokens

25. …you
wouldn’t
use
it
at
home!

27. !"#$%&"' !"#$%&"'
(#")*"'+",-".&"'
!",-".&"'&#")*"/'
0&12'!",34'56375'
8"++)9"2'!",34':'5'
8"++)9"2'!",34':'3'
8"++)9"2'!",34':'3';'5'
<"+"./2'!",34':'32'0&1'<",-"+*"/'
!",-".&"'0&12'56'3'
=./'

29. !"#$%&"'
(#)*+)&,-*'&-*(".('
!"#$%&"' !"#$%&"'
/0%"*(')110%&),-*'
2#)*+)&,-*'
&--#3%*)(-#'
2#)*+)&,-*'&-*(#-0'4"++)5"+'
67+%*"++'&-41-*"*('%*("#)&,-*+'
Bottleneck
No trust
Crash
recovery?
Denial of
Service

31. <?xml version="1.0" encoding="UTF-8"?>
<definitions name="HelloService"
targetNamespace="http://www.ecerami.com/wsdl/HelloService.wsdl"
xmlns="http://schemas.xmlsoap.org/wsdl/"
xmlns:soap="http://schemas.xmlsoap.org/wsdl/soap/"
xmlns:tns="http://www.ecerami.com/wsdl/HelloService.wsdl"
xmlns:xsd="http://www.w3.org/2001/XMLSchema">
<message name="SayHelloRequest">
<part name="firstName" type="xsd:string"/>
</message>
<message name="SayHelloResponse">
<part name="greeting" type="xsd:string"/>
</message>
<portType name="Hello_PortType">
<operation name="sayHello">
<input message="tns:SayHelloRequest"/>
<output message="tns:SayHelloResponse"/>
</operation>
</portType>
<binding name="Hello_Binding" type="tns:Hello_PortType">
<soap:binding style="rpc"
transport="http://schemas.xmlsoap.org/soap/http"/>
<operation name="sayHello">
<soap:operation soapAction="sayHello"/>
<input>
<soap:body
encodingStyle="http://schemas.xmlsoap.org/soap/encoding/"
namespace="urn:examples:helloservice"
use="encoded"/>
</input>
<output>
<soap:body
encodingStyle="http://schemas.xmlsoap.org/soap/encoding/"
namespace="urn:examples:helloservice"
use="encoded"/>
</output>
</operation>
</binding>
<service name="Hello_Service">
<documentation>WSDL File for HelloService</documentation>
<port binding="tns:Hello_Binding" name="Hello_Port">
<soap:address
location="http://localhost:8080/soap/servlet/rpcrouter"/>
</port>
</service>
</definitions>
Hello
World!

32. The
Web
is
a
coordina'on
pla<orm
Status
codes
Verbs
Media
Types

34. A
Case
Study
Client
• UK-­‐based
telecoms
service
provider
• Global
customers
(no
easy
downDme)
Problem
• Scalability
and
system
resilience
issues
• Huge
growth
curve
to
from
a
million
to
a
billion
messages
per
month
• Costs

35. Plaaorm
Architecture
Carrier
Carrier
Carrier
Carrier
Gateway
Voice to
Text
Algorithms
Integration
Database
Post
Processing
Shared
Filesystem
Bottleneck Nightmare!
Where’s my
file gone?
Shoehorn it
in that other
program
Fix things
up here

37. The
£10
Million
SoluDon
Carrier
Carrier
Carrier
Carrier
Gateway
Voice to
Text
Algorithms
“Queue”
Database
Post
Processing
Shared
Filesystem
Enterprise Service Bus
*
*
SoluDon
does
not
include
actual
implementaDon

39. ThoughtWorks
was
given
the
output
from
a
previous
enterprise
consultancy…
…and
told
to
“do
that,
but
cheaper”

41. Think
differently!
(or
even
just
stop
and
think)

42. Architecture is still important

43. Agile
EA:
PrioriDse
Service
Delivery
Carrier
Carrier
Carrier
Carrier
Gateway
Voice to
Text
Algorithms
Integration
Database
Post
Processing
Shared
Filesystem
Start by
fixing
storage

48. Storage
Manager
Project
Delivery
Small
team
3
Week
Incep'on
14
itera'ons
Java
solu'on
Performance
tes'ng
throughout
– See
Jones
and
Kua
paper,
Agile
2009
Con'nuously
built
and
deployed
for
tes'ng

49. Web-­‐friendly
Architecture
(mostly
wallet-­‐friendly
too!)
Storage Manager
Jboss/Tomcat
GPFS SAN
Cacheable!
Optimised
disk access!
Optimised
server config
Free!
Encapsulates
storage
detail!
Fast!
Spend £ on the
right
Infrastructure

52. What
is
going
on
here?
What
is
going
on
with
these
peaks?

53. Hypothesis
Directories
are
becoming
full,
slowing
random
access
to
files

54. PredicDon
A
single
directory
will
result
in
linearly
degrading
performance

56. Outcome
Adapt
the
directory
structure
to
take
advantage
of
the
underlying
file
system

57. Improving
Enterprise
Architecture
Carrier
Carrier
Carrier
Carrier
Gateway
Voice to
Text
Algorithms
Integration
Database
Post
Processing
Storage
Manager
Reduced
Load
Just shoehorn
it in that
other program
“She’ll be
right”
Scalable!

58. Storage
Manager
Benefits
• Immediate
reduced
load
on
integraDon
database
• Enabled
removal
of
code
from
systems
• Delivered
business
value
by
keeping
customers
happy
• “The
best
soLware
we
have
ever
deployed”
– OperaDons
director
I’ll
come
back
to
this

59. What’s
wrong
with
this
picture?
Voice to
Text
Algorithms!
Storage
Manager!
Just shoehorn
it in that
other program!
Scalable!!

60. What
if…
We
took
our
inspiraDon
from
successful
Web-­‐scale
companies?

61. What
if…
And
took
the
Dme
to
understand
our
SLAs?

62. What
if…
And
picked
the
right
technology
soluDon?
Not
just
the
one
we’re
being
sold?

63. What
if…
We
built
a
scalable
compute
plaaorm?

65. Grid
Project
Delivery
Larger
team
3.5
Week
Incep'on
18
itera'ons
Java
solu'on
Performance
tes'ng
throughout
Con'nuously
built
and
deployed
for
tes'ng

66. Web-­‐friendly
Architecture
(very
wallet-­‐friendly!)
Grid Manager
Embedded Jetty
Grid Manager
Embedded Jetty
Grid Manager
Embedded Jetty
Grid Manager
Embedded Jetty
Grid Manager
Embedded Jetty
ASR ASR ASR ASR
Grid Pipeline
ASR ASR ASR ASR
Grid Pipeline
Just
HTTP
Fault
Tolerant
Fault
Tolerant
Just
HTTP
Sustainable
container for
business logic
£0
Software
Infrastructure

67. Improving
Enterprise
Architecture
Carrier
Carrier
Carrier
Carrier
Gateway
Grid
Integration
Database
Post
Processing
Storage
Manager
Massively
Reduced
Load
“She’ll be
right”
Scalable!
Scalable,
sustainable!
Scalable Processing Platform

68. Grid
Benefits
• Scalable,
resilient
plaaorm
• Aligned
with
business
goals
• Further
reduced
load
on
integraDon
database
• Set
architectural
pa<erns
• Deliver
business
value
by
processing
more
messages
at
lower
cost
than
ever
before
• “The
best
soLware
we
have
ever
deployed”
– OperaDons
director
Be<er
every
Dme!

69. £10,000,000
Up-Front Cost of Bus Architecture

70. £1,000,000
Actual Cost of Completed Project

71. £0
Cost of Middleware

72. The
Web
works
And
its
economies
of
scale
eclipse
your
vendors’