The document discusses network support for cloud applications. It notes that cloud applications span multiple datacenters and content delivery networks, and have requirements around user latency and reliability. It proposes using software-defined networking (SDN) to give applications more programmatic control over the network and help optimize placement and migration decisions. SDN could provide network monitoring data and help orchestrate both computing and network resources to meet applications' quality of service needs in a dynamic cloud environment.
1. Félix Cuadrado
Network Support for Cloud Applications
International Workshop in Trends in Future
Communications
CPqD, Campinas, Brazil
25th February 2014
2. • 18,000 students in London
• Member of Russell Group
•School of EECS
• 70 academic staff
• £37M research grant portfolio
• Networks research group
• Wireless and systems networking
• 16 academic staff
• 50+ PhDs and Postdocs
Queen Mary University of London
2
3. • Distributed services
management in the
datacenter
• Monitoring of events
• Objectives-based
management
• Automated diagnosis
• Self-configuration
• Self-healing
Datacenter Services Management
3
Node N1
Container static_web
Node N6 Node N10
Node N3 Node N5
Node N4
Container esb1 Container esb1Container prc2
Container esb2Container esb1Container prc1
Container dyn_web2Container bsn_logic1 Container ora_dbContainer ora_db
CoRs
PrRc
PrCg
PrMg
ClMg
AcMg
AcDA
CPDA
ClDA
OpAc
ClPo
ClPS
ClDS
CrPD
AcDS
CPDA
Container bsn_logic2Container bsn_logic2 C
Node N1
Container static_web
Node N6 Node N10
Node N3
Node N5 Node N4
Container esb1 Container esb1Container prc2
Container esb2Container esb1Container prc1
Container dyn_web2Container bsn_logic1 Container ora_dbContainer ora_db
CoRs
PrRc
PrCg
PrMg
ClMg
AcMg
AcDA
CPDA
ClDA
OpAc
ClPo
ClPS
ClDS
CrPD
AcDS
CPDA
Container bsn_logic2Container bsn_logic2Container bsn_rule1
PrRR
OAcP
PrRP
Managed Domain
Configura on
Host
Resource
Environment
Host
Resource
RR
RR
RR
Res
Logical
Resource Base
LR
LR
LR
CRC
CRC
LR
Objec ves
O
O
O
O
O
O
EXTERNAL CHANGES
Management System
Monitor
Analyze Plan
ExecuteKnowledge
LRB Obj Cf
INTERNAL
CHANGES
Migrate
Compute,
Messaging
Update Graph
Decide Migrations
BSP SYNC
BARRIER
BSP SYNC
BARRIER
Distributed Graph Processing
6. • Spans over a multi tenant infrastructure
• Datacenters, CDN: computing resources
• Internet Service Providers, IXPs
• Distributed Application Overlay
• Nodes (computing), and links (connectivity)
• Requirements on links to end users and intra-
application links
• Elasticity: dynamically adapt to user workload
Anatomy of a Cross Cloud Application
6
7. • Applications know what they
need (QoS, requirements)
• Latency, bandwidth are often the
performance bottlenecks
• But only control cloud resources
• Where to deploy?
• Hack network at application layer
(proxies, load balancer,
middleboxes)
• Compensate/adjust on transport
protocols
Applications and Networks don’t talk
7
• Network views aggregated
packet information
• Internal information hidden for
other stakeholders
• Static network configuration
8. • Programmatic control plane for the network
• Control forwarding behaviour
• Break into the protocol stack
• Network virtualization resources can be
dynamically allocated
Enter SDN
8
Logically Centralised Control Plane, on a Internet
Scale, multi-tenant infrastructure?
9. • Applications are managed based on measured server
metrics.
• CPU, memory, requests/second, service time
• We also need network information monitoring!
• Static information (topology)
• Dynamic information (network status) … “real time”
Network analytics
9
Scalable Fine-grained Network Monitoring
Network plus Server App Analytics
Application-aware network management
10. • Applications management plane has to orchestrate both
compute and network infrastructure
• Use SDN to help with transient states, migration
• … and automatically handle application high availability
Dynamic Cloud App management with SDN
10
Infrastructure ecosystem
Act at the right timescale
Decide where and how much
Manage transitional states
11. • Cloud applications require some services
• Security, load balancing, forwarding…
• Geo-distributed applications
need similar support!
• How to extend to a network-wide scale?
• Co-location of application nodes- support services
• Efficient support of dynamic overlays
• Configure with changing network-wide policies
Network-wide services for applications
11
Load
Balan
cer
Proxy
Trans
coder FW
IDSCache
…
As challenging to manage as the applications themselves
12. • Cloud applications are a strong use case for SDN
• Support latency requirements
• Link to end user, intra application communications
• We need to talk!
• Application management needs to become aware of the
networking side
• Orchestration of the network and computing
infrastructure must be addressed
• How do we support autonomic dynamic application
management, in a scalable way?
Conclusions
12