Varnish extend introduction

1. Varnish Extend
Building a content delivery network in four hours

2. Per Buer
Product Strategist,
Varnish Software

3. What is it?
• Bundled software and services
• Varnish Plus - intelligent caching
• Cedexis - global load balancing and purging
• Allows users to control content delivery
• Can be applied to “private CDN” or “hybrid CDN”

4. • Caching proxy capable of caching 100TB+ of content per
server
• Advanced functionality such as cache-to-cache
replication
• TCP Acceleration ad-on for higher performance on mobile
• Real time statistics collection from the traffic that flows
through the network
• Easily managed through graphical UI

5. Cedexis Openmix
CLOUD-BASED GLOBAL LOAD-BALANCER
• Automated Traffic Management
• Multi/Hybrid-Cloud, Data-Centre, CDN, Server
• Multiple Data Streams can be used
• Designed for Custom Routing Strategies
BENEFITS
• Real-User Telemetry embedded in platform
• Advanced Control possible
• Highly Distributed and built for purpose

6. What is the problem Varnish
Extend is trying to solve?
• Removes the need for “all or nothing” CDN strategy
• Directs global traffic to the right servers

7. Varnish Extend and capacity planning
Requestpersecond
0
15000
30000
45000
60000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Origin DC Datacenter 2 CDN

8. Geo-distribution of traffic
Origin DC
West Coast DC
East Coast DC

9. Traditional content delivery
through CDN
CDN
Location: London, UK
ISP: BT
Location: London, UK
ISP: BT
Location: Hong Kong
ISP: PCCW Ltd

10. Inspiration
• Tesla Motors were distributing huge amounts of
contents to 100k+ vehicles and users across the
globe
• Set up a PoC in a few hours
• Leveraged existing global server infrastructure

11. Advanced Caching Software
• Intelligent Caching Server
• VCL provides full manipulation
of request/response
• Content Control
Cedexis
Advanced Routing Technology
• SaaS based Software Defined GSLB
• DNS (CNAME/A Record) or HTTP API based
• Multi Platform Purge
• Real-Time 3rd
Party Monitoring
• Clouds
• CDN’s
• Date Centre’s
• Servers
Varnish

12. Cedexis
GTM - Configure through
JavaScript or Prebuilt Applications
All the JS Language features.
• ECMA 5 Supported
• Write for corner cases
• Build automated intelligence into
your Traffic management.
• Cost, Load, Availability and
Performance and much more
• Pre-Written JS Apps in
developers.cedexis.com
Basic Pre-Built Applications in
Portal
• Basic Performance and
availability application.

13. Intelligent Cross-Pop Traffic Management.
Normal Routing Under Weight Routing Remove From Routing
NORMAL routing
weightings:
▪ Route based on best
“server” for the end-user.
▪ Costs weighted, RUM
Performance, Geo and
more..
Under or overweighting:
▪ Divert traffic to nodes based
on load.
▪ Weight nodes (and
performance) based on
loading of the server.
▪ Use metrics such as Server
metrics CPU steal-time,
RAM or I/O capacity
utilization
Remove from routing:
▪ Interface down/instance
down
▪ CPU/RAM or I/O
exhaust
▪ Availability monitoring
says node is down.
▪ Fast failover traffic to
other nodes.

14. How does Extend help?
• Strengthen the origin to server traffic
• Add a mechanism to direct incoming traffic
• Allows for secondary active-active datacenter
• Leverage CDNs to handle traffic peaks and
capacity problems

15. Supported content
• Everything that can be carried over HTTP
• Static web, dynamic web
• Linear and on demand video (HLS, DASH et al).
• API Content

16. Varnish Extend
deployed

17. Strengthen the origin
• Install Varnish Plus on origin to increase capacity
• Both direct traffic and CDN traffic will burden the
origin
• Origin typically has good connectivity - you can
leverage it
• DC capacity is typically cheaper than CDN delivery

18. Add a secondary DC
• A secondary DC can add capacity to handle
everyday peak traffic
• Multiple Varnish servers can leverage Varnish High
Availability to increase capacity and offload origin
• Route incoming traffic through OpenMix

19. Add a CDN to OpenMix
• You might not want servers all across the globe
• A CDN already provide this
• CDNs typically scale very, very well
• Only applied when serving out of your servers are
not ideal

20. Components used in Varnish
Extend
• Varnish Cache Plus w/Massive Storage Engine
used for caching - scales up to 100TB per cache
• VHA for increased performance and resilience in
each location
• Cedexis Openmix for Global Load Balancing
• Cedexis Global Purge

21. Intelligent delivery platform
Varnish
Varnish
Varnish
Big global CDN
Latin CDN Inc.

22. Q & A

23. Varnish High Availability
varnish plus 1 varnish plus 2
Client requests
Replication
streams

24. Enable TLS
• Varnish Extend comes with full TLS support
• Client facing TLS
• Origin facing TLS

25. Q & A