2. Other
22.0%
Amazon Video
Facebook
SSL
iTunes
Hulu
MPEG
BitTorrent
HTTP
11.7%
Netflix
34.2%
Youtube
13.2%
Sandvine 1H 2014 Global Internet Phenomenon Report
FreeBSD - Still being awesome
3. Other
22.0%
Amazon Video
Facebook
SSL (Netflix)
34.2%
What if we do SSL?
SSL
iTunes
Hulu
MPEG
BitTorrent
HTTP
11.7%
Youtube
13.2%
Sandvine 1H 2014 Global Internet Phenomenon Report
4. Network I/O kernel
• Data is copied in
• Data is copied out
• High memory
bandwidth, Cpu load
write() read()
• L1/2/3 cache
thrashed web
Classic Web Serving
server
worker thread
5. • Data is directed in
Network
I/O
and out of RAM
• No copies through
the CPU
• Sendfile
V/M
Async sendfile hints
• variable read-ahead
• Cache-behind worker thread nginx
kernel
Optimized Nginx Web Serving
6. Network I/O kernel
write() read()
ssl nginx
• SSL Bulk encryption
is expensive
• AESNI still costs
CPU cycles
• Back to having data
copies
• 2.5-3x hit on serving
Classic SSL Web Serving
7. Network
Socket bulk
encryption
Sendfile
I/O
V/M
kernel
plug-in worker thread
ssl nginx
• Encryption-aware
sockets
• Key exchange,
session mgmt still in
user libraries
• AESNI, crypto-offload
In-Kernel SSL Web Serving