1. Deploying Apache Traffic Server Leif Hedstrom @zwoop +lhedstrom

3. Spending much of my time on Apache Traffic Server, and how it can best integrate with our Ghost infrastructure and services

4. Several projects at Akamai are made possible with Traffic Serverlhedstro@akamai.com

6. Committer for Apache Traffic Server

7. VP of Apache Traffic Server PMC

8. ASF memberzwoop@apache.org

10. Detailed configurations

11. Static Content (forward proxying)

12. Forward and transparent proxy

13. Advanced features

15. Mandatory useless benchmark …

16. Mandatory less useless benchmark …

17. Intermediaries – Forward Proxy

18. Intermediaries – Reverse Proxy

19. Intermediaries – Intercepting (transparent) Proxy

20. Small deployment

21. Large deployments

22. Installation or Building

28. plugin.config records.config partition.config hosting.config cache.config update.config ip_allow.config storage.config logs_xml.config parent.config remap.config icp.config

29. records.config storage.config remap.config

31. Typically used with reverse proxying, but can be used in forward proxy as well.

32. E.g. remap all traffic for http://twitter.com to https://twitter.com

34. remap.config examples map http://www.example.com/css http://css.example.com map http://www.example.com http://real.example.com reverse_map http://real.example.com http://www.example.com redirect http://example.com http://www.example.com regex_map http://(.*)example.com http://other.example.com/$1 map / http://kitchensink.example.com

35. remap.config examples map http://www.example.com/css http://css.example.com map http://www.example.com http://real.example.com reverse_map http://real.example.com http://www.example.com redirect http://example.com http://www.example.com regex_map http://(.*)example.com http://other.example.com/$1 map / http://kitchensink.example.com

36. remap.config examples map http://www.example.com/css http://css.example.com map http://www.example.com http://real.example.com reverse_map http://real.example.com http://www.example.com redirect http://example.com http://www.example.com regex_map http://(.*)example.com http://other.example.com/$1 map / http://kitchensink.example.com

37. remap.config examples map http://www.example.com/css http://css.example.com map http://www.example.com http://real.example.com reverse_map http://real.example.com http://www.example.com redirect http://example.com http://www.example.com regex_map http://(.*)example.com http://other.example.com/$1 map / http://kitchensink.example.com

39. At least one disk (or “file”) required for any caching to happen

42. Common configurations are in default config file

43. There are many more configurations available

44. The defaults are generally “good”

45. Default configurations are for a reverse proxy, aka “accelerator”. This requires at a minimum configuration changes to remap.config

46. Many configurations (but not all) can be reloaded without restart $ sudotraffic_line -x

47. records.config for reverse proxy CONFIG proxy.config.http.server_port INT 80 CONFIG proxy.config.cache.ram_cache.size INT 1G CONFIG proxy.config.cache.ram_cache_cutoff INT 1M CONFIG proxy.config.reverse_proxy.enabled INT 1 CONFIG proxy.config.url_remap.remap_required INT 1 CONFIG proxy.config.url_remap.pristine_host_hdr INT 0 CONFIG proxy.config.http.negative_caching_enabled INT 1 CONFIG proxy.config.http.negative_caching_lifetime INT 120 CONFIG proxy.config.http.cache.ignore_client_cc_max_age INT 1 CONFIG proxy.config.http.normalize_ae_gzip INT 1

48. records.config for reverse proxy CONFIG proxy.config.http.server_port INT 80 CONFIG proxy.config.cache.ram_cache.size INT 1G CONFIG proxy.config.cache.ram_cache_cutoff INT 1M CONFIG proxy.config.reverse_proxy.enabled INT 1 CONFIG proxy.config.url_remap.remap_required INT 1 CONFIG proxy.config.url_remap.pristine_host_hdr INT 0 CONFIG proxy.config.http.negative_caching_enabled INT 1 CONFIG proxy.config.http.negative_caching_lifetime INT 120 CONFIG proxy.config.http.cache.ignore_client_cc_max_age INT 1 CONFIG proxy.config.http.normalize_ae_gzip INT 1

49. records.config for reverse proxy CONFIG proxy.config.http.server_port INT 80 CONFIG proxy.config.cache.ram_cache.size INT 1G CONFIG proxy.config.cache.ram_cache_cutoff INT 1M CONFIG proxy.config.reverse_proxy.enabled INT 1 CONFIG proxy.config.url_remap.remap_required INT 1 CONFIG proxy.config.url_remap.pristine_host_hdr INT 0 CONFIG proxy.config.http.negative_caching_enabled INT 1 CONFIG proxy.config.http.negative_caching_lifetime INT 120 CONFIG proxy.config.http.cache.ignore_client_cc_max_age INT 1 CONFIG proxy.config.http.normalize_ae_gzip INT 1

50. records.config for forward proxy CONFIG proxy.config.cache.ram_cache.size INT 16G CONFIG proxy.config.url_remap.remap_required INT 0 CONFIG proxy.config.reverse_proxy.enabled INT 0 CONFIG proxy.config.http.transaction_active_timeout_in INT 1800 CONFIG proxy.config.http.normalize_ae_gzip INT 1 CONFIG proxy.config.dns.dedicated_thread INT 1 (transparent proxy would be very similar)

51. records.config for forward proxy CONFIG proxy.config.cache.ram_cache.size INT 16G CONFIG proxy.config.url_remap.remap_required INT 0 CONFIG proxy.config.reverse_proxy.enabled INT 0 CONFIG proxy.config.http.transaction_active_timeout_in INT 1800 CONFIG proxy.config.http.normalize_ae_gzip INT 1 CONFIG proxy.config.dns.dedicated_thread INT 1 (transparent proxy would be very similar)

53. proxy.config.http.insert_request_via_str

54. proxy.config.http.insert_response_via_str

55. proxy.config.http.verbose_via_str

56. Tracers (very, very slow)

57. proxy.config.diags.debug.enabled

58. proxy.config.diags.debug.tags (e.g. http.*|dns)

59. Other

60. proxy.config.dump_mem_info_frequency

62. proxy.config.http.insert_request_via_str

63. proxy.config.http.insert_response_via_str

64. proxy.config.http.verbose_via_str

65. Tracers (very, very slow)

66. proxy.config.diags.debug.enabled

67. proxy.config.diags.debug.tags (e.g. http.*|dns)

68. Other

69. proxy.config.dump_mem_info_frequency

71. proxy.config.http.insert_request_via_str

72. proxy.config.http.insert_response_via_str

73. proxy.config.http.verbose_via_str

74. Tracers (very, very slow)

75. proxy.config.diags.debug.enabled

76. proxy.config.diags.debug.tags (e.g. http.*|dns)

77. Other

78. proxy.config.dump_mem_info_frequency

80. proxy.config.http.insert_request_via_str

81. proxy.config.http.insert_response_via_str

82. proxy.config.http.verbose_via_str

83. Tracers (very, very slow)

84. proxy.config.diags.debug.enabled

85. proxy.config.diags.debug.tags (e.g. http.*|dns)

86. Other

87. proxy.config.dump_mem_info_frequency

89. First, make sure ATS is down (trafficserver stop)

91. Watch the output

92. The argument to –T is a regular expression, telling the server which debug tracers you are interested in

93. This needs much better documentation

95. Advanced logging in many systems http://www.flickr.com/photos/osucommons/3329879294/

96. http://www.newlaunches.com/archives/insectesque_machine_prototype_helps_logging.php Advanced logging in Apache Traffic Server

97. Advanced logging example <LogFormat> <Name = "some_squid"/> <Format = "%<cqts> %<ttms> %<chi> %<psql> %<cqhm> %<cquc>"/> </LogFormat> <LogObject> <Format = "some_squid"/> <Filename = "ssquid"/> <Mode = "ascii_pipe"/> </LogObject>

98. Advanced logging example <LogFormat> <Name = "some_squid"/> <Format = "%<cqts> %<ttms> %<chi> %<psql> %<cqhm> %<cquc>"/> </LogFormat> <LogObject> <Format = "some_squid"/> <Filename = "ssquid"/> <Mode = "ascii_pipe"/> </LogObject>

99. Advanced logging example <LogFormat> <Name = "some_squid"/> <Format = "%<cqts> %<ttms> %<chi> %<psql> %<cqhm> %<cquc>"/> </LogFormat> <LogObject> <Format = "some_squid"/> <Filename = "ssquid"/> <Mode = "ascii_pipe"/> </LogObject>

100. Clustering

102. Highly flexible, with many configuration options

103. And still evolving and worked on

105. cache.config example dest_domain=example.comscheme=http revalidate=2h dest_host=server suffix=.html method=PUT action=never-cache url_regex=/static/ ttl-in-cache=86400

106. cache.config example dest_domain=example.comscheme=http revalidate=2h dest_host=server suffix=.xml method=PUT action=never-cache url_regex=/static/ ttl-in-cache=86400

107. cache.config example dest_domain=example.comscheme=http revalidate=2h dest_host=server suffix=.html method=PUT action=never-cache url_regex=/static/ ttl-in-cache=86400

109. traffic_shell

110. Management APIs (C, but easily used from e.g. Python using ctype)

111. Perl APIs to read stats

112. Useful for monitoring, statistics etc.

113. Stats via HTTP (plugin producing JSON, or “text” via built-in URL)

114. Health checks supported (and used by traffic_cop)

117. JSON stats via HTTP

118. Geo-location request ACLs (filter out requests by e.g. country)

119. Rewrite rules using mySQL or memcached “data”

120. Hopefully soon:

122. proxy.config.exec_thread.autoconfig

123. proxy.config.exec_thread.limit

124. proxy.config.accept_threads

125. Buffers

126. proxy.config.net.sock_send_buffer_size_in

127. proxy.config.net.sock_recv_buffer_size_in

128. proxy.config.net.sock_send_buffer_size_out

130. proxy.local.incoming_ip_to_bind

131. Ports to bind

132. proxy.config.http.server_port

133. proxy.config.http.server_port_attr

134. proxy.config.http.server_other_ports

135. proxy.config.http.connect_ports