The document summarizes new features and optimizations made to a high performance photo gallery over multiple versions. Key points include: 1) New features like mobile support, shopping CMS integration, speed improvements from bug fixes, and official Nginx support. 2) Performance optimizations including caching, memcached usage, SQL query optimizations, and switching to Sphinx for faster full-text search. 3) Traffic and usage statistics showing the system can handle over 180,000 pageviews daily on a single server with Nginx, Sphinx, MySQL and memcached.

2. v6

5. Freelancing and building open-source software in free time

10. Official ngnix support

12. Kernel modules override

13. Kernel classes override

14. CSS compile

15. Most popular images in 24 hours

16. Photo approvement functionality

17. Image filtering by resolution

19. 100% duplicates management accuracy

21. Max archive size

24. Completely fixed AJAX navigation usability, no more confusing of available images to left or to right.

25. Front end design remake, thanks to http://pauliusc.lt

26. HTML output compression

27. HTML 5 frontend changes, saves bandwidth

29. More things moved to Memcached service

31. AddQuery usage implementation in search

32. Refactored search page. One query less now.

33. Paginator updates

34. Sphinx wildcard support

35. Images without original deletion script

36. SEO enchancement related to resolution and user current page

38. Image preview full window cache!!! cached windows is as fast as cached pagination around 5ms

39. Image counter from log file, avoid insert on each image preview window

41. Cache status window

42. Recently top rated, in 24 hours

43. APC support as cache engine.

44. HTML5, SWF, FLV files support

45. Search suggest feature

47. Smart selects in image preview window

48. Full multilanguage support including translatable module URL!!! none of my known gallery/cms has this featyre. E.x gallery/search (engish) or gallerie/recherche (french)

49. Full InnoDB support. Performs well as MyISAM. Top process is PHP not Mysql :)

51. Multicolor search uses self inner joins. Regarding performance memory table can be activated.

52. http://code.google.com/p/hppg/wiki/SearchByColor

56. Gives 24x performance boost compared to standard method using php and mysql.

57. http://code.google.com/p/hppg/wiki/ColorIndexer

59. This library was used for writing color_indexer application

60. http://mattmueller.me/blog/creating-piximilar-image-search-by-color

61. There I got my inspiration and basic concept. Either database structure is completely different.

62. http://www.compuphase.com/cmetric.htm Formula for calculating similar color to our pallete

63. http://en.wikipedia.org/wiki/Tag_cloud Formula for representing color density in image sphinx table

66. CREATE TABLE IF NOT EXISTS `lh_gallery_pallete_images_stats` ( `pid` int(11) NOT NULL, `colors` varchar(100) NOT NULL, PRIMARY KEY (`pid`) ) ENGINE=MyISAM DEFAULT CHARSET=utf8;

68. /** * This part was changed based on formula * * It fits here better than just log * * http://en.wikipedia.org/wiki/Tag_cloud * */ $max = 15400/2; // A little better distribution of color $min = 25; $rmax = 50; $rmin = 1; $colorIndex = array(); foreach ($colorsMaximumImage as $color) { $colorIndexString = trim(str_repeat(' pld'.$color['pallete_id'],round((($rmin*($color['count']-25))/($max-$min))*100))); if ($colorIndexString != '') $colorIndex[] = $colorIndexString; }

73. http://remdex.info/Optimising-mysql-limit-performance-99a.html

74. Backend redesign

76. Unoptimized SQL query's

77. Resource hungry

78. No framework used (well, perhaps this is not a problem, but most of the time they just duplicate frameworks functionality, reinventing the wheel...)

79. No Etag based caching, bandwidth saver...

81. Fulltext search engine

82. Etag based caching

83. SQL querys caching

84. Fullpage caching

85. Low resource requirements

87. Sphinx – free open-source SQL full-text search engine (http://sphinxsearch.com/)

88. Memcached – free & open source, high-performance, distributed memory object caching system (http://memcached.org/)

89. eZ Components – an enterprise-ready, general-purpose PHP library of components used independently or together for PHP application development. (http://ez.no/ezcomponents)

90. JQuery – is a fast and concise JavaScript Library that simplifies HTML document traversing, event handling, animating, and Ajax interactions for rapid web development. (http://jquery.com/)

91. Lighttpd – lightweight open-source web server. (http://www.lighttpd.net/)

92. Mysql – database engine (http://www.mysql.com)

94. Fully working ngnix config provided. For eshop requirements and standard

96. Configuration

97. Database

98. Feed

99. ImageAnalysis

100. ImageConversion

101. PersistentObject

102. Translation

103. Cache

104. Url

105. UserInput

107. Example in next slide

110. Keyword (haposai)

113. Things I do not know how to do till now. If sorting is based on relevance how to now previous two images.

115. Had to use two query's. SetFilter() works with @weight

116. AddQuery comes in help here for perfromance. Mutch more relevance images now.

119. Not a single slow query

121. SELECT * FROM `lh_gallery_images`

122. INNER JOIN ( SELECT pid FROM lh_gallery_images ORDER BY comtime DESC, pid DESC LIMIT 20 OFFSET 20 ) AS items

123. ON lh_gallery_images.pid = items.pid

124. This query is at least 5x times faster than normal select. Tested with (150 K records.)

125. See - http://www.mysqlperformanceblog.com

127. Apache

130. http://www.infoq.com/presentations/lutke-rockstar-memcaching

132. Last uploaded

133. Last hits

134. Popular images and so on.

138. $mode – sorting mode (Ex. Popular)

140. Some benchmarks [root@ks310613 ~]# ab -n 500 -c 10 http://animeonly.org/Fantasy/Mix-16a.html This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0 Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ Copyright 2006 The Apache Software Foundation, http://www.apache.org/ Benchmarking animeonly.org (be patient) Completed 100 requests Completed 200 requests Completed 300 requests Completed 400 requests Finished 500 requests Server Software: lighttpd Server Hostname: animeonly.org Server Port: 80 Document Path: /Fantasy/Mix-16a.html Document Length: 26883 bytes Concurrency Level: 10 Time taken for tests: 0.545137 seconds Complete requests: 500 Failed requests: 0 Write errors: 0 Total transferred: 13593092 bytes HTML transferred: 13441500 bytes Requests per second: 917.20 [#/sec] (mean) Time per request: 10.903 [ms] (mean) Time per request: 1.090 [ms] (mean, across all concurrent requests) Transfer rate: 24349.84 [Kbytes/sec] received Connection Times (ms) min mean[+/-sd] median max Connect: 0 0 0.0 0 0 Processing: 5 10 2.9 9 23 Waiting: 4 9 3.1 9 23 Total: 5 10 2.9 9 23 Percentage of the requests served within a certain time (ms) 50% 9 66% 12 75% 13 80% 13 90% 13 95% 13 98% 20 99% 22 100% 23 (longest request)

143. User ID is needed if user is logged in.

144. Can be used for custom pages, that do not change

145. Then image is uploaded or deleted, we just increase cache version and Etag is expired automatic also.

147. Mysql queries

149. Traffic stats

151. No performance issues at this time.

152. Gallery home page

153. http://code.google.com/p/hppg/