1. Just Do It Later...Procrastination in Ruby Philly.Rb – August 9, 2011

3. Github: https://github.com/robdimarco/

4. Email: rob @ 416 software . com

5. More: http://www.innovationontherun.com

6. This Presentation: https://github.com/robdimarco/deferred_processing_talk

7. Out of Stream Processing

8. Always Looking to Speed Up User Experience

9. One Way to Get Faster..Do Less

11. Image resizing

12. HTTP/FTP downloads

13. Updating indexes

14. Batch import / exports

15. Analytics

19. Work kept in same process

21. Shared access to data is desired

22. Want communication with other threads

26. Runtime outside of main process but on same machine

27. Let's Take It Up A Notch Queueing!!!

28. “Queues” Queue Request Response Push Pop

29. Delayed::Job

31. Your code creates a Delayed::Job persisted object

32. Worker will go through and work off jobs

36. User.find(1).follow(User.find(2)

37. becomes

38. User.find(1).delay.follow!(User.find(2))

40. Enqueue with

41. Delayed::Job.enqueue(MyJob.new)

44. max_attempts

45. max_run_time

46. destroy_failed_jobs

48. By default, uses ActiveRecord, other frameworks available

52. Errors are stored alongside the job

54. One solitary queue with priorities, cannot create individual queues

55. Have had problem with workers processing long jobs not dying

56. Big queues can lead to database contention

60. Want “out of the box” GUI

61. Big queues

62. Lots of workers

63. Want to process outside your code base

64. Resque

66. Uses Redis to persist queues

67. Rake task for starting a worker

68. Sinatra app for monitoring queues, jobs, and workers.

72. config/resque.yml

76. perform takes in arguments sent to enqueue

78. Standalone or mounted in your application

79. Good snapshot of what is happening

83. Creating a list of jobs for each queue

84. Tracking workers

85. Maintaining stats

87. Enqueue the job

88. Resque.enqueue User, 2, 1

90. Looks to see if you are using Ruby EE

92. Large queues

93. Multiple queues

94. Nice admin tool

95. Workers resistant to job quirks

97. Do not want Redis

98. Do not want queues in RAM

99. Do not want JSON serialization

100. Want to manually query the job queue

101. Amazon SQS

106. Using RightAws gem to abstract this away

110. Easy to add/remove queues

111. No additional services to manage

113. You do not want to handle worker process management

114. You want to minimize processing time / job.

115. AMQP Messaging - The Big Gun

117. Protocol defining how messaging clients and brokers will interact

118. Open, c ross-vendor specification

124. Cross-systems

127. https://github.com/blog/542-introducing-resque

131. http://kr.github.com/beanstalkd/