Building a Queue-Backed Feed Reader, Part 2
Queueing is a critical tool for building truly scalable web apps. Don’t do any heavy lifting in the web processes (mongrels); instead, put jobs on a queue, let background workers do the work, and then display the results to the user in another request.This concept is often met with a big “huh?” from Rubyists, so here I’m going to give a tangible example, including a small but completely functional Rails app, using Delayed Job (aka DJ) for the queueing solution.
I had a good time fussing around with the demo.
This is, funny enough, somewhat related to the alligator problem I was having yesterday.