RubyFlow The Ruby and Rails community linklog

×

The Ruby and Rails community linklog

Made a library? Written a blog post? Found a useful tutorial? Share it with the Ruby community here or just enjoy what everyone else has found!

CloudCrowd — Parallel Processing for the Rest of Us

by jashkenas —

CloudCrowd is a new gem that provides convenient, MapReduce-inspired, scalable processing for slow jobs like image resizing, PDF processing, and video encoding. The gem provides a central server and job queue, worker daemons that can be run from anywhere, and a web interface for keeping track of it all.

Comments

Here’s the blog post announcing it with a bit more detail:

http://www.documentcloud.org/blog/2009/09/14/cloudcrowd-parallel-processing-for-the-rest-of-us/

jashkenas —

Post a comment

You can use basic HTML markup (e.g. <a>) or Markdown.

As you are not logged in, you will be
directed via GitHub to signup or sign in