…AMQP and Eventmachine to interact with RabbitMQ. The choice of AMQP was a no brainer, we already used daemon-kit and it has native AMQP support. The switch took less than a weekend to get up and running!
In the end, we went from two starling queue servers and two daemon servers running 8 daemon workers each, to two queue server and two daemon servers running one daemon each. Starling was constant source of pain, the servers would just start handing out random timeouts after …
- There's no Place Like ::1: Twitter AMQP WebSocket Example (no polling)
- Brightbox Blog: Queues and Callbacks
- igvita.com: HTTP PubSub: Webhooks & PubSubHubbub
- 4 Lines of Code: RabbitMQ and AMQP in Ruby
- High Scalability: Hot Holiday Scalability Links for 2009
- Engine Yard Ruby on Rails Blog: Win a Motorola DROID Programming Contest: "Worst App Server Technology Ever"
…simultaneous connections or other enterprise messaging features, you'll be better served by AMPQ or JMS brokers. ActiveMQ, in particular, is very configurable, so it'll most likely fit the bill if memory consumption or scaling to many subscriptions are not a concern.
Scalability
ocamlmq has been designed to support millions of queues and topic subscriptions without undue memory usage. This table summarizes the time complexity of some STOMP operations: SEND to queue …
- Litany Against Fear: Messaging with Ruby on Rails Notes
- 4 Lines of Code: Background Jobs in Ruby on Rails
- ronin coder: Open Source Bridge presentation
- Jake Scruggs: Rails Conf 2010 Day 2
- Alexey Kovyrin's Blog: ActiveMQ Tips: Flow Control and Stalled Producers Problem
Of course, there is no single answer to that question - it depends on your application. AMQP is a great power tool for message routing , but there are other systems that can do a better job at specific tasks. One of such tools is Beanstalkd , which is a simple, and a very fast work queue service rolled into a single binary - it is the memcached of work queues. Originally built to power the backend for Causes Facebook app, it is a mature and production ready open source …
- 4 Lines of Code: Background Jobs in Ruby on Rails
- Rails Envy » Home: Rails Envy Podcast - Episode #099
- techno weenie: Structuring your background jobs
- Scout ~ The Blog: Three reasons for Resque (and a Scout Plugin)
- Brightbox Blog: Queues and Callbacks
- Josh Owens is a Rails Freak: Throwing away code
When I looked at the code base and took daemon-kit and AMQP out of the equation, I started to look for better queue options. By looking for something more integrated into a rails app, I would be able to move all my code into one easily tested spot.
After a week of research and reading, I realized resque 1 might fit the bill. Since resque integrates more directly into the rails app, I can submit jobs from the web interface now - allowing new features I want. With multiple queue support …
- Axon Flux // A Ruby on Rails Blog: Resque to the rescue. But a gotcha: Don't forget to refresh those ActiveRecord connections
- 4 Lines of Code: Background Jobs in Ruby on Rails
- Scout ~ The Blog: Three reasons for Resque (and a Scout Plugin)
- A Fresh Cup: Double Shot #576
- Rails Envy » Home: Rails Envy Podcast - Episode #099
- techno weenie: Structuring your background jobs
Beetle - High-availability redundant AMQP queues.
Draft Prawn 1.0 Spec - Just in case you want to know where this PDF generation tool is going, and perhaps offer some input.
From Bundler to Open and Inclusive Software Communities - Steven Baker had a bad experience with the NIH attitude that pervades parts of current Ruby tools development, and has gone public with it.
Isolate - A simple alternative for gem management.
Non-blocking …
- igvita.com: Non-blocking ActiveRecord & Rails
…Theo Schlossnagle . I really think that cueing your database to publish over AMQP is the bees knees and it turns out I wasn't alone!
Scaling GIS Data in Non-relational Data Store by Mike Malone. How SimpleGEO uses NoSQL and other technologies. Yes, the still use memcached. Caching ain't going anywhere.
CLTV45: The Evolution of the Graph Data Structure from Research to Production . In this recording from " NoSQL Live Boston…
- igvita.com: Future of RDBMS is RAM Clouds & SSD
- Engine Yard Ruby on Rails Blog: LDAP Directories: The Forgotten NoSQL
- James on Software: Most NoSQL DBs Are Not Scalable
- paperplanes: NoSQL And You - Thoughts On Finding Right Partner In Chrime
- Merbist: I did it wrong
- Intridea - Company Blog: Hashie Gains a Chainable Hash
Doug Barth of Interactive Mediums has created two plugins for monitoring RabbitMQ , an enterprise messaging system based on the emerging AMQP standard.
Doug's RabbitMQ Overall Monitoring Plugin monitors the overall health of RabbitMQ - reporting the number of queues, connections, etc. His RabbitMQ Queue Monitoring Plugin drills down to a specific queue.
Doug tells me that Interactive Mediums, which offers a mobile customer engagement …
- Mike Perham: Changelog vs Commitlog
- paperplanes: There's Something About Redis
- Labnotes: Advanced Messaging & Routing with AMQP
- Litany Against Fear: Messaging with Ruby on Rails Notes
- Heroku: Background Jobs with DJ on Heroku
- Rails Dog: Generating Thousands of PDFs on EC2 with Ruby
…most simple and basic example of using an AMQP message queue from Ruby? And what is an AMQP message queue anyway?
Message queues are useful to store a large number of items which can not be processed immediately and to achieve a loose coupling between application parts in general. There are two standard protocols for asynchronous message queues, AMQP and XMPP. AMQP is the lighter one which uses a binary format, while XMPP uses XML. AMQP means Advanced Message Queuing Protocol…
- igvita.com: Advanced Messaging & Routing with AMQP
- Article RSS Feed: August 2009 Meeting
- railzite: Getting started with AMQP and Ruby
- Brightbox Blog: Queues and Callbacks
- Open Sourcery: Looking beyond daemon-kit 0.2
- High Scalability: Hot Holiday Scalability Links for 2009
[ CHEF -760 ] - Use AMQP drivers directly for indexing queues
[ CHEF -776 ] - users and groups for mac os x
[ CHEF -805 ] - Deploy resource's scm_provider should accept a short string/symbol as name instead of a fully qualified class name
[ CHEF -806 ] - knife refactored should show all the sub commands with —help
[ CHEF -865 ] - Implement retry logic when making server requests
[ CHEF -881 …
- BenCurtis.com: A Chef recipe for ProFTPD
- Engine Yard Ruby on Rails Blog: Custom Chef Recipes with Engine Yard Cloud
- English - AkitaOnRails.com: Chatting with Adam Jacob
- Signal vs. Noise: Nuts & Bolts: Configuration management with Chef
- Rails Dog: Generating Thousands of PDFs on EC2 with Ruby
- SD Ruby Podcast: Episode 067: Cooking up a Cloud (with Chef & EC2)
AMQP . start ( :host => 'localhost' ) do
q = MQ . new . queue ( 'tasks' )
q . subscribe do | msg |
puts msg
end
end
This server is pretty basic it handles the messages and prints them
out as it gets them.
Now lets create a client.rb that sends messages to the queue.
1 2 3 4 5 6 7 8
require 'rubygems'
require 'carrot'
q = Carrot . queue ( 'tasks' )
10 . times { | x | q . publish ( 'Message number ' …
- Neubia: Rails, Queues and Mongrel?
- Jason Seifer: Microsoft deems Ruby on Rails a competitor
- brant interactive: Seth Godin's ebook, ‘What matters now' Free download. Tons of great ideas/things to think about.
- Rails Inside: RailsTutorial.org: Michael Hartl's Awesome New Rails Tutorial
- paperplanes: A Collection Of Redis Use Cases
- a timocracy of one: A great photo essay by THomas Hoepker of East Berlin over the last 50 years that Roula found