24 April 2014

The Ruby Reflector

Topic

RabbitMQ

  Source Favicon
On paperplanes 25 days ago.
Email

When we set out to build our first product ( Scalarium , now better known as Amazon OpsWorks , we started off with a rookie mistake.

Initially, we played with some ideas to test if we can fit them together. This was mostly focussing on orchestration of servers and their provisioning. We tried out a mix of RabbitMQ, Nanite and Chef (early adopters, yay!)

Back then, NoSQL databases just started appearing, and we thought, screw MySQL, we're going to use something …

paperplanes.de Read
  Source Favicon
On paperplanes 1 month ago.
Email

…to dedicated setups, the databases (we have four clusters, eight database servers in total) and our RabbitMQ service, which we needed to move to a cluster setup .

Most hosted services give you means to scale up. For Heroku apps, you add more dynos, or you increase the capacity of a single dyno .

For their databases (or Amazon RDS, for that matter), upgrade the underlying server, simple enough to do. For RabbitMQ, go for a bigger plan that gives more dedicated resources, …

paperplanes.de Read
  Source Favicon
By Guest Post of New Relic 3 months ago.
Email

RabbitMQ

RabbitMQ has evolved to be one of the primary queuing frameworks for Java developers today, based on the standard AMQP protocol. This RabbitMQ plugin for New Relic lets you clearly see how your RabbitMQ server is doing from within your New Relic dashboard. Metrics you can monitor include the number of messages queued for sending or processing within one of your monitored queuing servers. This is especially important, as lack of ability to process and dispatch messages …

newrelic.com Read
  Source Favicon
By Todd Hoff of High Scalability 3 months ago.
Email

…systems like Hadoop, HBase, Cassandra, Mongo, RabbitMQ, and MySQL, our usage is fairly standard, but there is one aspect of what we do that is pretty unique. We collect or receive information from 100+ sources and we struggled early on to find a way to deal with how data from those sources changed over time, and we ultimately decided that we needed a data storage solution that could represent those changes. Basically, we needed to be able to "version" or "branch" …

highscalability.com Read
  Source Favicon
By Todd Hoff of High Scalability 3 months ago.
Email

…decription of their use of RabbitMQ and their overall architecture on the RabbitMQ mailing list. The closing sentiment marks this as definitely an architecture to learn from:

Although it may seem complex, nyt⨍aбrik has simple components and is mostly principles and plumbing. The key point to grasp is that there is no head, no master, no single point of failure. As I write this I can see components failing (not RabbitMQ), and we are fixing them so they are more reliable. …

highscalability.com Read
  Source Favicon
On Article RSS Feed 9 months ago.
Email

…here at GoCardless and covering some of the ways we've simplified using RabbitMQ's Topic Exchange in a ruby environment with ‘Hutch'.

I'll then talk about some of the issues we encountered around scaling and setting up multiple rabbit nodes as a cluster, highlighting some of the potential failure points and edge cases this brings with it and a tools we built to make sure we had them covered.

Drinks!

During the talks there will be some drinks available, …

lrug.org Read
  Source Favicon
By Joshua Timberman of Chef Blog 1 year ago.
Email

/var/opt/chef-server - The dependent services such as RabbitMQ, Nginx and so on are here, including the PostgreSQL database, SOLR indexes.

/var/log/chef-server - All the runit services write their output here.

The design of the system is such that this is self contained and maintained using the chef-server-ctl program, rather than modifying the underlying components themselves.

Chef Server Configuration

The main configuration file for the Chef Server in Chef 11 is /etc/chef-server/chef-server.rb …

opscode.com Read
  Source Favicon
By Paul Ingles of pingles 1 year ago.
Email

…with a colleague earlier this week which involved connecting to an internal RabbitMQ broker and transforming some messages before forwarding them to our Kafka broker.

We're using langohr to connect to RabbitMQ. Its consumer and queue documentation shows how to use the subscribe function to connect to a broker and print messages that arrive:

The example above is pretty close to what we started working with earlier today. It's also quite similar …

oobaloo.co.uk Read
  Source Favicon
By 0x4a6f4672 of 4 Lines of Code over 1 year ago.
Email

the message queue processing server like ActiveMQ, RabbitMQ or ZeroMQ

Then there are also the languages and version management systems, frameworks and libraries,

gems and plugins, written by countless other developers:

languages like C, Ruby, Python or Javascript

version management systems like SVM, Git, RVM or rbenv

frameworks like Rails or Django

libraries like Prototype or jQuery

gems and plugins for pagination, authentication, etc.

In order to build …

4loc.wordpress.com Read
  Source Favicon
On pingles over 1 year ago.
Email

I was doing some work with a colleague earlier this week which involved connecting to an internal RabbitMQ broker and transforming some messages before forwarding them to our Kafka broker.

We're using langohr to connect to RabbitMQ. Its consumer and queue documentation shows how to use the subscribe function to connect to a broker and print messages that arrive:

1 2 3 4 5 6 7 8

( require ' [ langohr.consumers :as lcm ])

( lcm/subscribe ch "images.resize"

oobaloo.co.uk Read