I'll then talk about some of the issues we encountered around scaling and setting up multiple rabbit nodes as a cluster, highlighting some of the potential failure points and edge cases this brings with it and a tools we built to make sure we had them covered.
During the talks there will be some drinks available, …
/var/log/chef-server - All the runit services write their output here.
The design of the system is such that this is self contained and maintained using the chef-server-ctl program, rather than modifying the underlying components themselves.
Chef Server Configuration
The main configuration file for the Chef Server in Chef 11 is /etc/chef-server/chef-server.rb …
The example above is pretty close to what we started working with earlier today. It's also quite similar …
…before, at least not at that granular level. For example, round trip times of liveness traffic in a RabbitMQ cluster.
This gives you a whole new pile of data to obsess about. It's good because that insight is very valuable. But it requires more attention, and more issues require investigation.
You also need to learn how a system behaving normally is reflected in those new systems, and what constitutes unusual behaviour. It takes time to learn and to interpret the data correctly.
Over the last year, as we started turning Travis CI into a hosted product , we added a ton of metrics and monitoring. While we started out slow, we soon figured out which metrics are key and which are necessary to monitor the overall behavior of the system.
I built us a custom collector that rakes in metrics from our database and from theexposed by RabbitMQ. It soon dawned on me that these are our core metrics, and that they need not only graphs, we need to be alerted when they cross thresholds.
Then there are also the languages and version management systems, frameworks and libraries,
gems and plugins, written by countless other developers:
frameworks like Rails or Django
gems and plugins for pagination, authentication, etc.
In order to build …
1 2 3 4 5 6 7 8
( require ' [ langohr.consumers :as lcm ])
( lcm/subscribe ch "images.resize"
Score +2 if you are familiar with RFC 2822.
Score -2 if you didn't know what an RFC was.
Score +2 for any mail generating library you have worked extensively with.
Score -2 if you want to continue working with them.
Score +2 if you have done significant work with a large-scale distributed …
Installing Drizzle 7.1.33-stable
The source tar package is available from the Launchpad download area . Please see the Drizzle manual on how to install Drizzle 7.1.33-stable from source tar package.
Pinterest co-founder shared a bit about their stack on :
+ heavily-modified Django at the application layer
Tornado and (very selectively) node.js as web-servers.
and membase / redis for object- and logical-caching, respectively.
RabbitMQ as a message queue.
, and for static-delivery and load-balancing.
Persistent data storage using.
MrJob onfor .