This is a guest post by Patrick Eaton , and Distributed Systems at Stackdriver.
Stackdriver provides intelligent monitoring-as-a-service for cloud hosted applications. Behind this easy-to-use service is a large distributed system for collecting and storing metrics and events, monitoring and alerting on them, analyzing them, and serving up all the results in a web. Because we ourselves run in the cloud (mostly on ), we spend a lot of time …
@ jimblomo : A Note on Distributed Computing advised against treating remote calls as local functions, I advise against treating the cloud as datacenter
Instagram : A , Rapid History of Scaling Instagram (with a tiny team). Have a bigger team. Do simple first. Reduce moving parts. Test and monitor everything. Use earlier. Match the team with the tools. Simple isn't always hacky. Rocketship scaling has been somewhat democratized.
Most of your hard …
…their handling of network failures. Cascading failure happens. Split brain happens. Distributed systems do not scale linearly vs a single system; having a 5 node cluster will not handle 5x the throughput of a single system so your costs will increase super-linearly and your chances of network failure increase 5x (and thus exposing those hard-to-test network failure bugs). Distributed systems are useful only if:
You need scale beyond what one system can provide
You are willing to …
Notes on Distributed Systems for - Bloods reading if you're tinkering with a non-trivial web application.
How to Permanently Prevent - from ever Re-Opening Apps After a Restart tweak.
Rails has Two - Or many, really. A small exploration of why it's getting really hard to learn " Stacks " these days.
Draper 1.0.0 released - One of the more complex alternatives for decorators.
…exciting new product at RICON , 's Distributed Systems Conference.
We are currently using and testing our first productized NoSQL database.will be a first-class citizen in our stack starting of 2013. We are very excited about the changes pioneered by our upcoming support for Riak and we are looking forward to sharing …
§ A Distributed Systems . List
§ Haiku Deck . Easy, simple presentations on the iPad.
§ Anic is an interesting language for parallel processing (inactive project, but some good ideas).
§ Imaging at a Trillion Frames Per Second : fast enough to see light propagating.
§ The iPhone Has Passed a . Threshold
§ 0th-world problems are like first-world problems except only applicable to computerists
…to bringinto the enterprise.
I've had a blast writing this series and hope everyone has enjoyed reading it. I'll have more here, at my blog Composite Code , and other places in the near future. I'm a huge advocate of OSS, Cloud / Utility Computing & Distributed Systems, and more. It's all coming, sooner than many may realize. Are you ready to revolutionize your development yet?
…dispute that some web standards do provide guidelines that account for the written about this as well, cautioning that 's perspective is "overly optimistic" because "the fact that web standards …of Distributed Computing. Yet, what makes the fallacy of network reliability still valid in web-based systems is primarily the human element - although there are rules in place, it's unwise to assume everyone is following them. Other technology bloggers have
At Couchbase we are looking for experienced hackers to help us build the fastest, most reliable distributed database on the planet. You don't need to a be expert already, but you should be ready to learn the ins and outs of distribute database systems, including:
Systems Resource Management: io (disk, network), cpu, memory usage
Maximizing Throughput and Minimizing Latency
Profiling, Benchmarking and Optimization
Distributed Systems with Ruby? Yes!
Building a distributed system with as many moving components as CloudFoundry is no small feat, and it is really interesting to see that the team behind it chose Ruby as the platform of choice. If you look under the hood, you will find Rails, Sinatra, Rack, and a lot of EventMachine code. If you ever wondered if Ruby is a viable platform to build a non-trivial distributed system, then this is great case study and a vote of confidence by VMware…