Hey, it's HighScalability time:
( Earth sized solar flare , some more flair )
Google I/O to world: Just try to keep up with us. You can't. But go ahead and try. Nah na na na nah...
17 billion : Google Cloud Messaging messages per day with 60ms latency; 1B page views : 500px; 121 billion : edge graph using Titan; 4 billion hours : hours watched on Netflix per quarter; 4.5 trillion : BigTable transactions per month
- MySQL Performance Blog: Is Synchronous Replication right for your app?
@ davidpav : "This is what Netflix does - after each deployment creates AMI for faster scaling up"
@ franzgranlund : Rewrote my little batch-processing application using # akka . 20% performance increase just like that - and now it is easier to scale.
@ marshray : Ouch, that's kind of dismal. Perhaps we need a new term: "eventual scalability"
@ adrianco : RT @ rbranson: @ cscotta load average is the worst thing …
Netflix recently open sourced a project called Hystrix :
Hystrix is a latency and fault tolerance library designed to isolate points of access to remote systems, services and 3rd party libraries, stop cascading failure and enable resilience in complex distributed systems where failure is inevitable.
Specifically, Netflix talk about how they make this happen:
How does Hystrix accomplish this?
Wrap all calls to external systems (dependencies) in a HystrixCommand object …
…and the bulkhead pattern introduced in this book now being popularized by Netflix, who openly write about their experiences implementing it .
Netflix is a great example here. They're very open about what they do, they write detailed post-mortems when there's an outage. You should read their engineering blog , same for Etsy's .
Why? Because it attracts engineering talent.
If you're looking for a job, which company would …
- New Relic: Community News: Multi-Device Adaptation vs. Optimization
- Meta | ateM: Getting github emails on organizational projects
- High Scalability: Designing for Resiliency will be so 2013
…passion for teaching. Our real competition is cat videos on YouTube, streaming movies on Netflix, tweets on Twitter, status updates on Facebook, and all the other things that take your attention away from programming. With that in mind, my efforts become focused on developing courses that are so engaging and rewarding that you decide to turn your full attention away from other activities and spend what leisure time you do have on improving your programming craft.
- How Software is Built: Interview with Chad Lucien and Parag Sheth - Hillcrest Labs
- High Scalability: Stuff The Internet Says On Scalability For January 20, 2012
…another major outage , one that shut down the likes of Reddit, Netflix, Airbnb. This outage knocked out Kissmetrics and Lighthouse — tools we depend on to get our jobs done and help our own customers.
We understand outages happen. What we don't understand is why you aren't more upfront with your customers about it. After all, the last time S3 went down, your status board showed all green except for a tiny icon that indicated something might actually be amiss …
- High Scalability: Stuff The Internet Says On Scalability For June 15, 2012
- Kalzumeus Software: Kalzumeus Podcast 3: Growing Consulting Practices, with Brennan Dunn
- Lessons Learned: A new field guide for entrepreneurs of all stripes
- DigitalHobbit: Rails in the Cloud: AWS, Heroku, and Morph
- giant robots smashing into other giant robots: Thank you
- Tammer Saleh: Managing Heroku environment variables for local development
…Deconstructing Recommender Systems: How Amazon and Netflix predict your preferences and prod you to purchase .
§ Argo is easily my top pick movie of the year. The real story behind the rescue attempt is just as interesting and nerve wrecking .
§ Kent Beck :
first you learn the value of abstraction, then you learn the cost of abstraction, then you're ready to engineer
- Trevor Turk: Links for 5-17-11
- Katz Got Your Tongue?: A Proposal for ES.next Proposals
- Global Nerdy: JavaScript Oddities from the WAT Video, Explained
- John Resig: Redefining the Introduction to Computer Science
- New Relic: Node.js and PaaS: Changing the Development & Operations World
- Patrick Lenz: Proper Language Detection on the Web
…Derek discovered that the person who owned the " Cosmo" gamer tag also had a Netflix account. And that's how he became Cosmo.
"I called Netflix and it was so easy," he chuckles. "They said, ‘What's your name?' and I said, ‘ Todd [ Redacted],' gave them his e-mail, and they said, ‘ Alright your password is 12345,' and I was signed in. I saw the last four digits of his credit card. That's when I filled out the Windows Live…
- Coding Horror: Touch Laptops
- occasionally useful: Work for Amazon!
- A Fresh Cup: Double Shot #773
- High Scalability: Stuff The Internet Says On Scalability For August 26, 2011
- Trevor Turk: Links for 09-26-11
- Engine Yard Developer Blog: Let the Engine Yard Cloud dashboard and SSH access help you
…supercomputer has world's fastest storage; four billion hours : Netflix streaming in last 3 months; $1.2B : Google's Q1 infrastructure spend
Quotable Quotes:
Google : We'll track EVERY task on EVERY data center server
Stacey Higginbotham : All in all in the last five years the world has gained 54 Tbps of new capacity.
@ seveas : Scalability 103: Hardware sucks. Software sucks. Everything *will* …