Instagram wrote a nice article about it.
Pooling Opening a connection is expensive. Use a pooler.
pgbouncer is a pooler.
pgPool II can even do query analysis. However, it has higher overhead and is more complex to configure.
Tools Monitor everything.
check_postgres.pl is a plugin to monitor PostgreSQL.
pgAdmin III and Navicat are nice clients.
pgbadger is for log analysis. So is pg_stat_statements.
Closing MVCC works by each tuple having a range of transaction IDs …
…warrants distracting us from what's really relevant?
I've removed Twitter, Instagram, games, even email from my phone. It's quite deliberating. It does turn an iPhone into a rather expensive two-factor authentication device, but it removes a lot of pointless distractions.
Banksy says it best:
No more vibrating phone when an email comes in, when someone sends me a direct message or likes a photo.
All that can wait. My focus can't.
… Fox and Fawn, items often sell out within minutes of the picture being posted on Instagram.
Even Looking back on "Look Back" videos . Look Back's are one minute videos generated from a user's pics and posts. For the release they planned on 187 Gbps more bandwidth and 25 petabytes of disk. To get the rendering done …'s infrastructure struggles when a new feature becomes an unexpected hit. That's the situation described in an engaging story:
Benedict Evans makes a great case that is a 1+ trillion dollar business, is disrupting the part of this industry, which globally has over $ 100 billion in revenue, by sending 18 billion SMS messages a day when the global SMS system only sends 20 billion SMS messages …
…for the type of business I want to run. Venture capital is for people who want to grow something to Instagram orlevels. Getting funding for something that typically (and insultingly) refers to as a "lifestyle business" is far harder. , by design, isn't designed for those insane levels of scale.
And finally, I'm personally averse to the whole racket of venture capital. Entrepreneurs are the new labor , especially when old guys with money …
…with your phone (and buy stuff from others like a swap meet). Kind of likemeets Instagram.
What it's like: eBay meets Instagram
Who's involved/Why it's promising: Raised $ 3.5 million inA financing, former Kaboodle
What it does:ecommerce where you can shop items endorsed by famous people like Kelly Bensimon, Cynthia Rowley and Julianne Moore at a reduced price and you customize who you follow.
What it's …
@ rbranson : The i2 EC2 instances are a huge deal. Instagram could have put off sharding for 6 more months, would have had 3x the staff to do it.
@ mraleph : often devs still approach performance of code as if they are riding a horse cart but the horse had long been replaced with fusion reactor
Now we know the cost of bandwidth: Netflix's new plan: save a buck with SD-only streaming .
Massively interestingthread on Why is processing …