20 April 2014

The Ruby Reflector

Topic

BigTable

  Source Favicon
By Todd Hoff of High Scalability 13 days ago.
Email

MapReduce scheduler that gave rise to Hadoop when it was mimicked, so did the BigTable NoSQL data store that has spawned a number of quasi-clones, and even the B4 WAN and the Spanner distributed file system that have yet to be cloned.

"What we have seen is that a logically centralized, hierarchical control plane with a peer-to-peer data plane beats full decentralization," explained Vahdat in his keynote. "All of these flew in the face of conventional wisdom," …

highscalability.com Read
  Source Favicon
By Todd Hoff of High Scalability 6 months ago.
Email

Fellow in the Systems Infrastructure Group ( MapReduce, BigTable, Spanner, GFS, etc), talks about a few interesting aspects of Google's culture.

What Made Google Google

Progress is a modern idea. The conviction that future can be changed for the better through individual advancement and action has over hundreds of years driven an exponential growth in the technome.

What drives progress? Challenges. Individuals finding and defeating a challenge. There's usually something …

highscalability.com Read
  Source Favicon
By Assaf Arkin of Labnotes 7 months ago.
Email

…systems - systems such as Amazon's Dynamo, Google's BigTable and MapReduce, Apache's Hadoop and so on.

Startup Life

§ How to hire . I'll quote the last tip, which I've seen a couple other people tweet about:

Don't hire.

Many founders hire just because it seems like a cool thing to do, and people always ask how many employees you have. Companies generally work better when they are smaller. It's always worth spending time to think …

blog.labnotes.org Read
  Source Favicon
On Labnotes 7 months ago.
Email

…systems - systems such as Amazon's Dynamo, Google's BigTable and MapReduce, Apache's Hadoop and so on.

Startup Life

§ How to hire . I'll quote the last tip, which I've seen a couple other people tweet about:

Don't hire.

Many founders hire just because it seems like a cool thing to do, and people always ask how many employees you have. Companies generally work better when they are smaller. It's always worth spending time to think …

blog.labnotes.org Read
  Source Favicon
By Shannon -jj Behrens of JJinuxLand 2 years ago.
Email

See the website .

See the slides .

He doesn't cover setting up a production cluster.

Using a schema is optional.

Cassandra is like a combination of Dynamo from Amazon and BigTable from Google.

It uses timestamps for conflict resolution. The clients determine the time. There are other approaches to conflict resolution as well.

Data in Cassandra looks like a multi-level dict.

By default, Cassandra eats 1/2 of your RAM. You might want to change that ;)

jjinux.blogspot.com Read
  Source Favicon
On igvita.com 2 years ago.
Email

…you get is a nice database engine for certain type of workloads. In fact, Google's BigTable, Hadoop's HBase, and Cassandra amongst others are all using a variant or a direct copy of this very architecture.

Simple on the surface, but as usual, implementation details matter a great deal. Thankfully, Jeff Dean and Sanjay Ghemawat , the original contributors to the SSTable and BigTable infrastructure at Google released LevelDB earlier last year , …

igvita.com Read
  Source Favicon
On paperplanes 2 years ago.
Email

…can only assume DynamoDB either lets the last write win or has a scheme similar to BigTable, using timestamps for each attribute.

Writes don't allow you to specify something like a quorum, telling DynamoDB how consistent you'd like the write to be, it seems to be up to the system to decide when and how quickly replication to other datacenters is done. Alex Popescu's summary on DynamoDB and Werner Vogels' introduction suggest that writes are replicated …

paperplanes.de Read
  Source Favicon
On paperplanes over 2 years ago.
Email

…around this, even with a range-based key location. HBase (and Google's BigTable, for that matter) stores ranges of data in separate tablets. As tablets grow beyond their maximum size, they're split up and the remaining parts re-distributed. The advantage of this is that the original range is kept, even as you scale up.

Consistent Hashing Enables Partitioning

When you have a consistent hash, everything looks like a partition. The idea is simple. Consistent hashing forms a keyspace, …

paperplanes.de Read
  Source Favicon
By techarch of The "Tech. Arch." almost 4 years ago.
Email

such as SimpleDB, BigTable, Cassandra, CouchDB, and MongoDB .

I recommend a few excellent podcasts on Cassandra , CouchDB and MongoDB to get a sense of what this is all about.

Recently, MongoDB has received a lot of attention due to the following factors:

availability on many platforms

rich language support: C, C++, C#, Java, Javascript, Perl, PHP, Python, Ruby

binary json for efficient storage

equivalent of …

blog.monnet-usa.com Read
  Source Favicon
By Trevor Turk of Trevor Turk 4 years ago.
Email

Google and Amazon's broad use of their non-relational BigTable and Dynamo systems. We evaluated all the usual open source NoSQL suspects. After considerable debate, we decided to go with Cassandra.

News flash

We don't deserve anything. Publishers can do whatever they want. If you don't like it, don't send them nasty emails or browse their sites with ad-blockers: just don't support them. Don't read their content, don't link to them, and …

almosteffortless.com Read