…onboard memory is added to the globally coherent cache, and it's CPU is available to help process I/O operations. All in about a minute. It's pretty awesome stuff, and we had fun testing these features in our datacenter when we were deploying it.
For now, we continue to use Amazon S3 as a backup, but we intend to replace it with a second Isilon cluster in a secondary datacenter which we'll keep in sync via replication within the next several months.
- Trevor Turk: Weekly Digest, 8-10-09
- GIANT ROBOTS SMASHING INTO OTHER GIANT ROBOTS: Big Bang
- till's blog: Shopping for a CDN
- Dalibor Nasevic: Using Amazon S3 in Rails Applications
- : High Quality Ruby on Rails Example Applications
- Alexey Kovyrin's Blog: Nginx-Fu: X-Accel-Redirect From Remote Servers
Amazon S3 for user-uploaded assets like photos and documents
Memcached for temporary counters and rendered HTML
Polyglot persistence also makes it easy to dip your toes into NoSQL. Don't migrate your existing production data - instead, use one of these new datastores as a supplementary tool. (Example: put non-critical session data or stats into Redis or Tokyo Tyrant.) And if you're starting on a new app, you should give serious consideration to NoSQL options for your …
- Vineet Gupta | Computer Programmer: NoSql Databases - Part 1 - Landscape
- Viget Extend : The Development Lab: Around "Hello World" in 30 Days
- paperplanes: Relational Data, Document Databases and Schema Design
- Engine Yard Ruby on Rails Blog: Key-Value Stores in Ruby: The Wrap Up
- Developing with Style: Handling Dates in MongoDB
- igvita.com: Flow Analysis & Time-based Bloom Filters
…"Currently, I'm working on migrating a large amount of assets from a server-based file system to Amazon S3. It's a very involved integration but I love it because I'm solving a real problem. My engineering skills are very useful in this situation." He believes in taking small steps when he's programming, and he is extremely methodical; "Change one variable at a time and look at the results. Then you can have meaningful comparisons. As programmers, a lot of times …
- RubyLearning Blog: RPCFN: Mazes (#5)
- OmniNerd: Corporate Responsibility to Employee vs Customer
This code takes pics from your camera that have been dumped to your hard drive, but not reformatted for the Web in terms of pixels or dpi, resizes them, re-dpis them, and uploads them to Amazon S3. Note that the size is pretty damn arbitrary .
convert is the ImageMagick command-line utility; amazon ships with my utility_belt gem.
- Trevor Turk: Weekly Digest, 9-11-09
- A Fresh Cup: My Tools of the Trade - 2009
- Dalibor Nasevic: Using Amazon S3 in Rails Applications
- Heroku: Gemcutter's Adventure on Heroku
- Tammer Saleh: Bushido
- Rails Envy » Home: Rails Envy Podcast - Episode #094: 10/02/2009
…unified API . It deals with both server cloud and storage based services and supports Amazon S3 and Rackspace Files; as well as servers and on Amazon EC2 , Rackspace Servers, Terremark vCloud and Slicehost. Support is also available for Amazon ELB and SimpleDB.
The beauty of fog is how the same code interacts with different cloud services. It uses models, an idea familiar to anyone who has used an object mapper (like ActiveRecord), to abstract the common parts between …
- How Software is Built: Interview with Brian Gentile - CEO of Jaspersoft
- Opscode Blog: Chef Training Class in Seattle 4/26/2010
- RailsLab: Episode #21 - On The Edge - Part 3
- Dead Programmer Society: Configuring Hybrid Ruby on Rails Applications On EY-Cloud
- Software by Rob: Work Less, Get More Done, Convenient Open Source, What a Startup is Really Like, and more...
- till's blog: Thoughts on RightScale
Amazon S3
Why do I consider S3 to be a pseudo CDN. Well, for starters — Amazon S3 is not distributed.
By nature, it shouldn't be used as a CDN. The problem is though that many people still do. Take a look at Twitter and think twice why a page takes so long to load (and the avatars are always last). There's your answer.
In order to be fair — Twitter also sometimes switches to Cloudfront (216.137.61.222) (or Akamai (213.248.124.139)?). I haven't really figured …
- : Make Your Websites Load Faster With Cloud Files CDN
- High Scalability: Strategy: Caching 404s Saved the Onion 66% on Server Time
- Litany Against Fear: Riding Rails at the New York Times Notes
- Idle Process: Harsha Madhyastha and Colleagues Win Best Paper Award
- Ruby Inside: Interesting Ruby and Rails Tidbits #31
- matt-darby.com posts: Capistrano task to auto upload assets to S3
Amazon recently announced their new storage service, Reduced Redundancy Storage ( RRS). We are pleased to introduce a new storage option for Amazon S3 called Reduced Redundancy Storage ( RRS) that enables customers to reduce their costs by storing non-critical, reproducible data at lower levels of redundancy than the standard storage of Amazon S3. It provides a [...]
- Topics: Amazon.com
Arq is an easy to use backup app that stores your files on Amazon S3. It's not perfect (yet), but I love it.
Acorn is great for simple image editing. Adium is for chat. Colloquy is for irc.
Of course I use Dropbox .
Fluid is great for making websites into standalone apps. You can make one for Gmail and set that to be your default maito client. Highly recommended.
Gitx is a good git gui for looking through changesets …
- saladwithsteve: My first Thrift app
- Meta Bates: Twitter Weekly Updates for 2009-12-13
- Daddy Fixes Everything: iPhoto AppleScript to Remove Duplicates
- A Fresh Cup: Double Shot #646
- Developing with Style: inType: A Windows alternative to Textmate?
- Luigi Montanez: Engine Yard Express: A Production Slice on Your MacBook Pro
…. (I also hear praise for the NERDtree plugin from people who use vim more than I do.) Overall, though, I think Ben's screencast is a nice bit of training, and certainly goes deeper than the average 5-minute Railscast. Peepcode has a great little screencast on emacs , but nothing on vim so far.
Ben also created a video on how to use Amazon S3 in a Rails app, and I'll be reviewing that soon.
- Andrzej on Software: Andrzej's Rails tips #5
- zerosum dirt(nap) - Home: Railsconf 2009 Recap
- Litany Against Fear: Professional Ruby Conference Notes
- Daddy Fixes Everything: Authlogic - Rails Authentication Done Right
- Viget Extend : The Development Lab: Viget Devs Storm Chicago
Provide Heroku with your Amazon S3 keys: heroku config:add s3_access_key_id=YOUR_ID s3_secret_access_key=YOUR_KEY
Run the cron Rake task manually, for testing purposes: heroku rake cron
If all goes well, a new private bucket named APP NAME-heroku-backups will be created and will contain a backup file named APP NAME-YEAR-MONTH-DAY-HOURMINUTESECOND.dump .
Confirm that the backups are working by downloading the archive and attempting to reload it into a freshly created database: createdb …
- Heroku: Our travels continue
- DigitalHobbit: Rails in the Cloud: AWS, Heroku, and Morph
- Tender Lovemaking: Full Text Search on Heroku
- All About Ruby: Hosting your Rails app - first look at Heroku
- Andrzej on Software: Andrzej's Rails tips #7
- Rail Spikes - Home: Bundler and I are breaking up