I am very excited to announce that your Engine Yard Cloud account can provision new environments in an Australia datacenter. This is in part thanks to our infrastructure provider Amazon, and part due to the quick work by our Engine Yard engineers to add and test the new region.
We already had regions in Singapore, Japan and West Coast USA so why is a region in Australia/ New Zealand so exciting? It solves the pesky speed of light problem with respect to latency, in a manner of speaking. Why is latency an issue?
- New Relic: Meet Our Engineers: Graham Dumpleton, Senior Software Engineer for the Python Agent
- MySQL Performance Blog: linux.conf.au 2012 roundup
- Dr Nic: Coming to America
- World Wide Webber: Powdah!
- Bamboo Blog: Snake Game using HTML5 Canvas tag
- Smile, Breath and Keep trying: They say the first post is the hardest
3 nodes in one datacenter. Writes were only done on a single node. The cluster contained the tuning: wsrep_provider_options = "gcs.fc_limit = 256; gcs.fc_factor = 0.99; gcs.fc_master_slave = yes"
based on Codership's recommended tuning for single-node writing. I was running wsrep_slave_threads=16 and all other required wsrep settings.
Also note that I disabled log-bin and innodb_support_xa on these nodes.
XtraDB Cluster 2-colo
Just like PXC 1-colo, except …
- MySQL Performance Blog: Is Synchronous Replication right for your app?
If you are interested in future foward OS designs then you might find Akaros worth a look. It's an operating system designed for many-core architectures and large-scale SMP systems, with the goals of:
Providing better support for parallel and high-performance applications
Scaling the operating system to a large number of cores
A more indepth explanation of the motiviation behind Akaros can be found in Improving Per-Node Efficiency in the Datacenter with NewOS Abstractions …
Among all the different technologies in our stack, we also use MySQL. While we still run MySQL (or Percona-Server) ourselves, we selected a managed solution to power parts of our production infrastructure: a Multi-AZ setup with Amazon's RDS.
AZ is Amazon-speak for "availability zone", essentially a datacenter. RDS stands for: Relational Database Service.
Judging from my experience with our own setups where EBS is in the mix, I have to say that Amazon does an …
- Zerosum Dirt(nap): Better AWS Access Control with IAM (and Fog)
- Headius: JRuby on Rails on Amazon Elastic Beanstalk
- High Scalability: Retrospect on recent AWS outage and Resilient Cloud-Based Architecture
- RubyLearning Blog: How Can We Develop For Tomorrow's Needs?
- Engine Yard Developer Blog: AWS Multi-Region Support in Alpha
- Opscode Blog: Chef 0.10.0 Released!
… Cade Metz interviews Google's guru of the datacenter, Luiz André Barroso: delivering good Internet service requires designing the software and hardware of entire datacenter to work together as one computer; split application pieces across an array of computers; modesty is key, select modest machines with modest processors and spread applications as thin as possible; wimpy cores won't process work fast enough to be useful, that's too thin. To read much more the Internet…
1. DATACENTER MIGRATION
How the conversion affects your slice will depend on its datacenter.
You can see your slice's datacenter by going into the SliceManager , clicking on the slice for more details, and then checking the " Datacenter" entry at the end of the detail list.
If the datacenter does not begin with " STL" your slice will not be migrated anywhere and the conversion will involve no downtime. Slices in DFW and ORD are already in a Rackspace datacenter…
- : Simple Load Balancing on Cloud Servers
- Brightbox Ruby Blog: Cloud Balancers now available in beta!
- High Scalability: Sponsored Post: Undertone, Box.net, Wiredrive, Joyent, DeviantART, CloudSigma, ManageEngine, Site24x7
- Zen and the Art of Programming: Who is accessing your Gmail account?
- Heroku: The New Heroku (Part 4 of 4): Erosion-resistance & Explicit Contracts
Retail uses VPC. VPC makes AWS look just like your own datacenter.
November 10, 2010 is when they turned off the last frontend server not using AWS. All traffic for amazon.com is now served from AWS.
They've had billions of orders over the lifetime of amazon.com.
Amazon has taken really old orders out of the database and moved them into S3.
They use Oracle.
Be sure to consider compliance issues.
When moving to the cloud, start with simple applications (or …
- Merbist: Causality of scalability
- High Scalability: Scaling an AWS infrastructure - Tools and Patterns
- New Relic: New Relic offers proven application performance management for AWS Elastic Beanstalk
- Ruby Inside: How to Cure Net::HTTP's Risky Default HTTPS Behavior
- AkitaOnRails.com - English: QCon Special - Signing Off
- paperplanes: Be Humble, and Get Shit Done!
…running all of the above on a single machine, or across a large cluster of servers within your own datacenter.
Distributed Systems with Ruby? Yes!
Building a distributed system with as many moving components as CloudFoundry is no small feat, and it is really interesting to see that the team behind it chose Ruby as the platform of choice. If you look under the hood, you will find Rails, Sinatra, Rack, and a lot of EventMachine code. If you ever wondered if Ruby is a viable …
- Yan Pritzker: What cloud computing is NOT
- Bamboo Blog: Integrating Pusher Into a Complex App in One Day
- codahale.com: When Formality Works
- Merbist: Ruby concurrency explained
- New Relic: Free PHP app performance monitoring for PHP Fog customers. We
- The messagepub Blog: How-To: Rack Middleware for API Throttling
…performance, the actual storage (in GB) and the throughput which Amazon charges for. In real a datacenter SAS disks are also more expensive than those crappy 7500 rpm SATA(-II) disks.
Partitioning
When I say partitioning, I mean spreading out the various document types by database. So even though the great advantage of a document oriented database is to be able to have a lot of different data right next to each other, you should avoid that.
Because when your data grows, it's …
- Engine Yard Developer Blog: Key-Value Stores in Ruby: The Wrap Up
- Opscode Blog: Chef 0.6.0 Release
- How Software is Built: Interview with Damien Katz - Apache CouchDB
- paperplanes: 10 Annoying Things About CouchDB
- Me Dev, You Jane: The State of Me - Jan 2009
- Luigi Montanez: Starting Back Up
…state Technologies are Transforming MySQL Server Performance and the Datacenter Architectures
Author: Vadim Tkachenko
How to Fulfill the Potential of InnoDB Performance and Scalability
Author: Yasufumi Kinoshita
Innodb Architecure And Performance Optimization
Author: Peter Zaitsev
Instrumenting PHP applications
Author: Peter Zaitsev, Justin Swanhart
MySQL Graphing and Trending with Cacti
Author: Baron Schwartz…