Announcing Our Beginning Ember.js Workshop in Boston

Learn how to write Ember applications with our Beginning Ember.js workshop in Boston.

EC2 CPU benchmark: Fastest instance type (serial performance)

July 25, 2011

Update: This post is still relevant for build servers, but it turns out that at the moment EC2 does not give you a serial speed advantage over most modern laptops. Run the loop below on your laptop if you don’t believe me.

I sometimes use EC2 spot instances to run my test suite. To figure out which instance type to use, I ran a quick benchmark. I mostly care about serial performance, not the number of cores, which left me with the following contenders (prices are hourly for spot instances):

m1.large / $0.12 / “Large”
2 x 2 EC2 Compute Units; here: 2 cores of Intel Xeon E5507 @ 2.27GHz
m2.xlarge / $0.17 / “High-Memory Extra Large”
2 x 3.25 EC2 Compute Units; here: 2 cores of Intel Xeon X5550 @ 2.67GHz
c1.medium / $0.06 / “High-CPU Medium” [32-bit]
2 x 2.5 EC2 Compute Units; here: 2 cores of Intel Xeon E5410 @ 2.33GHz
c1.xlarge / $0.24 / “High-CPU Extra Large”
8 x 2.5 EC2 Computer Units; here: 2 cores of Intel Xeon E5506 @ 2.13GHz
cc1.4xlarge / $0.56 / “Cluster Compute Quadruple Extra Large”
total 33.5 (I assume 16 x 2.1) EC2 Compute Units on two Intel Xeon X5570 @ 2.93GHz

I ran two benchmarks. First, the following loop:

1	`time for i in {0..10000}; do for j in {0..1000}; do :; done; done`

Second, my Rails app’s test suite, with Selenium on a headless X server, unparallelized.

Here are the timings:

Instance Type   Loop (sec)   Test suite (sec)
m1.large        47           79
m2.xlarge       28           51
c1.medium       45           67
c1.xlarge       37           63
cc1.4xlarge     27           64

Conclusion

The result seems pretty clear: For serial computation, the high-memory instances (m2.xlarge and above) are the fastest.

(This of course is not because of the RAM, but because their CPUs happen to have the highest serial computation power, as you might expect from the EC2 Compute Unit count provided by Amazon.)

Notes

The timings came back with +/- 1 on the loop, and +/- 2 on the test suite, so at this point I am reasonably confident in the results.
Just to make sure, I launched an m2.4xlarge instance, and as expected, it has the same CPU model and the same timings as m2.xlarge. The only difference is that it comes with 8 cores instead of 2.
I’m not sure why the cluster-compute instance (cc1.4xlarge) is so slow on my test suite, compared to the loop. I launched two different instances, in case I had a “bad apple”, and both came out the same. Perhaps it’s some weird timing issue in my test. But I think more likely, the CPUs in the cluster-compute instances just happen to be very good at this particular loop. (Unlike the loop timings, the slower test suite timing is in line with what you might expect from Amazon’s EC2 Compute Unit count.)
All benchmarks were run on the official Ubuntu 11.04 AMIs, 32-bit for c1.medium, 64-bit for the rest, with EBS for the cc1.4xlarge instance and instance storage for the rest.

[…]

Heap Overflow in YAML URI Escape Parsing (CVE-2014-2525)

March 29, 2014

There is an overflow in URI escape parsing of YAML in Ruby. This vulnerability has been assigned the CVE identifier CVE-2014-2525.

Details

Any time a string in YAML with tags is parsed, a specially crafted string can cause a heap overflow which can lead to arbitrary code execution.

For example:

YAML.load <code_from_unknown_source>

Affected Versions

Ruby 1.9.3-p0 and above include psych as the default YAML parser. Any versions of psych linked against libyaml <= 0.1.5 are affected.

And, these versions of Ruby bundle an affected version of libyaml:

Ruby 2.0.0-p451 and earlier,
Ruby 2.1.0 and Ruby 2.1.1.

You can verify the version of libyaml used by running:

$ ruby -rpsych -e 'p Psych.libyaml_version'
[0, 1, 5]

Solutions

Users who install libyaml to the system are recommended to update libyaml to 0.1.6. When recompiling Ruby, point to the newly updated libyaml:

$ ./configure --with-yaml-dir=/path/to/libyaml

Users without a system libyaml rely on the embedded libyaml and are recommended to update psych to 2.0.5 which vendors libyaml 0.1.6:

$ gem install psych

or, update your Ruby to 2.0.0-p481, 2.1.2 or newer.

History

Originally published at 2014-03-29 01:49:25 UTC
Update published at 2014-03-29 09:37:00 UTC
Update published at 2014-05-09 03:00:00 UTC

Posted by hone and zzak on 29 Mar 2014

[…]

The Ruby Rails Aggregator