Comments on: Benchmarking the cloud: not simple http://www.netuality.ro/benchmarking-the-cloud-not-simple/datacenter/20100118 Taming the big, bad, nasty websites Mon, 01 Feb 2010 07:06:08 +0000 http://wordpress.org/?v=2.9 hourly 1 By: Adrian http://www.netuality.ro/benchmarking-the-cloud-not-simple/datacenter/20100118/comment-page-1#comment-627 Adrian Mon, 01 Feb 2010 07:06:08 +0000 http://www.netuality.ro/?p=155#comment-627 Hi Matthew, thank you for visiting my blog and for commenting. Here's my point. While not I/O intensive, the kernel compilation still needs to fetch a reasonably large amount of sources from the disk and write back different compilation artifacts in the process. Therefore, a slow disk [especially a very slow one] can skew the results -> kernel compilation is not 100% relevant as a CPU benchmark. Couldn't find the exact point where I said it's "I/O intensive" in my article, can you please point the erroneous phrase so I can fix it? Please also note I'm just aggregating data from different sources, so you may want to consider these statements as pertaining to their respective authors, not to *me*. Please feel free to come up with more relevant information and point to the place where we could see the "more accurate" data you are referring to. I would appreciate in the future if you could avoid ad hominem attacks and stick to the facts! Thanks. Hi Matthew, thank you for visiting my blog and for commenting. Here’s my point.

While not I/O intensive, the kernel compilation still needs to fetch a reasonably large amount of sources from the disk and write back different compilation artifacts in the process. Therefore, a slow disk [especially a very slow one] can skew the results -> kernel compilation is not 100% relevant as a CPU benchmark. Couldn’t find the exact point where I said it’s “I/O intensive” in my article, can you please point the erroneous phrase so I can fix it?

Please also note I’m just aggregating data from different sources, so you may want to consider these statements as pertaining to their respective authors, not to *me*.

Please feel free to come up with more relevant information and point to the place where we could see the “more accurate” data you are referring to.

I would appreciate in the future if you could avoid ad hominem attacks and stick to the facts! Thanks.

]]>
By: Matthew http://www.netuality.ro/benchmarking-the-cloud-not-simple/datacenter/20100118/comment-page-1#comment-626 Matthew Sun, 31 Jan 2010 12:33:25 +0000 http://www.netuality.ro/?p=155#comment-626 You are wrong, kernel compilation is not I/O intensive. You might want to be qualified in computing before spreading inaccurate assumptions and revealing your ignorance in the matter. In many cases EBS will get worse performance than local instance storage for disk I/O. Not to mention, the GeekBench folks were not using industry standard utilities, but their own in-house benchmarking utility. The validity of a software benchmark called GeekBench that is supposedly cross-platform should be questioned. Scheduling and device drivers work differently across operating systems. The amount of inaccuracy in your assessment probably means that you shouldn't make them, at least until you get a little more experience with the field. You are right about one thing though, benchmarking the cloud is not simple. You are wrong, kernel compilation is not I/O intensive. You might want to be qualified in computing before spreading inaccurate assumptions and revealing your ignorance in the matter.

In many cases EBS will get worse performance than local instance storage for disk I/O.

Not to mention, the GeekBench folks were not using industry standard utilities, but their own in-house benchmarking utility. The validity of a software benchmark called GeekBench that is supposedly cross-platform should be questioned. Scheduling and device drivers work differently across operating systems.

The amount of inaccuracy in your assessment probably means that you shouldn’t make them, at least until you get a little more experience with the field. You are right about one thing though, benchmarking the cloud is not simple.

]]>