Comments on: Why no TPC benchmarks for MySQL? http://www.xaprb.com/blog/2012/03/07/why-no-tpc-benchmarks-for-mysql/ Stay curious! Mon, 13 May 2013 05:55:40 +0000 hourly 1 http://wordpress.org/?v=3.5.1 By: Xaprb http://www.xaprb.com/blog/2012/03/07/why-no-tpc-benchmarks-for-mysql/#comment-19931 Xaprb Wed, 14 Mar 2012 11:14:34 +0000 http://www.xaprb.com/blog/?p=2651#comment-19931 Right, MySQL isn’t at all qualified for TPC-H. Percona ran TPC-H for Kickfire back in the days when they wanted external validation and testing. It ran well on Kickfire (though that was essentially the only thing that would run at all on it) but of course it would never complete on vanilla MySQL.

]]> By: Michael Mior http://www.xaprb.com/blog/2012/03/07/why-no-tpc-benchmarks-for-mysql/#comment-19929 Michael Mior Wed, 14 Mar 2012 03:31:56 +0000 http://www.xaprb.com/blog/?p=2651#comment-19929 After trying to run TPC-H benchmarks on MySQL, it seems MySQL isn’t quite ready. Some of the queries wouldn’t even run as written (this is after fixing minor syntactic differences). I recall one query running through the optimizer for a couple hours before even starting execution.

]]> By: Charles Levine http://www.xaprb.com/blog/2012/03/07/why-no-tpc-benchmarks-for-mysql/#comment-19914 Charles Levine Thu, 08 Mar 2012 22:38:06 +0000 http://www.xaprb.com/blog/?p=2651#comment-19914 Could it be that MySQL performance isn’t good enough to be competitive? Almost all results are published by hardware vendors. MySQL doesn’t have a DeWitt-clause, so any hardware vendor is free to use it. I doubt there’s a lack of interest. And there’s an obvious price advantage to using MySQL. And yet, the hardware companies predominately choose to use SQL Server for TPC benchmarks (and Oracle and DB2 to a much lesser extent). By Occam’s razor, the answer is that MySQL isn’t fast enough to win TPC benchmarks.

]]> By: Mark Grennan http://www.xaprb.com/blog/2012/03/07/why-no-tpc-benchmarks-for-mysql/#comment-19903 Mark Grennan Wed, 07 Mar 2012 21:57:44 +0000 http://www.xaprb.com/blog/?p=2651#comment-19903 And it is ESPENSIVE! I don’t think TPC matters. I think they are an out of date standard. You can’t expect to get their results with your code and your hardware will not match theirs. (to many BIOS and patch level)

I do think it’s time to discuss what kinds of standards we should keep. Is MySQL really getting faster or is it just the hardware? (one systems many version of MySQL)

]]>