Comments on: Performance Fireworks: Microsoft Fast Fizzles, Google Explodes http://arnoldit.com/wordpress/2009/07/04/performance-fireworks-microsoft-fast-fizzles-google-explodes/ by Stephen E. Arnold Sun, 21 Mar 2010 18:57:31 +0000 http://wordpress.org/?v=2.9 hourly 1 By: Vic Nathan http://arnoldit.com/wordpress/2009/07/04/performance-fireworks-microsoft-fast-fizzles-google-explodes/comment-page-1/#comment-70899 Vic Nathan Fri, 25 Sep 2009 15:53:52 +0000 http://arnoldit.com/wordpress/?p=6963#comment-70899 FAST QPS pertains to Enterprise Search whereas the Google Search QPS you cite pertains to, presumably, Google.Com, which is internet search. You ought to know better than to compare these two types of searches as if they are the same. Also, you should know better that any performance comparisons of just some QPS numbers is meaningless without ensuring that the hardware, workload and dataset used are comparable. In my view, you have lost all credibility as a search analyst. Please stop misleading folks. FAST QPS pertains to Enterprise Search whereas the Google Search QPS you cite pertains to, presumably, Google.Com, which is internet search. You ought to know better than to compare these two types of searches as if they are the same. Also, you should know better that any performance comparisons of just some QPS numbers is meaningless without ensuring that the hardware, workload and dataset used are comparable.

In my view, you have lost all credibility as a search analyst. Please stop misleading folks.

]]> By: Peter Petley http://arnoldit.com/wordpress/2009/07/04/performance-fireworks-microsoft-fast-fizzles-google-explodes/comment-page-1/#comment-58950 Peter Petley Sun, 05 Jul 2009 23:26:48 +0000 http://arnoldit.com/wordpress/?p=6963#comment-58950 I suspect this whole thing is an misunderstanding. I'm an Enterprise Search Consultant for a Fast / MS Partner and have worked on a varierty of ESP Projects. We've thrown over 100 QPS to a 4 node install during performance testing so 20 QPS is not a problem. What I think the presentation means is If you need a guaranteed 20 QPS with a sub second response time that Fast ESP is a better solution than the standard Sharepoint Search. QPS for all vendors varies on hardware, data and complexity of the query etc. In fact here's a write up which mentions 1500 qps. http://www.espen.com/archives/2009/02/fast_forward_20.html. Regards Pete I suspect this whole thing is an misunderstanding. I’m an Enterprise Search Consultant for a Fast / MS Partner and have worked on a varierty of ESP Projects. We’ve thrown over 100 QPS to a 4 node install during performance testing so 20 QPS is not a problem.

What I think the presentation means is If you need a guaranteed 20 QPS with a sub second response time that Fast ESP is a better solution than the standard Sharepoint Search.

QPS for all vendors varies on hardware, data and complexity of the query etc.

In fact here’s a write up which mentions 1500 qps. http://www.espen.com/archives/2009/02/fast_forward_20.html.

Regards

Pete

]]> By: irrelevant http://arnoldit.com/wordpress/2009/07/04/performance-fireworks-microsoft-fast-fizzles-google-explodes/comment-page-1/#comment-58854 irrelevant Sun, 05 Jul 2009 03:23:31 +0000 http://arnoldit.com/wordpress/?p=6963#comment-58854 This might be the case of geese and too much power point. The product sheet for Goog appliance http://googleenterprise.blogspot.com/2009/02/google-search-appliance-providing.html list 300 (++ for higher end) queries per minute. Assuming even distribution that gives you 50 queries/sec. Even if this topic is strictly about product sheet/ppt acrobatics based query benchmarking assume any system (from lucene to google to fast and autonomy) can demonstrate triple digit qps performance. This might be the case of geese and too much power point. The product sheet for Goog appliance http://googleenterprise.blogspot.com/2009/02/google-search-appliance-providing.html list 300 (++ for higher end) queries per minute. Assuming even distribution that gives you 50 queries/sec. Even if this topic is strictly about product sheet/ppt acrobatics based query benchmarking assume any system (from lucene to google to fast and autonomy) can demonstrate triple digit qps performance.

]]> By: Fireworks | All Days Long http://arnoldit.com/wordpress/2009/07/04/performance-fireworks-microsoft-fast-fizzles-google-explodes/comment-page-1/#comment-58769 Fireworks | All Days Long Sat, 04 Jul 2009 11:52:37 +0000 http://arnoldit.com/wordpress/?p=6963#comment-58769 [...] Performance Fireworks: Microsoft Fast Fizzles, Google Explodes … By Stephen E. Arnold News and Information from ArnoldIT.com about Search and Content Processing. Beyond Search – http://arnoldit.com/wordpress/ [...] [...] Performance Fireworks: Microsoft Fast Fizzles, Google Explodes … By Stephen E. Arnold News and Information from ArnoldIT.com about Search and Content Processing. Beyond Search – http://arnoldit.com/wordpress/ [...]

]]>