Re: Methodology for assessing results from multiple search engines?
Thanks for the wonderful summary. We've already selected a vendor, what we are using this for is to improve the usability of the presentation and confirm enhancements. There are lot of people out there that quote hearsay or have a predetermined solution in mind. Your example was perfect...
Google is Cuter: Or, "brand names work". One of our Ultraseek customers did a blind kitten war test between Ultraseek and Google. Ultraseek was preferred 75% of the time. Some executive found this hard to believe and asked that they try it again with the logos attached to the pages. The second time, people preferred Google over half the time.
Thanks for the summary again - I will use some of your ideas in good health. Have virtual coffee on me.
--- In SearchCoP@yahoogroups.com, Walter Underwood <wunderwood@...> wrote:
> I finally got around to writing up my comments on A/B testing for evaluating
> search engines. See my post on ³kitten war² testing:
- Yes, thanks, Walter. :-)
In case anyone's interested, I've written up my previous post (in
response to Crystal) about a methodology for evaluating search engines
I also ended up putting together a set of requirements groupings that
one might consider in doing an evaluation of search engines as a
follow-up to the above post (and because a former co-worker of mine
happened to ask me that question recently):
Hopefully, of some use to someone out there :-)
I point to your post, Walter, when discussing the known issues with
the particular way I went about doing my own evaluation, so thanks for
writing that up.
On Wed, Sep 17, 2008 at 10:26 AM, Jim <jim.smith@...> wrote:
> Thanks for the wonderful summary. We've already selected a vendor, what we
> are using this for is to improve the usability of the presentation and
> confirm enhancements. There are lot of people out there that quote hearsay
> or have a predetermined solution in mind. Your example was perfect...