Loading ...
Sorry, an error occurred while loading the content.
 

Re: Beta Testing For Usability?

Expand Messages
  • doug.gorman@rocketmail.com
    Thanks, Kaleb. I ve recently found some great articles on A/B testing and it s use in product and usability development. This was an excellent one:
    Message 1 of 5 , Nov 5, 2009
      Thanks, Kaleb. I've recently found some great articles on A/B testing and it's use in product and usability development.

      This was an excellent one: http://blog.mixpanel.com/ab-testing-to-increase-user-engagement

      I definitely think we'll try this approach.

      --- In agile-usability@yahoogroups.com, Kaleb Pederson <kaleb.pederson@...> wrote:
      >
      > On Mon, Nov 2, 2009 at 12:58 PM, doug.gorman@...
      > <doug.gorman@...> wrote:
      > > Hello, everyone!
      > >
      > > We're about to roll out a few applications to a beta test group and I was wondering what techniques you've all used to get useful feedback about usability during beta test phases.
      >
      > Nice question.
      >
      > > Have you used other approaches or techniques during betas to get great "real world" feedback on usability? What techniques had the highest yield?
      >
      > Depending on the type of application, a true real-world indicator of
      > the effectiveness of various UI changes would be to A/B test them
      > (http://en.wikipedia.org/wiki/A/B_testing). Assuming you're working
      > with a web application, you should be able to send a certain
      > percentage of users (possibly pre-screened and filtered) through the
      > beta page(s) to determine the overall affect on the target metrics. If
      > a single change positively effects the target metrics, like conversion
      > or lead generation, then it's probably a good change and likely makes
      > the application more usable.
      >
      > --
      > Kaleb Pederson
      >
      > Blog - http://kalebpederson.com
      > Twitter - http://twitter.com/kalebpederson
      >
    Your message has been successfully submitted and would be delivered to recipients shortly.