CHI-WEB Archives

ACM SIGCHI WWW Human Factors (Open Discussion)

CHI-WEB@LISTSERV.ACM.ORG

Options: Use Forum View

Use Proportional Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
Kay Corry Aubrey <[log in to unmask]>
Reply To:
Kay Corry Aubrey <[log in to unmask]>
Date:
Mon, 5 Jun 2006 15:42:08 -0400
Content-Type:
text/plain
Parts/Attachments:
text/plain (65 lines)
Hi Rolf - I am investigating these technologies for background information.
I have not done this type of study myself, so I have no direct experience
with this type of approach. However, it sounds promising.

I have read several articles that lead me to think remote unattended testing
can provide valid & valuable feedback, if the study design and sample
selection are sound. 

Here's one article worth reading on the subject: " An Empirical Comparison
of Lab and Remote Usability Testing of Web Sites" by Tullis, T. S.,
Fleischman, S., McNulty, M., Cianchette, C., and Bergel, M. (2002) Usability
Professionals Association Conference, July 2002, Orlando, FL. (You can get a
.pdf of the article on http://members.aol.com/TomTullis/prof.htm) 

The Fidelity team ran two sets of the same test: one in the lab and the
other using remote unattended techniques. While the remote unattended was
misses the information you get from watching a live user, it offered other
advantages: you can run many more users so you get a wider diversity of
responses, people's comments tended to be very rich and objective, you can
collect other measures more easily such as clickstream, time on task. 

Ron Perkins of Design Perspectives in Newburport, MA has also written
extensively on remote unattended testing. I don't have quick access to his
papers, but you could probably find his work in the ACM Digital Library. 

Kay



-----Original Message-----
From: Rolf Molich [mailto:[log in to unmask]] 
Sent: Monday, June 05, 2006 3:01 PM
To: Kay Corry Aubrey; [log in to unmask]
Subject: Re: remote unattended (AKA automated) usability testing software

Hi Kay.

I teach my students that they should be very careful with unattended 
usability testing - for various reasons that I consider excellent.

I found your survey interesting because I assume that you would hardly ask 
for tools that support a method that you don't believe in.

So my question is: What data do you have to support the claim that this 
method produces useful results?


Thanks, Rolf

Rolf Molich
DialogDesign
Skovkrogen 3
DK-3660 Stenlose
Denmark

www.DialogDesign.dk     [log in to unmask]     +45 4717 1731

    --------------------------------------------------------------
        Tip of the Day: Email mailto:[log in to unmask]
               with any comments, questions or problems
     CHI-WEB: www.sigchi.org/web POSTINGS: mailto:[log in to unmask]
              MODERATORS: mailto:[log in to unmask]
       SUBSCRIPTION CHANGES & FAQ:  www.sigchi.org/web/faq.html
    --------------------------------------------------------------

ATOM RSS1 RSS2