CHI-WEB Archives

ACM SIGCHI WWW Human Factors (Open Discussion)


Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Kay Corry Aubrey <[log in to unmask]>
Reply To:
Kay Corry Aubrey <[log in to unmask]>
Mon, 5 Jun 2006 15:42:08 -0400
text/plain (65 lines)
Hi Rolf - I am investigating these technologies for background information.
I have not done this type of study myself, so I have no direct experience
with this type of approach. However, it sounds promising.

I have read several articles that lead me to think remote unattended testing
can provide valid & valuable feedback, if the study design and sample
selection are sound. 

Here's one article worth reading on the subject: " An Empirical Comparison
of Lab and Remote Usability Testing of Web Sites" by Tullis, T. S.,
Fleischman, S., McNulty, M., Cianchette, C., and Bergel, M. (2002) Usability
Professionals Association Conference, July 2002, Orlando, FL. (You can get a
.pdf of the article on 

The Fidelity team ran two sets of the same test: one in the lab and the
other using remote unattended techniques. While the remote unattended was
misses the information you get from watching a live user, it offered other
advantages: you can run many more users so you get a wider diversity of
responses, people's comments tended to be very rich and objective, you can
collect other measures more easily such as clickstream, time on task. 

Ron Perkins of Design Perspectives in Newburport, MA has also written
extensively on remote unattended testing. I don't have quick access to his
papers, but you could probably find his work in the ACM Digital Library. 


-----Original Message-----
From: Rolf Molich [mailto:[log in to unmask]] 
Sent: Monday, June 05, 2006 3:01 PM
To: Kay Corry Aubrey; [log in to unmask]
Subject: Re: remote unattended (AKA automated) usability testing software

Hi Kay.

I teach my students that they should be very careful with unattended 
usability testing - for various reasons that I consider excellent.

I found your survey interesting because I assume that you would hardly ask 
for tools that support a method that you don't believe in.

So my question is: What data do you have to support the claim that this 
method produces useful results?

Thanks, Rolf

Rolf Molich
Skovkrogen 3
DK-3660 Stenlose
Denmark     [log in to unmask]     +45 4717 1731

        Tip of the Day: Email mailto:[log in to unmask]
               with any comments, questions or problems
     CHI-WEB: POSTINGS: mailto:[log in to unmask]
              MODERATORS: mailto:[log in to unmask]