ACM SIGCHI General Interest Announcements (Mailing List)


Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Condense Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
"ACM SIGCHI General Interest Announcements (Mailing List)" <[log in to unmask]>
Alexandros Paramythis <[log in to unmask]>
Sat, 5 Dec 2009 04:48:16 -0500
text/plain; charset="ISO-8859-1"
Alexandros Paramythis <[log in to unmask]>
text/plain (177 lines)
(Apologies if you receive this message multiple times)

                         CALL FOR PAPERS

                        Special Issue on
      Principled Design and Evaluation of Adaptive Systems

             User Modeling and User-Adapted Interaction:
               The Journal of Personalization Research
        (An international journal published by Springer Verlag)

              Web site:


Updates from the previous CFP:

* If you plan to submit a paper to the special issue, please
  contact the editors (umuai_specialissue at at your
  earliest convenience, to indicate your intention and the topic
  your submission will cover.

* A web site and a mailing list have been set up for discussing
  prospective contributions to this special issue. If you are
  interested in participating in the discussions, or just want
  to receive progress updates, please contact the editors
  (umuai_specialissue at


The importance and benefits of involving users in the design and
evaluation of adaptive systems have been advocated for a long time.
In fact, user studies have become an integral part of papers
published in the UMUAI journal, and indeed most papers published
in the major conferences in the area. Although this is most
definitely indicative of increasing maturity in the field, we are
far from having solved all related outstanding issues:

* Most papers report summative evaluations, aiming to establish
  the extent to which the use of an adaptation method has improved
  the system. Often more scientific insight can be gained from
  formative evaluations that inform and guide the development
  process of adaptive systems.

* Most papers report on a single evaluation activity, often
  assessing the system as a whole only. More principled and rigorous
  forms of evaluation are possible, in which different system layers
  or components are evaluated separately, and more is learned about
  what causes success (or, more importantly in some cases, failure).

* Certain success criteria have received a lot more attention than
  others. For example, for recommender systems, the focus has often
  been on recall and precision, rather than serendipity, privacy and
  trust. A more holistic approach to evaluation is needed, including
  the consideration of trade-offs between criteria. Metrics and
  methods for evaluating new criteria are also needed.

This special issue aims to create a new point of reference for the
evaluation of adaptive systems, bringing future evaluations to the
next level. Rather than just encouraging evaluation studies, the
goal of this special issue is to reflect the current body of
knowledge on evaluation methods and methodologies for different
types of user adaptive systems. We expect contributions will
address the following core categories:

* Papers describing novel methods that can be used for the user-
  centred design and formative evaluation of adaptive systems.

* Papers demonstrating the value and benefit of success criteria
  used in the evaluation of adaptive systems, validating concrete
  evaluation metrics, or considering trade-offs between different

* Papers describing frameworks for the principled design and
  evaluation of adaptive systems, that may provide guidance and
  serve as the theoretical underpinnings of future studies.

All papers in the issue will undergo stringent peer-review. Papers
proposing a new evaluation method, framework, or criteria will
need to validate these proposals, for example through case studies
and / or surveys.

Authors will be expected to position their work in relation to a
framework for the principled design and evaluation of adaptive
systems, which will be summarized by the editors in an
introductory article. This framework has been developed over the
course of several international workshops (for more informaton
see ) and preliminary material
for prospective contributors to the special issue has been made
available on the issue's web site (see ). To provide a coherent
point of reference, authors are also expected to cross-reference
their accepted submissions to each other, where applicable, in a
second round of editing.

Articles that describe a traditional global summative evaluation
of an adaptive system should be submitted to the regular track of
UMUAI rather than this special issue (contact the editors if in


Submissions to the special issue should follow the UMUAI
formatting guidelines and submission instructions available at:

Each submission should note that it is intended for the Special
Issue on Principled Design and Evaluation of Adaptive Systems.

Note! Potential authors are asked to submit a tentative title and
short abstract (which can be altered for the actual submission)
** at your earliest convenience ** to the special issue's editors
(umuai_specialissue at to assist in the formation of
a panel of appropriate reviewers, and facilitate discussions
amongst the prospective contributors.

UMUAI is an archival journal that publishes mature and
substantiated research results on the (dynamic) adaptation of
computer systems to their human users, and the role that a model
of the system about the user plays in this context. Many articles
in UMUAI are quite comprehensive and describe the results of
several years of work. Consequently, UMUAI gives "unlimited" space
to authors (so long as what they write is important). Authors
whose paper exceeds 40 pages in journal format (including
illustrations and references) are however requested to supply a
short justification upon submission that explains why a briefer
discussion of their research results would not be advisable.


* Deadline for submission of title and abstract: At your earliest
  convenience, and not later than January 4, 2010

* Deadline for paper submissions: February 1, 2010


Submissions will undergo the normal review process, and will be
reviewed by three established researchers selected from a panel of
reviewers formed for the special issue.  Barring unforeseen
problems, authors can expect to be notified regarding the review
results within three months of submission.


Stephan Weibelzahl
School of Computing
National College of Ireland Dublin
sweibelzahl at

Alexandros Paramythis
Institute for Information Processing and Microprocessor Technology (FIM)
Johannes Kepler University Linz
alpar at

Judith Masthoff
Computing Science
University of Aberdeen
j.masthoff at

                To unsubscribe, send an empty email to
     mailto:[log in to unmask]
    For further details of CHI lists see