(Apologies if you receive this message multiple times)
CALL FOR PAPERS
Special Issue on
Principled Design and Evaluation of Adaptive Systems
User Modeling and User-Adapted Interaction:
The Journal of Personalization Research
(An international journal published by Springer Verlag)
Web site: http://www.easy-hub.org/umuai/
Updates from the previous CFP:
* If you plan to submit a paper to the special issue, please
contact the editors (umuai_specialissue at easy-hub.org) at your
earliest convenience, to indicate your intention and the topic
your submission will cover.
* A web site and a mailing list have been set up for discussing
prospective contributions to this special issue. If you are
interested in participating in the discussions, or just want
to receive progress updates, please contact the editors
(umuai_specialissue at easy-hub.org).
The importance and benefits of involving users in the design and
evaluation of adaptive systems have been advocated for a long time.
In fact, user studies have become an integral part of papers
published in the UMUAI journal, and indeed most papers published
in the major conferences in the area. Although this is most
definitely indicative of increasing maturity in the field, we are
far from having solved all related outstanding issues:
* Most papers report summative evaluations, aiming to establish
the extent to which the use of an adaptation method has improved
the system. Often more scientific insight can be gained from
formative evaluations that inform and guide the development
process of adaptive systems.
* Most papers report on a single evaluation activity, often
assessing the system as a whole only. More principled and rigorous
forms of evaluation are possible, in which different system layers
or components are evaluated separately, and more is learned about
what causes success (or, more importantly in some cases, failure).
* Certain success criteria have received a lot more attention than
others. For example, for recommender systems, the focus has often
been on recall and precision, rather than serendipity, privacy and
trust. A more holistic approach to evaluation is needed, including
the consideration of trade-offs between criteria. Metrics and
methods for evaluating new criteria are also needed.
This special issue aims to create a new point of reference for the
evaluation of adaptive systems, bringing future evaluations to the
next level. Rather than just encouraging evaluation studies, the
goal of this special issue is to reflect the current body of
knowledge on evaluation methods and methodologies for different
types of user adaptive systems. We expect contributions will
address the following core categories:
* Papers describing novel methods that can be used for the user-
centred design and formative evaluation of adaptive systems.
* Papers demonstrating the value and benefit of success criteria
used in the evaluation of adaptive systems, validating concrete
evaluation metrics, or considering trade-offs between different
* Papers describing frameworks for the principled design and
evaluation of adaptive systems, that may provide guidance and
serve as the theoretical underpinnings of future studies.
All papers in the issue will undergo stringent peer-review. Papers
proposing a new evaluation method, framework, or criteria will
need to validate these proposals, for example through case studies
and / or surveys.
Authors will be expected to position their work in relation to a
framework for the principled design and evaluation of adaptive
systems, which will be summarized by the editors in an
introductory article. This framework has been developed over the
course of several international workshops (for more informaton
see http://www.easy-hub.org/workshops/ ) and preliminary material
for prospective contributors to the special issue has been made
available on the issue's web site (see
http://www.easy-hub.org/umuai/layered.dot ). To provide a coherent
point of reference, authors are also expected to cross-reference
their accepted submissions to each other, where applicable, in a
second round of editing.
Articles that describe a traditional global summative evaluation
of an adaptive system should be submitted to the regular track of
UMUAI rather than this special issue (contact the editors if in
HOW TO SUBMIT
Submissions to the special issue should follow the UMUAI
formatting guidelines and submission instructions available at:
Each submission should note that it is intended for the Special
Issue on Principled Design and Evaluation of Adaptive Systems.
Note! Potential authors are asked to submit a tentative title and
short abstract (which can be altered for the actual submission)
** at your earliest convenience ** to the special issue's editors
(umuai_specialissue at easy-hub.org) to assist in the formation of
a panel of appropriate reviewers, and facilitate discussions
amongst the prospective contributors.
UMUAI is an archival journal that publishes mature and
substantiated research results on the (dynamic) adaptation of
computer systems to their human users, and the role that a model
of the system about the user plays in this context. Many articles
in UMUAI are quite comprehensive and describe the results of
several years of work. Consequently, UMUAI gives "unlimited" space
to authors (so long as what they write is important). Authors
whose paper exceeds 40 pages in journal format (including
illustrations and references) are however requested to supply a
short justification upon submission that explains why a briefer
discussion of their research results would not be advisable.
* Deadline for submission of title and abstract: At your earliest
convenience, and not later than January 4, 2010
* Deadline for paper submissions: February 1, 2010
Submissions will undergo the normal review process, and will be
reviewed by three established researchers selected from a panel of
reviewers formed for the special issue. Barring unforeseen
problems, authors can expect to be notified regarding the review
results within three months of submission.
School of Computing
National College of Ireland Dublin
sweibelzahl at ncirl.ie
Institute for Information Processing and Microprocessor Technology (FIM)
Johannes Kepler University Linz
alpar at fim.uni-linz.ac.at
University of Aberdeen
j.masthoff at abdn.ac.uk
To unsubscribe, send an empty email to
mailto:[log in to unmask]
For further details of CHI lists see http://sigchi.org/listserv