CHI-ANNOUNCEMENTS Archives

ACM SIGCHI General Interest Announcements (Mailing List)

CHI-ANNOUNCEMENTS@LISTSERV.ACM.ORG

Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
"Alfred Kobsa, Editor UMUAI" <[log in to unmask]>
Reply To:
Alfred Kobsa, Editor UMUAI
Date:
Fri, 21 Aug 2009 11:32:20 -0700
Content-Type:
text/plain
Parts/Attachments:
text/plain (161 lines)
================================================================
                         CALL FOR PAPERS

                        Special Issue on
      Principled Design and Evaluation of Adaptive Systems

             User Modeling and User-Adapted Interaction:
               The Journal of Personalization Research
        (An international journal published by Springer Verlag)


              Web site: http://www.easy-hub.org/umuai/

=================================================================

The importance and benefits of involving users in the design and
evaluation of adaptive systems has been advocated for a long time.
In fact, user studies have become an integral part of papers
published in the UMUAI journal, and indeed most papers published
in the major conferences in the area. Although this is most
definitely indicative of increasing maturity in the field, we are
far from having solved all related outstanding issues:

* Most papers report summative evaluations, aiming to establish
  the extent to which the use of an adaptation method has improved
  the system. Often more scientific insight can be gained from
  formative evaluations that inform and guide the development
  process of adaptive systems.

* Most papers report on a single evaluation activity, often
  assessing the system as a whole only. More principled and rigorous
  forms of evaluation are possible, in which different system layers
  or components are evaluated separately, and more is learned about
  what causes success (or, more importantly in some cases, failure).

* Certain success criteria have received a lot more attention than
  others. For example, for recommender systems, the focus has often
  been on recall and precision, rather than serendipity, privacy and
  trust. A more holistic approach to evaluation is needed, including
  the consideration of trade-offs between criteria. Metrics and
  methods for evaluating new criteria are also needed.

This special issue aims to create a new point of reference for the
evaluation of adaptive systems, bringing future evaluations to the
next level. Rather than just encouraging evaluation studies, the
goal of this special issue is to reflect the current body of
knowledge on evaluation methods and methodologies for different
types of user adaptive systems. We expect contributions will
address the following core categories:

* Papers describing novel methods that can be used for the user-
  centred design and formative evaluation of adaptive systems.

* Papers demonstrating the value and benefit of success criteria
  used in the evaluation of adaptive systems, validating concrete
  evaluation metrics, or considering trade-offs between different
  criteria.

* Papers describing frameworks for the principled design and
  evaluation of adaptive systems, that may provide guidance and
  serve as the theoretical underpinnings of future studies.

All papers in the issue will undergo stringent peer-review. Papers
proposing a new evaluation method, framework, or criteria will
need to validate these proposals, for example through case studies
and / or surveys.

Authors will be expected to position their work in relation to a
framework for the principled design and evaluation of adaptive
systems, which will be summarized by the editors in an
introductory article. This framework has been developed over the
course of several international workshops (see http://www.easy-
hub.org/workshops/) and preliminary material for prospective
contributors to the special issue has been made available on the
issue's web site (see http://www.easy-hub.org/umuai/layered.dot).
To provide a coherent point of reference, authors are also
expected to cross-reference their accepted submissions to each
other, where applicable, in a second round of editing.

Articles that describe a traditional global summative evaluation
of an adaptive system should be submitted to the regular track of
UMUAI rather than this special issue (contact the editors if in
doubt).


HOW TO SUBMIT

Submissions to the special issue should follow the UMUAI
formatting guidelines and submission instructions available at:

http://www.umuai.org/paper_submission.html

Each submission should note that it is intended for the Special
Issue on Principled Design and Evaluation of Adaptive Systems.

Potential authors are asked to submit a tentative title and short
abstract (which can be altered for the actual submission) to
assist in the formation of a panel of appropriate reviewers.

UMUAI is an archival journal that publishes mature and
substantiated research results on the (dynamic) adaptation of
computer systems to their human users, and the role that a model
of the system about the user plays in this context. Many articles
in UMUAI are quite comprehensive and describe the results of
several years of work. Consequently, UMUAI gives "unlimited" space
to authors (so long as what they write is important). Authors
whose paper exceeds 40 pages in journal format (including
illustrations and references) are however requested to supply a
short justification upon submission that explains why a briefer
discussion of their research results would not be advisable.


IMPORTANT DATES

Deadline for submission of title and abstract: January 4, 2010
Deadline for paper submissions: February 1, 2010


REVIEW PROCESS

Submissions will undergo the normal review process, and will be
reviewed by three established researchers selected from a panel of
reviewers formed for the special issue.  Barring unforeseen
problems, authors can expect to be notified regarding the review
results within three months of submission.


GUEST EDITORS

Stephan Weibelzahl
School of Computing
National College of Ireland Dublin
sweibelzahl at ncirl.ie
http://www.weibelzahl.de/

Alexandros Paramythis
Institute for Information Processing and Microprocessor Technology
(FIM)
Johannes Kepler University Linz
alpar at fim.uni-linz.ac.at
http://www.fim.uni-linz.ac.at/staff/paramythis/

Judith Masthoff
Computing Science
University of Aberdeen
j.masthoff at abdn.ac.uk
http://www.csd.abdn.ac.uk/~jmasthof/


Alfred Kobsa, Editor
User Modeling and User-Adapted Interaction:
The Journal of Personalization Research



    ---------------------------------------------------------------
                To unsubscribe, send an empty email to
     mailto:[log in to unmask]
    For further details of CHI lists see http://sigchi.org/listserv
    ---------------------------------------------------------------

ATOM RSS1 RSS2