CHI-ANNOUNCEMENTS Archives

ACM SIGCHI General Interest Announcements (Mailing List)

CHI-ANNOUNCEMENTS@LISTSERV.ACM.ORG

Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
Silvia Rocchi <[log in to unmask]>
Reply To:
Silvia Rocchi <[log in to unmask]>
Date:
Wed, 22 Jun 2005 09:56:03 +0200
Content-Type:
text/plain
Parts/Attachments:
text/plain (72 lines)
Posted on behalf of Jacques Terken, Sriram Subramanian and Massimo Zancanaro 


Call for Papers
 
User-centred design and evaluation of services for human-human communication and collaboration

http://www.Industrialdesign.tue.nl/ICMI/eval-workshop


Workshop at the 7th International Conference on Multimodal Interfaces, October 7th, Trento, Italy, http://icmi05.itc.it,  

Organizers
Jacques Terken (Technische Universiteit Eindhoven. Eindhoven, NL)
Sriram Subramanian (University of Saskatchewan, Saskatoon, CA)
Massimo Zancanaro (ITC-irst, Trento, IT)

Goals and objectives
Developments in perceptive technologies (most notably computer vision and speech recognition) and the availability of multi-user devices (like non-desktop devices and portable devices) have triggered renewed interest in supporting co-located communication and collaboration. The ability to maintain a context model through perceiving what is going on has opened possibilities for services that anticipate people's needs and can take action to support people's co-located communication and collaboration in a contextually and socially appropriate way. 

Recently, a number of research projects have started to actively investigate these issues, for example the EU-funded Integrated Projects Computers in the Human Interaction Loop (CHIL; http://chil.server.de) and Augmented Multiparty Interaction (AMI; http://www.amiproject.org), the Canadian Network for Effective Collaboration Technologies through Advanced Research (NECTAR; http://www.nectar-research.net) and Cognitive Agent that Learns and Organizes (CALO, http://www.cse.ogi.edu/CHCC/Projects/CALO) .

Rather than just driving developments from the technology perspective, user-centred design and service evaluation are central concerns in these projects. For more conventional interaction design, the User-centred Design philosophy has been well established. In the early stages of the design process, information is obtained from the users through simulations (low-fi prototypes such as drawings, sketches, interactive PowerPoint simulations etc) that help the designers to obtain requirements and elaborate the concept in an iterative fashion. Also, in most cases the evaluation metrics are straightforward. 

In the context of designing services for co-located communication and collaboration applying the user-centred design approach is more complex. Building simulations is already a major effort and involves many decisions without proper guidance from user data, in the awareness that the decisions will strongly affect the user experience. Also, many of the perceptual components cannot easily be simulated. Therefore, formative evaluation is a slow and laborious process, which runs counter to the ideas underlying User-centred Design, namely to obtain the information in the early stages of the design process. Similarly, extensive summative evaluation is a challenging task. Services for co-located communication and collaboration need to be evaluated at different levels: at the individual, the social and the organisational level. Furthermore, evaluation is a multidisciplinary activity, calling on expertise from cognitive, social and organisation science and it's not easy to bring the required expertises together within a project team. 

Against this background, we propose a workshop on User-centred Design and evaluation of co-located communication and collaboration with the aim to bring together researchers from different backgrounds to share experiences. Building on previous workshops that have been organised in the context of both CSCW and E-CSCW conferences (e.g. ECSCW'93 Workshop on Evaluation Studies in CSCW, http://www.ul.ie/~idc/library/papersreports/LiamBannon/16/sigois.html and Methodologies for Evaluating Collaboration Behaviour in Co-Located Environments, http://www.edgelab.ca/CSCW/Workshop2004/ , the main goals are, to exchange information about the approaches taken to formative and summative evaluation for services supporting co-located communication and collaboration and about solutions devised by different researchers/teams, and to address a number of important questions. 
* What is the proper context for formative and summative evaluation in this scenario? Preferably, field studies should play a central role in the evaluation of services, but the logistics and the lack of control over real-life situations makes this often difficult. Therefore, researchers resort to lab studies with framed tasks such as the hidden-profile task. However, the ecological validity of this kind of formative and summative evaluation is questionable, as these tasks do not link to the normal goals that people entertain. 
* What are proper methodologies and metrics for formative and summative evaluation in the context of smart services for co-located communication and collaboration? 
* What is the role of theory in conducting evaluations and what are the theoretical frameworks that different researchers employ? 

We expect that the discussion will help to elaborate and refine a framework for formative and summative evaluation of co-located communication and collaboration. 

Intended Participants, Paper Submission, Workshop Proceedings
We invite contributions from researchers and students working in the area of co-located communication and collaboration from different backgrounds, ranging from computer science to social and organisational psychology. 
Interested attendees should submit a research paper (maximum 8 pages) containing original work or overviews. Based on the reviews about 10 to 15 papers will be selected for the workshop. 
Accepted submissions will be included in Workshop proceedings. In addition, a special issue of a relevant journal will be negotiated for publication of papers from the workshop (under normal review conditions).

Duration
The workshop will be for a full day and structured to provide maximum time for group discussion. Papers will be made available in advance. The workshop will have four sections (separated by the morning break, lunch and the afternoon break). In the first session the participants will briefly introduce themselves. In the second session participants will outline key discussion topics for the two midday sessions. In the third session the group will be divided into sub-groups moderated by the workshop organizers to have focussed discussions on some of the key topics identified earlier. In the fourth session the group will reconvene to summarize the advances identified in the breakout discussions. The workshop will end with a short discussion to define immediate next steps, identify follow-up journal plans and target dates for submission.

Workshop Organizers 
Jacques Terken (Technische Universiteit Eindhoven) [log in to unmask]
Massimo Zancanaro (ITC-irst, Istituto Trentino di Cultura) [log in to unmask]
Sriram Subramanian (University of Saskatchewan, Saskatoon) [log in to unmask]

Programme Committee
Dima Aliakseyeu, Technische Universiteit Eindhoven, Department of Industrial Design
Paulo Barthelmess, Oregon Health & Science University, Center for Human-Computer Communication (CHCC)
Anita Cremers, TNO - Technische Menskunde
Maria Danninger, Universität Karlsruhe, Fakultät für Informatik
Antonella De Angeli, University of Manchester, UK
Dina Goren-bar, Ben-Gurion University of the Negev, Israel
Carl Gutwin, University of Saskatchewan,  Department of Computer Science
Fabio Pianesi, ITC-irst, Istituto Trentino di Cultura
Stacey 	Scott, Massachusetts Institute of Technology, Dept of Aeronautics
John Soldatos; Athens Information Technology - Greece

Submission schedule
Submission deadline (according to template: camera-ready) July 10. 
Submit papers in PDF or PS-format to [log in to unmask]
Detailed information about the Templates (ACM SIG Proceedings) can be found on the ACM web site: http://www.acm.org/sigs/pubs/proceed/template.html
Acceptance notification August 10, 2005
Early registration closing date August 31, 2005
Camera-ready versions August 26, 2005

    ---------------------------------------------------------------
                To unsubscribe, send an empty email to
     mailto:[log in to unmask]
    For further details of CHI lists see http://sigchi.org/listserv
    ---------------------------------------------------------------

ATOM RSS1 RSS2