ACM SIGCHI General Interest Announcements (Mailing List)


Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Mark Smucker <[log in to unmask]>
Reply To:
Mark Smucker <[log in to unmask]>
Tue, 7 May 2013 17:02:36 +0000
text/plain (54 lines)
There is growing interest in ways to incorporate models of human behavior into Cranfield-style evaluation of information retrieval systems. While there are many approaches to this problem, two prominent approaches have been either to start from a user interface and then simulate user interaction with this interface, or to take traditionally styled evaluation measures and make them more realistic in terms of known human behavior.

The SIGIR 2013 Workshop on Modeling User Behavior for Information Retrieval Evaluation (MUBE 2013) aims to bring together people to discuss existing and new approaches, ways to collaborate, and other ideas and issues involved in improving information retrieval evaluation through the modeling of user behavior.

Areas of interest for the workshop include but are not limited to:

+ Studies of user behavior applicable to evaluation
+ Models of users
+ Data collection
+ Test collection support for evaluation using user models
+ Calibration and validation of effectiveness measures derived from user models
+ Connections to related research in automated usability
+ Information foraging theory
+ Economic models applied to IR evaluation
+ Simulation of interaction
+ Evaluation of sessions
+ Models of query reformulation
+ Studies of relevance judging
+ Click models
+ Incorporation of user variance into evaluation

We are soliciting submission of 2 page poster papers to encourage sharing of ideas and encourage discussion.  We would like to see a wide range of paper styles: reports of original research, preliminary research results, proposals for new work, and position papers.  All papers will be peer reviewed by the program committee and judged by their relevance to the workshop and their likelihood to generate discussion.  Accepted papers will be presented both at a one-hour boaster session and during the workshop's poster session.

Papers should be in the ACM SIG proceedings format ( ) and submitted via EasyChair:

In addition to the boaster/poster sessions, the workshop will include several invited talks and afternoon breakouts groups devoted to specific topics chosen by the workshop attendees.

Important Dates:

+ Papers due: June 9, 2013 (firm deadline due to shortened review cycle)
+ Acceptance notification: June 26, 2013
+ Camera ready copy due: July 3, 2013
+ Workshop in Dublin: August 1, 2013


+ Charles Clarke (University of Waterloo)
+ Luanne Freund (University of British Columbia)
+ Mark Smucker (University of Waterloo)
+ Emine Yilmaz (University College London)

Workshop Website:

    For news of CHI books, courses & software, join CHI-RESOURCES
     mailto: [log in to unmask]

    To unsubscribe from CHI-ANNOUNCEMENTS send an email to
     mailto:[log in to unmask]

    For further details of CHI lists see