WEPIR 2019: Second Annual Workshop on the Evaluation of Personalisation in Information Retrieval
To be held in conjunction with the ACM SIGIR Conference on Human Information Interaction and Retrieval, CHIIR 2019
March 10-14, 2019 in Glasgow, Scotland, UK.
Call for Papers
The purpose of the WEPIR workshop series is to bring together researchers from different backgrounds, interested in advancing the evaluation of personalisation in information retrieval. The workshop focus is on the development of a common understanding of the challenges, requirements and practical limitations of meaningful evaluation of personalisation in information retrieval. The planned outcome of the workshop is the proposal of methodologies to support evaluation of personalised information retrieval from both the perspectives of the user experience in interactive search settings, and of user models for personalised information retrieval and their algorithmic incorporation in the search process.
Since the focus of the workshop is primarily on exchange of ideas and development of new research activities, only short paper contributions will be sought in the form of 2 to 4 page papers in the standard ACM conference format.
Topics for contributions include but not be limited to:
• Task design for evaluation of personalised information retrieval
• Test collections for personalised information retrieval
• Evaluation metrics for peronsalised information retrieval
• Protocols for evaluation of interactive personalised information retrieval
• User modeling for personalised information retrieval
• Search algorithms for personalised information retrieval
• Submitted contributions will be selected for inclusion in the workshop on the basis of reviews by the programme committee
The topic of evaluation of the incorporation of personalisation within search applications and algorithms and their impact on user engagement and experience of search is currently underexplored within the information retrieval community. This is particularly the case from the perspective of comparative evaluation of interactive and algorithmic elements of personalised search systems, and the representation and exploitation of user models. To reflect this, the workshop will focus on establishing and exploring the principles working towards the outcome of a proposed framework. The workshop will have the following elements:
• Invited talk: Prof. Ian Ruthven of the University of Strathclyde will deliver an invited keynote presentation.
• Presentations of papers submitted in response to an open call for research and position papers. Papers will be presented as short oral and poster format. The number of oral presentations will be limited to allow for the maximum of time for interactive activities, with other papers being presented as posters.
• Working groups focusing on relevant topics for the evaluation of personalised information retrieval. These topics will be defined on the day, but could include experimental protocols, test collection development, and evaluation metrics.
• Consolidation session: integration of the activities of the working groups, and proposal of agreed framework or frameworks for the evaluation of personalised information retrieval
The workshop is accepting short papers from 2 to 4 pages (including references) describing approaches or ideas/challenges on the topics of the workshop. Submissions do not need to be anonymized.
Submissions should be in ACM Standard SIGCONF format. LaTeX and Word templates are available at (https://www.acm.org/publications/proceedings-template).
Papers should be submitted in pdf format through the EasyChair system (https://easychair.org/conferences/?conf=wepir2019 <https://easychair.org/conferences/?conf=wepir2019>) no later than midnight Sunday 3rd of February, 2018 (AoE). Submissions will be reviewed by members of the workshop program committee. Accepted papers will be included in the extended CHIIR 2019 Proceedings and will be available via the ACM Digital Library. In addition, it is planned to index the WEPIR workshop proceedings with CEUR-WS. Authors of select papers may be invited to contribute to a journal publication which describes the outcomes of the workshop.
***Anywhere on Earth Time Zone***
Midnight Sunday 3rd of February : Deadline for paper submission
Midnight Sunday 24th of February: Notification to authors
Midnight Friday 8th of March: Camera-ready papers due
Thursday, 14th of March 2019: WEPIR Workshop at CHIIR
Further information is available on our website http://www.ir.disco.unimib.it/wepir2019/ or by emailing the workshop organizers at [log in to unmask] <mailto:[log in to unmask]>
Gareth J. F. Jones, ADAPT Centre, Dublin City University, Ireland
Nicholas J. Belkin, Rutgers University, USA
Gabriella Pasi, University of Milano-Bicocca, Italy
Séamus Lawless, ADAPT Centre, Trinity College Dublin, Ireland
For news of CHI books, courses & software, join CHI-RESOURCES
mailto: [log in to unmask]
To unsubscribe from CHI-ANNOUNCEMENTS send an email to
mailto:[log in to unmask]
For further details of CHI lists see http://listserv.acm.org