ACM SIGMM Interest List


Options: Use Classic View

Use Monospaced Font
Show HTML Part by Default
Condense Mail Headers

Topic: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Message-ID: <[log in to unmask]>
Sender: ACM SIGMM Interest List <[log in to unmask]>
From: Maria Maistro <[log in to unmask]>
Date: Thu, 15 Jul 2021 15:22:04 +0000
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="_000_CD323D49E6204FE691B4B8A39B95A569kudk_"
Reply-To: Maria Maistro <[log in to unmask]>
Parts/Attachments: text/plain (2952 bytes) , text/html (4 kB)
Call for participation: TREC Health Misinformation Track 2021<>

Misinformation represents a key problem when using search engines to guide any decision-making task: Are users able to discern authoritative from unreliable information and correct from incorrect information? This problem is further exacerbated when the search occurs within uncontrolled data collections, such as the web, where information can be unreliable, misleading, highly technical, and can lead to unfounded escalations. Information from search-engine results can significantly influence decisions, and research shows that increasing the amount of incorrect information about a topic presented in a Search Engine Result Page (SERP) can impel users to make incorrect decisions.

In this context, the TREC 2021 Misinformation track fosters research on retrieval methods that promote reliable and correct information over misinformation. The track offers the following task:

* Ad-hoc Retrieval Task: The goal is to design a ranking model that promotes credible and correct information over incorrect information;

* Corpus: noclean version of the C4 dataset (;
* Topics: about consumer health search (people seeking health advice online);
* Runs: runs may be either automatic or manual with the standard TREC run format.

Detailed guidelines on:<>

* Runs due from participants: September 2, 2021
* Evaluation results returned: End of September 2021
* Notebook paper due: October 2021
* TREC 2021 Conference: November 17-19, 2020
* Final paper due: February 2021

* Charles Clarke, University of Waterloo
* Maria Maistro, University of Copenhagen
* Mark Smucker, University of Waterloo

For more information or to ask questions, join the google group:!forum/trec-health-misinformation-track


Maria Maistro, PhD
Tenure-track Assistant Professor
Department of Computer Science
University of Copenhagen
Universitetsparken 5, 2100 Copenhagen, Denmark



[log in to unmask]

If you don't already have a password for the LISTSERV.ACM.ORG server, we recommend
that you create one now. A LISTSERV password is linked to your email
address and can be used to access the web interface and all the lists to
which you are subscribed on the LISTSERV.ACM.ORG server.

To create a password, visit:


Once you have created a password, you can log in and view or change your
subscription settings at: