ACM SIGCHI General Interest Announcements (Mailing List)


Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Condense Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
"ACM SIGCHI General Interest Announcements (Mailing List)" <[log in to unmask]>
Wed, 21 Nov 2007 15:27:31 -0500
Priscilla Rasmussen <[log in to unmask]>
text/plain; charset="iso-8859-1"
Priscilla Rasmussen <[log in to unmask]>
text/plain (192 lines)
The deadline of registration has been extended until
December 27, 2007.

                 Call for Participation

              The 7th NTCIR Workshop (2007/2008)
Evaluation of Information Access Technologies: Information Retrieval,
        Question Answering, and Cross-Lingual Information Access

               October 2007 - December 2008
(Final Meeting: December 16-19, 2008, NII, Tokyo, Japan)

                     Online Registration:

We are pleased to announce that the Seventh NTCIR (NTCIR-7)
workshop will start this year, and the concluding Workshop meeting
will be held at NII, Tokyo, Japan in December 16-19, 2008.

Participation is invited from anyone interested in research on
information access technologies and evaluation of them, such as
retrieval of documents from various genres, cross-lingual
information retrieval of Asian languages, question answering
and cross-lingual information access.

NTCIR Workshops are periodical events which are held once per
one and half years. All the documents needed for evaluation
will be provided from NII to the participants.

We have used Documents in East Asian Languages, but attracted
international participation. You are most welcome to participate!

Each task has Wiki or mailing lists for discussion. Discussion
for task design and evaluation methodologies are welcome.

** Tasks/Clusters for NTCIR-7

NTCIR-7 hosts the following tasks.

Cluster 1. Advanced Cross-lingual Information Access (ACLIA)
* Complex Cross-Lingual Question Answering (CCLQA)
* Information Retrieval for Query Answering (IR4QA)

Cluster 2. Information Access to User Generated Contents (UGC)
* Multi-Lingual Opinion Analysis Task (MOAT)
* Cross-Lingual Information Retrieval over Blog data (CLIR-B)

Cluster 3. Information Access to Focused Domains (PATENT)
* Patent Mining Task
* Patent Translation Task

Cluster Independent
* Multimodal Summarization of Trends (MuST)

** Clusters and Tasks Overview

* Cluster 1: Advanced Cross-lingual Information Access (ACLIA)

This cluster evaluates "Complex CLQA", "CLIR" and "the contribution
of CLIR to CLQA". Documents are (Simplified and Traditional)
Chinese, and Japanese news published in 1998-2001. Questions/topics
are English, Chinese, Japanese and can be more.

CCLQA and CLIR share the same set of questions/topics, and
participation is welcome to test (1) end-to-end QA, or (2) CLIR
or IR module only using either original natural language questions,
or analyzed queries containing question types. IR modules will
be evaluated both IR itself and effectiveness in QA.

CCLQA and IR focusing to specific types of questions is new for
NTCIR. And we would like to know "What kind of IR mechanism
would be the best for what kind of QA mechanism?", "What kind
of combination is the best?", etc.

* Cluster 2: Information Access to User-Generated Contents


This cluster consists of "Cross-Lingual Information Retrieval
for Blog (CLIR-B)" task and "Multilingual Opinion Analysis
Task (MOAT)". These use a newly crawled blog corpus of Chinese,
Japanese and English, which including both blog posts and
the comments for them; Topics will be shared by the tasks.

CLIR has been investigated in NTCIR from the beginning, but
Blog is a new document genre for NTCIR. CLIR for Blog shall be
an informational task to search opinionated documents relevant
to each topic. Opinion Analysis Task tests the ability of
the system to automatically identify relevance and opinionatedness
of each sentences in the relevant documents, opinion holder,
polarity and stakeholder (target of the opinion). Compared to
Opinion Analysis Task using news documents in NTCIR-6, identifying
"Stakeholder" is new.

* Cluster 3: Information Access for Focused Domains


This cluster consists of "Patent Translation" and "Patent Mining"
tasks. It is targeting to evaluate the technologies to enhance
the information access for Patent, which were investigated
in the past NTCIRs.

Patent Translation will conduct both intrinsic and extrinsic
evaluation. Intrinsic evaluation consists of automatic
evaluation using a metrics like BLEU and human judgments.
Extrinsic evaluation adopts CLIR-task based evaluation, i.e.,
the contribution machine translation for CLIR will be tested.

Patent Mining task targets cross-genre information access
between patents and scientific papers. Abstracts of conference
papers are used as "topics" and the systems are requested
to provide appropriate International Patent Classification (IPC)
classes. It can be done as automatic categorization of paper
abstracts to IPC classes or as a cross-genre retrieval from
conference papers to patents.

* Multi-modal Summarization of Trends (MuST): TBA

Automatic identification and extraction of numeric information
related to the trends of a topic, and way of visualization will
be investigated and evaluated. For visualization, as a common
platform, an open source software for visualization will be provided.

** Important Dates

Registration Due:  December 27, 2007
Dry Run:    from November 2007 to April 2008
Formal Run: from 2007-11 to 2008-08
Task Overview Partial Release: by September 1, 2008
Evaluation Results Return: by September 1, 2008
Papers for Proceedings Due: October 1, 2008
Camera-ready for Proceedings Due: November 1, 2008
Final Meeting: December 16-19, 2008

* Notes

1. Whether there will be a dry run or not depends on each task.
For further information, please consult the web site for each task.

2. The exact dates for the dry and formal runs are decided by each
task. For further information, please contact Noriko Kando

The registration system for NTCIR-7 task participation is online.
Please register for NTCIR-7 at ;

"How to Participate" and "User Agreement forms" to obtain the data
set will be released soon. These are generally similar to
the previous ones that we used for NTCIR-6.
Just for your information:




                To unsubscribe, send an empty email to
     mailto:[log in to unmask]
    For further details of CHI lists see