ACM SIGMM Interest List


Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
"M. Larson" <[log in to unmask]>
Reply To:
M. Larson
Sun, 2 Dec 2012 18:44:58 -0600
text/plain (54 lines)
Call for Task Proposals
MediaEval 2013 Multimedia Benchmark
Deadline for proposals: 22 December 2012
MediaEval is a benchmarking initiative dedicated to evaluating new algorithms for multimedia access and retrieval. It emphasizes the 'multi' in multimedia and focuses on human and social aspects of multimedia tasks. 

MediaEval 2013 is calling for proposals for new tasks from researchers in academia and industry. 

The proposal should contain the following elements:
- Names of proposer or proposers
- Name of task
- Description of the use scenario underlying the task (Who would ultimately use the technology developed to address this task?)
- Description of task (What is the problem that task participants will be expected to solve?)
- Description of the dataset to be used, including a statement on how it is to be licensed (Note that MediaEval encourages the use of Creative Commons data wherever possible.)
- Description of how the ground truth will be generated
- Statement of the evaluation metric and/or methodology
- Statement of why the task is a MediaEval task (Does the task involve a strong social or human component?)

Please email your proposal (a ca. 1 page .pdf) to Martha Larson [log in to unmask] and Gareth Jones [log in to unmask] by December 22, 2012.

Task proposals are accepted on the basis of the existence of a community of task supporters. Support is determined using a survey, which is circulated widely to the research community at the beginning of the year (i.e., January 2013). Task decisions are made mid-February. 

We encourage task proposers to join forces with colleagues at other institutions to create a organizing team large enough to bear the burden of data set generation, results evaluation, and working notes paper review. Please contact Martha Larson [log in to unmask] if you have questions about task organization or if you are interested in being connected up with other people with similar interests and who could join together to form a task organizer team.

MediaEval has been experiencing steady growth since it was founded in 2008 as a track called "VideoCLEF" within the CLEF benchmark campaign. In 2010, it became an independent benchmark and in 2012 it ran for the first time as a fully "bottom-up benchmark", meaning that it is organized for the community, by the community, independently of a "parent" project. MediaEval 2012 produced a working notes proceedings with 54 short papers, now available online at:

Example tasks that have run in past years are:
- Placing Task: Predict the geo-coordinates of user-contributed photos.
- Tagging Task: Automatically assign tags to user-generated videos.
- Spoken Web Search: Search FOR audio content WITHIN audio content USING an audio content query. 
- Social Event Detection: Find multimedia items related to a particular event within a social multimedia collection.
- Violent Scenes Detection Task: Automatically detect violence in movies.
- Visual Privacy Task: Obscure faces acceptably for human viewers.

We expect the MediaEval 2013 workshop to be held close in time and place to ACM Multimedia 2013 in Barcelona, Spain. For more information on the MediaEval Multimedia benchmark, please visit or contact Martha Larson [log in to unmask]

Martha Larson -- [log in to unmask]
Multimedia Information Retrieval Lab
Delft University of Technology                
Mekelweg 4, 2628 CD DELFT              
The Netherlands
office tel: +31(0)15 278 5812


To unsubscribe from the MM-INTEREST list:
write to: mailto:[log in to unmask]
or click the following link: