ACM SIGCHI General Interest Announcements (Mailing List)


Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Condense Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
text/plain; charset="utf-8"; format="fixed"
Tue, 22 Aug 2017 10:14:13 +0000
Hobbit Team <[log in to unmask]>
Hobbit Team <[log in to unmask]>
"ACM SIGCHI General Interest Announcements (Mailing List)" <[log in to unmask]>
text/plain (62 lines)
Open Call for Benchmarks

This is an Open Call for adding benchmarks to HOBBIT project platform. HOBBIT aims at abolishing the barriers in the adoption and deployment of Big Linked Data by European companies, by means of open benchmarking reports that allow them to assess the fitness of existing solutions for their purposes. These benchmarks are based on data that reflects reality and measures industry-relevant Key Performance Indicators (KPIs) with comparable results using standardized hardware.

Inside the project, we have already developed several benchmarks  for Question Answering, Data Storage, Sensor Data etc.[1] The benchmarks have been used in open challenges on major Semantic Web conferences, for example: DEBS [2] , MOCHA [3]  and OKE [4] .

To drive the Semantic Web and Big Linked Data community towards transparent performance evaluation using standardized hardware (i.e. by running on HOBBIT platform), we ask you to add your benchmarks to the HOBBIT CKAN instance. Just follow the steps below:

1. Register on HOBBIT benchmark CKAN portal:
2. Go to Benchmarks → Add Benchmark and fill out the necessary information:
    a. Description of the benchmark
    b. Tags
    c. License (if not listed, select Other (Open))
    d. Version: 1.0
    e. Author and email address [your email]
    f. Maintainer and email address (fill out even if it is the same as author)
3. Click Next: Add Data
    a. Add link to benchmark repository (necessary)
    b. Format HTML
4. Click Save & add another
    a. Add links to gold standard dataset, tasks, publications etc. (optional)
    b. Format CSV, RDF, HTML etc.
5. Click finish
6. Thanks! :)

Adding your benchmarks to HOBBIT CKAN will help with their adoption and dissemination

[1] All the benchmarks are available on our CKAN:

Holistic Benchmarking of Big Linked Data - HOBBIT EU Project

Unsubscribe [log in to unmask] from this list:

Forward this email to a friend:

 Update your profile:

    For news of CHI books, courses & software, join CHI-RESOURCES
     mailto: [log in to unmask]

    To unsubscribe from CHI-ANNOUNCEMENTS send an email to
     mailto:[log in to unmask]

    For further details of CHI lists see