ACM SIGCHI General Interest Announcements (Mailing List)


Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Condense Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
"ACM SIGCHI General Interest Announcements (Mailing List)" <[log in to unmask]>
Hobbit Team <[log in to unmask]>
Tue, 28 Nov 2017 08:00:31 +0000
text/plain; charset="utf-8"; format="fixed"
Hobbit Team <[log in to unmask]>
text/plain (85 lines)
StreaML Open Challenge 2017-2018
After a successful co-organization of the DEBS Grand Challenge with the HOBBIT project ( at the DEBS 2017 Conference, HOBBIT is proud to announce the Stream Machine Learning (StreaML) Open Challenge, which starts in December 2017.

The StreaML Open Challenge will ensure continuous participation and systems evaluation with periodic cutoffs. The first cutoff is in May 2018.
* A monetary prize will be provided to the best-winning system!
* Stay tuned and get ready to participate!

The StreaML Open Challenge at a glance
The StreaML Open Challenge focuses on the task related to the problem of automatic detection of anomalies for manufacturing equipment.
The overall goal of the task is to detect abnormal behavior of a manufacturing machine based on the observation of the stream of measurements provided by each of the machines from observable set, which is dynamic (i.e. machines dynamically join and leave the set of observable machines). The data produced by each sensor is clustered and the state transitions between the observed clusters are modelled as a Markov chain. Based on this classification, anomalies are detected as sequences of transitions that happen with a probability lower than a given threshold.

We herewith invite system developers to participate in the aforementioned scenario. To ensure that the system results are comparable, we will provide the HOBBIT benchmarking platform for the generation of the final results to be included into the system publications. A specification of the hardware on which the benchmarks will be run will be released in due course.

Please note, that StreaML Open Challenge reuses the dataset ( and the task description ( of DEBS GC 2017 but in contrast to DEBS Challenge, systems will be continuously evaluated every week and results will be shown at leaderboard.

Participants are allowed to use the published benchmark ( as a reference implementation of anomaly detection algorithm to pass the correctness checks and focus on performance and stability of their systems, which are included into evaluation criteria.

Read more details here:

The winner of each round of the challenge will get a prize of 500€.

Important Dates
Dry run: December 2017 – end of January 2018
Training phase: February – end of April 2018
Cutoff and results proclamation: May 2018

Registration and Submission
Submission and registration procedure is documented here:

The evaluation platform can be reached under following address:

* Pavel Smirnov – AGT Group GmbH
* Martin Strohbach – AGT Group GmbH

We would like to explicitly thank AGT International ( for being a sponsor for the StreaML Open Challenge.

Further Information and Contact
For detailed information, including datasets and submission guidelines,
please visit the challenge website:
Feel free to join StreaML open challenge google group to ask any questions:

Holistic Benchmarking of Big Linked Data - HOBBIT EU Project

Unsubscribe [log in to unmask] from this list:

Forward this email to a friend:

 Update your profile:

    For news of CHI books, courses & software, join CHI-RESOURCES
     mailto: [log in to unmask]

    To unsubscribe from CHI-ANNOUNCEMENTS send an email to
     mailto:[log in to unmask]

    For further details of CHI lists see