June 2022 - Multimediate Challenge - lists.hcics.simtech.uni-stuttgart.de

Deadline extension and evaluation update!
by Dominike Thomas 14 Jun '22

14 Jun '22

Dear participants, the deadlines for Grand Challenge paper submissions were extended (see https://2022.acmmm.org/important-dates/). This means, you now have time to submit your papers until June 25! Important: eval.ai is currently not working as expected. Please submit your predictions via email to Michael Dietz (michael.dietz(a)informatik.uni-augsburg.de<mailto:michael.dietz@informatik.uni-augsburg.de>). We can guarantee to evaluate every correctly formatted submission that reaches us until June 24. Please find the baseline evaluation results on train and test set at https://git.opendfki.de/philipp.mueller/multimediate22_baselines. All the best for your work! The MultiMediate organisers

1 0

Important information for your evaluations!
by Dominike Thomas 13 Jun '22

13 Jun '22

Dear MultiMediate participants, this message contains several important bits of information for your evaluations. Please read it carefully. (1) If you experience difficulties with obtaining results on eval.ai, please send your test set predictions directly to Michael Dietz and Dominik Schiller. They will evaluate the predictions for you. (2) We found a bug in our baseline evaluation code. As a result, there are new baseline results for the agreement estimation subchallenge (please see https://git.opendfki.de/philipp.mueller/multimediate22_baselines). We apologize if this causes any inconvenience on your side! (3) Please report results on the official challenge test set in your paper submission. For ablation studies please make use of the official validation set to ensure comparability to other approaches as well as the official baselines. (4) We added a few more ablation results for the baselines (see https://git.opendfki.de/philipp.mueller/multimediate22_baselines). Please cite the following publication in your paper to refer to the official baselines and the challenge in general: Philipp Müller, Michael Dietz, Dominik Schiller, Dominike Thomas, Hali Lindsay, Patrick Gebhard, Elisabeth André, and Andreas Bulling. 2022. MultiMediate ’22: Backchannel Detection and Agreement Estimation in Group Interactions. Thank you very much! The MultiMediate organisers

1 0

Test data now online
by Dominike Thomas 05 Jun '22

05 Jun '22

Dear Participants, the test data, including pre-computed features is now available on the dataset download page. All the best for your evaluations, The MultiMediate organisers

1 0

Evaluation open
by Dominike Thomas 02 Jun '22

02 Jun '22

Dear MultiMediate participants, you can now start to evaluate your approaches on eval.ai (https://eval.ai/challenge/1740). Evaluation on the validation set is possible as often as you like. On the test set, 5 evaluations are allowed per team. Test data will be published on June 4 latest. IMPORTANT: We would like to ask you to tell us in which subchallenges you plan to participate. To do so, please write an email to Dominike (dominike.thomas(a)vis.uni-stuttgart.de<mailto:dominike.thomas@vis.uni-stuttgart.de>) with the name(s) of the subchallenge(s). Thank you very much and let us know in case of any questions! Best, The MultiMediate organisers

1 0