Dear MultiMediate participants,

The evaluation phase is starting now. You can submit your validation and test set predictions at https://hcai.eu/challenges/web/challenges/challenge-page/23/overview
There is also an additional update concerning the multi-domain engagement estimation task. Anonymising the speeddating dataset proved to be more difficult than expected, to the extent that we can not be sure that participants identities are protected if we use the dataset as part of the challenge. To protect our participants we therefore had to take the decision to not include the speeddating dataset as an evaluation set. As a result, we have three remaining test sets for this task: NOXI (MultiMediate’23 version), NOXI (additional languages), and MPIIGroupInteraction. If you plan to submit to the engagement estimation track, you are required to evaluate on all three of these datasets.

The required features for the test sets are made available on the download pages for NOXI and MPIIGroupInteraction. For NOXI they are already available, for MPIIGroupInteraction they will be on Monday - unfortunately our website admin was already on their weekend when we contacted them on Friday.

Please let us know in case of any further questions!

Best,
Philipp


––––––––––––––––––––––––––––––––––––––––––––––––––––––
Dr. Philipp Müller 
Senior Researcher

Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)
Stuhlsatzenhausweg 3, Campus D3 1
66119 Saarbrücken
Germany
+49 681 85775 7752
–––––––––––––––––––––––––––––––––––––––––––––––––––––– 
Deutsches Forschungszentrum für Künstliche Intelligenz GmbH
Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern 
Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender)
Helmut Ditzer

Vorsitzender des Aufsichtsrats: 
Dr. Ferri Abolhassan 
Amtsgericht Kaiserslautern, HRB 2313 
––––––––––––––––––––––––––––––––––––––––––––––––––––––
Website: https://www.dfki.de