July 2025 - Multimediate Challenge - lists.hcics.simtech.uni-stuttgart.de

Consolidated Leaderboards and further paper deadline extension
by Philipp Mueller 09 Jul '25

09 Jul '25

Dear MultiMediate particpants, many thanks for all your submissions! This year, we made great progress across three tasks in the challenge. The consolidated leaderboard can be found here: https://docs.google.com/spreadsheets/d/1KYG3IdbmgmIVoNyzzzcByU-xT9_Z34sBc6m… Please let us know asap in case you think there are any mistakes. We have included all teams that did register and were also able to improve over results from previous years (in the case of bodily behaviour and eye contact). We have also added information on the approaches from previous years in each case. Please explicitly discuss these methods in your paper submission and compare to those. To give you some more time to write high-quality papers, we extend the paper deadline until Monday 14th July, AoE. All the best for your submissions, we are looking forward to reading them! Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

1 0

Reminder concerning evaluation rules
by Philipp Mueller 02 Jul '25

02 Jul '25

Dear all, please keep in mind that we have a limited number of test set evaluations per team (5). There are indications that some participants tried to get more test set evaluations by registering several email addresses. We did not have a technical means in place to avoid this - we will definitely add a compulsory registration step next year. To make this year’s competition as fair as possible, we take the following steps: (1) Every team needs to register. This means they send us the list of team members with affiliations, and a single email address that will be used for submitting evaluations. Send this information to both philipp.mueller(a)dfki.de <mailto:philipp.mueller@dfki.de> and daksitha.withanage.don(a)uni-a.de <mailto:daksitha.withanage.don@uni-a.de> Only test set evaluations from this email address will be counted, and we will monitor any possibly suspicious submissions from other email addresses. (2) To offset the advantage some teams might have had by registering several email addresses, we will allow for more test set submissions from the official team email addresses. The new limit for test set submissions will be 20. We hope that in this way we improve the fairness of the challenge. We acknowledge that it is not a perfect solution, and we will have better technical measures in place next year. Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

1 0

Clarification on paper format
by Philipp Mueller 02 Jul '25

02 Jul '25

Dear all, your challenge solution papers (deadline 11 July) should follow the formatting guidelines of ACM Multimedia. They should be max. 6 pages long with max. 2 additional pages for references. See also here: https://acmmm2025.org/call-for-grand-challenge-participation/ The review process is single blind. Please put your author names and affiliations on the paper. Please also state your team name in the submission email. Submissions should be sent via email to both Philipp.Mueller(a)dfki.de <mailto:Philipp.Mueller@dfki.de> and daksitha.withanage.don(a)uni-a.de <mailto:daksitha.withanage.don@uni-a.de> Let us know if you have any further questions! Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

1 0

Extension of paper submission deadline
by Philipp Mueller 02 Jul '25

02 Jul '25

Dear participants, to give you more time to write your paper after the final evaluations, we decided to extend the paper submission deadline to July 11. Please note that this does not impact the deadline for the test results submission to eval ai. This deadline will remain at July 7. All deadlines are AoE time. Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

1 0