June 2025 - Multimediate Challenge - lists.hcics.simtech.uni-stuttgart.de

Details on Engagement Baselines
by Philipp Mueller 26 Jun '25

26 Jun '25

Dear MultiMediate participants, if you are participating in this year’s engagement task, please consult the following baseline repository for baseline results: https://git.opendfki.de/philipp.mueller/multimediate25 Philipp Mueller / MultiMediate25 · GitLab git.opendfki.de As eGeMAPs v2 achieves the best combined performance, please at least always compare your approach to this baseline method in your paper submissions. Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

1 0

Deadline extension
by Philipp Mueller 23 Jun '25

23 Jun '25

Dear MultiMediate participants, we have extended the deadlines for results and paper submission. Deadlines have been moved to July 7, AoE. On the eval.ai system, the deadline is listed in CET time (Jul 8, 2025 2:00:00 PM CET), but this corresponds to July 7, AoE. We are looking forward to receiving your submissions! Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

1 0

Eval.ai challenge online
by Philipp Mueller 19 Jun '25

19 Jun '25

Dear all, it is now possible to submit your test set predictions to eval.ai. Please use this link: https://challenges.hcai.eu/web/challenges/challenge-page/28/evaluation Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

1 0

Clarification on paper submission process
by Philipp Mueller 16 Jun '25

16 Jun '25

Dear MultiMediate participants, we are clarifying some aspects of the paper submission process for this year. (1) Invited submissions Every team that manages to outperform the previous year’s SOTA on at least one of the challenge tasks is invited to submit a paper. The leaderboards for previous year’s tasks can be found on our website: https://multimediate-challenge.org/Leaderboard/ For the cross-cultural, multi-domain engagement estimation task (new this year), we ask you to also report the combined CCC score on the test sets that were included last year (NoXI (base), NoXI (additional languages), MPII-GI). In case you do not outperform the previous year’s score on these test sets, you can still submit. Your submission will be judged in relation to the other methods submitted this year. (2) Submission Please send your submissions in pdf format directly to philipp.mueller(a)dfki.de and daksitha.withanage.don(a)uni-a.de Follow the instructions (https://acmmm2025.org/call-for-grand-challenge-participation/) and use the official template of ACM Multimedia. (3) Review process Submissions will undergo a peer review process that evaluates the scientific novelty and quality of the work. Make sure you provide adequate ablation experiments (at least on the validation sets) to underscore your contributions. Top performance is not a guarantee for acceptance if your paper lacks scientific novelty or suffers from a poor presentation. (4) Evaluation website The evaluation website will be up and running in the next days. Please let us know in case of any further questions! Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

2 1