
Dear MultiMediate'24 participants, many thanks for your participation in the challenge! As a result of your efforts, we could make clear progress on Multi-Domain Engagement Estimation, Bodily Behaviour Recognition, and Eye Contact Detection. We consolidated the final leaderboard here: https://docs.google.com/spreadsheets/d/1TUsixmFEp__mL5_ix0Qj5GlIXoC5FQhgN87A... For these we included the approaches from previous years which were documented in a scientific publication. When writing your papers, it is important to correctly represent your achieved test results in relation to this table. In addition it is important to discuss the previously published approaches for the task you tackled: both in the related work section, as well as when discussing your results in the results or discussion section. Please be aware that we are evaluating achieved performance as well as scientific novelty and quality. This means that a submission reaching top performance on a task can still be rejected if the paper is badly written or does not provide meaningful insights. On the other hand, you can have good chances of acceptance even without top results if you can contribute to the scientific understanding of approaches and tasks. Please report all metrics from the leaderboard in your results tables or figures. E.g., for multi-domain engagement estimation please include all four CCC values (NoXi, NoXi Additional Languages, MPIIGroupInteraction, Overall). Please always support your method contributions with appropriate ablation experiments (on the validation set if the allowed test set evaluations were not enough). We strongly encourage publishing your source code. For submission, please mail your pdf to philipp.mueller@dfki.de mailto:philipp.mueller@dfki.de until July 19, 23:59 AoE. I will send you a receipt confirmation latest on the following day. Submission is single-blind, i.e. you can add your names to the paper, and you should refer to the team names you used on eval.ai. Please let me know in case of any further questions! Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de