June 2024 - Multimediate Challenge - lists.hcics.simtech.uni-stuttgart.de

Evaluation phase starting
by Philipp Mueller 30 Jun '24

30 Jun '24

Dear MultiMediate participants, The evaluation phase is starting now. You can submit your validation and test set predictions at https://hcai.eu/challenges/web/challenges/challenge-page/23/overview There is also an additional update concerning the multi-domain engagement estimation task. Anonymising the speeddating dataset proved to be more difficult than expected, to the extent that we can not be sure that participants identities are protected if we use the dataset as part of the challenge. To protect our participants we therefore had to take the decision to not include the speeddating dataset as an evaluation set. As a result, we have three remaining test sets for this task: NOXI (MultiMediate’23 version), NOXI (additional languages), and MPIIGroupInteraction. If you plan to submit to the engagement estimation track, you are required to evaluate on all three of these datasets. The required features for the test sets are made available on the download pages for NOXI and MPIIGroupInteraction. For NOXI they are already available, for MPIIGroupInteraction they will be on Monday - unfortunately our website admin was already on their weekend when we contacted them on Friday. Please let us know in case of any further questions! Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

1 0

Updates on solution (paper) submission
by Philipp Mueller 30 Jun '24

30 Jun '24

Dear Multimediate participants, we have updates on the paper submission process. In total, we will be able to accept a maximum of three solution papers across all tasks. They will be reviewed with respect to performance and scientific quality. Paper submission deadline: July 12 Acceptance notification: July 22 Camera ready due: August 4 Furthermore, we are currently in the process of setting up the evaluation server, where participants will be able to upload their test set predictions. Test sets will be released by June 28. Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

2 1

Update on challenge paper submission
by Philipp Mueller 10 Jun '24

10 Jun '24

Dear MultiMediate participants, many thanks for all your replies to my earlier message. The good news is that we could convince the ACM MM conference organisers to allow submissions of challenge solution papers! We are currently clarifying the exact process with the grand challenge chairs and will get back to you as soon as we know more. Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

1 0

Important Updates on Solution Paper Submission
by Philipp Mueller 05 Jun '24

05 Jun '24

Dear MultiMediate’24 participants, to our surprise, we received news from the ACM Multimedia grand challenge chairs that this year, there will not be the possibility for challenge participants to submit solution papers to the conference. We asked the grand challenge chairs already on March 27 for the details on the submission process but only got a reply last week. In our understanding, being able to publish a solution paper at ACM Multimedia is one of the primary motivations of participating in the challenge (and it was the default policy during the last 3 years). Together with other grand challenge organizers, we are currently trying to convince the grand challenge chairs to reconsider their decision. We would be very interested in your take on this as challenge participants. So, please write us to what extent the inability to submit a solution paper would impact your participation in our challenge. Also, please indicate whether it is okay for you to cite from your response (including your name and affiliation) when writing to the grand challenge chairs. Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de

7 6