Reminder concerning evaluation rules
Dear all, please keep in mind that we have a limited number of test set evaluations per team (5). There are indications that some participants tried to get more test set evaluations by registering several email addresses. We did not have a technical means in place to avoid this - we will definitely add a compulsory registration step next year. To make this year’s competition as fair as possible, we take the following steps: (1) Every team needs to register. This means they send us the list of team members with affiliations, and a single email address that will be used for submitting evaluations. Send this information to both philipp.mueller@dfki.de <mailto:philipp.mueller@dfki.de> and daksitha.withanage.don@uni-a.de <mailto:daksitha.withanage.don@uni-a.de> Only test set evaluations from this email address will be counted, and we will monitor any possibly suspicious submissions from other email addresses. (2) To offset the advantage some teams might have had by registering several email addresses, we will allow for more test set submissions from the official team email addresses. The new limit for test set submissions will be 20. We hope that in this way we improve the fairness of the challenge. We acknowledge that it is not a perfect solution, and we will have better technical measures in place next year. Best, Philipp –––––––––––––––––––––––––––––––––––––––––––––––––––––– Dr. Philipp Müller Senior Researcher Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Stuhlsatzenhausweg 3, Campus D3 1 66119 Saarbrücken Germany +49 681 85775 7752 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Deutsches Forschungszentrum für Künstliche Intelligenz GmbH Firmensitz: Trippstadter Straße 122, D-67663 Kaiserslautern Geschäftsführung: Prof. Dr. Antonio Krüger (Vorsitzender) Helmut Ditzer Vorsitzender des Aufsichtsrats: Dr. Ferri Abolhassan Amtsgericht Kaiserslautern, HRB 2313 –––––––––––––––––––––––––––––––––––––––––––––––––––––– Website: https://www.dfki.de
participants (1)
-
Philipp Mueller