I was wondering if the organisers would consider lifting the limit of 100 submissions per participant. There is still some time to the end of the competition and I don't think it would be a problem form the fairness perspective.
In general I think limiting a total number of submissions is not a good idea, especially for competitions that are expected to lead to gainig insights in a domain. I simply think that having no limit on submissions encourages to try different, sometimes outlandish ideas that may lead to performace leaps.
Hello Adam,
this restriction is enforced by the limitations of our servers. We also want to discourage using the preliminary evaluation system as 'the ultimate' indicator of quality and promote teams which actually utilize the training data for the assessment of solutions before they decide to send them.
Nevertheless, the competition rules do not prohibit sending more than 100 solutions - the limitation is only to the number of solutions stored in the system. Older solutions can be deleted using the submission management system.
Best regards and good luck!
Andrzej Janusz
Thanks for clarification. I understand limiting the number of submissions in order to avoid excessive tuning or attempts to discover features of the evaluattion set -- but applied 20 min period between submissions seems reasonable to deal with those situations.
i must say that 100 stored solutions is more than enough!
Thanks!
