Re: IMPORTANT ANNOUNCEMENT
by janek - Saturday, April 15, 2017, 20:18:36

The Leaderboard is online. Scores of all correctly evaluated solutions which had been submitted before the April 11, were set to 0.

Andrzej Janusz

Re: IMPORTANT ANNOUNCEMENT
by janek - Saturday, April 15, 2017, 15:19:59

Dear Participants,

the new test data set is available in the Data files folder and the evaluation system is finally online. However, we do need some more time to maintain the Leaderboard. Until we finish, scores of your new solutions will be visible only in your Submissions folder.

I would like to sincerely thank you for your patience. Good luck during the last month of the challenge :-)

I would also like to use this occasion to wish you all a joyful Easter!

Andrzej Janusz

Re: IMPORTANT ANNOUNCEMENT
by dymitrruta - Monday, April 10, 2017, 22:11:16

Dear Andrzej, while the presented motivation is reasonable, this action writes off many hours of work and wastes many GFlops of comp. power which is not a good outcome. To minimize the damage I encourage immediate publishing of validation labels to avail lengthy models retrain asap. Dymitr

Re: IMPORTANT ANNOUNCEMENT
by janek - Wednesday, April 12, 2017, 09:28:03

Dear Dymitr,

unfortunately, due to the bug that caused this situation, the game_ids which we currently have are not reliable (if they were reliable we would not have this problem).

Andrzej

Re: IMPORTANT ANNOUNCEMENT
by dymitrruta - Wednesday, April 12, 2017, 07:20:30

Very helpful would also be the game_id for the training set data. With that extra information the contestants would be able to simulate the realistic scenario of validating on the separate games data rather fall into the risk of overfitting through in-game training and validation. Cheers. Dymitr

Re: IMPORTANT ANNOUNCEMENT
by janek - Monday, April 10, 2017, 22:54:58

Dear Dymitr,

I do realize that for many participants our decision means a significant loss of time and resources. I hope that at least some of models that you already tested can be reused to make predictions for new data.

Regarding the validation labels, I uploaded a file named deprecated_testLabels.7z to the Data files folder.

Andrzej

Re: IMPORTANT ANNOUNCEMENT
by janek - Friday, April 14, 2017, 18:27:38

Dear Participants,

we have an unexpected delay in processing the new test data and for this reason, the submission system will not be reopened until tomorrow, April 15. 

I am very sorry for this delay and I would like to thank you for your patience.

Andrzej Janusz