Final Score
by neuralnite - Saturday, September 14, 2024, 03:07:10

What does the final score represent?

RE: Final Score
by maciejswiech - Wednesday, September 18, 2024, 13:36:01

The final score is the MSE on the test set.

The lowest MSE among the 3 solutions selected by the team for the final evaluation.

The scores are higher on this set due to many reasons such as overfitting to the shared data and greater ranges of rankings on the test set.

RE: Final Score
by mcognetta - Wednesday, September 18, 2024, 14:54:17

Is it possible for you to manually inspect the scores and tell us the scores for each of the final 3 submissions? At least for the teams with invited papers?

The three models we chose used very different techniques (by design, since we weren't sure of how the final test set would be distributed), so knowing which was best changes our paper dramatically.