I tried to enlarge training set by adding deprecated test data. I supposed that l need to concatenate chunk5,6,and 7 in this order and fill decision with "deprecated test labels"
Then I tried cross-validation only on old train set and only on the new set (deprecated)
In first case I got ~ 0.79 roc auc, In second ~ 0.59 which means complete random in labels.
So my question is - in which order shall one match deprecated labels? The best way would be obtaining file with pairs: gamestate_id - decision for deprecated data.
Thanks in advance!