Alice_Bob / catch-the-flip-leaderboard
PublictierB.csv, from your
copy of the workspace, then submit it here:
it is scored against the hidden labels of the test split, which only this notebook can read.score, where higher means more suspicious. The 30 % of the segments with the highest scores are
discarded, and the leaderboard shows the flip suppression : one minus the
fraction of flips among the kept segments, divided by the fraction of flips among all
segments. 0 means that the scores carry no information, 1 that every flip was discarded.
The score is shown with two decimals. For the jury it counts in points: none up to
0.30, all 10 from 0.55, and a straight line in between.
How to submit.
tierB.csv, press Save for the leaderboard and
sign in. This copies the file to the aqora store of the account that signs in, as
catch-the-flip/tierB.csv. From a laptop, catchtheflip.leaderboard.save("tierB.csv") does the
same for the account of aqora login.catch-the-flip/tierB.csv from your aqora store. It only
asks to read your storage, and it keeps a copy of exactly what it scored.parse_submission and
flip_suppression give the same number as catchtheflip.scoring.leaderboard_score,
which you can run on the validation split.