Balanced Accuracy Can Hide Silent Class Loss in Neural-Signal Test-Time Adaptation
A new arXiv paper evaluates full test-time adaptation across 11 dataset-encoder cells on Siena/EEG, PTB-XL/ECG and Sleep-EDF/EEG under fixed splits and update rules. It shows that in the binary case balanced accuracy can score a decoder that stopped predicting a minority class the same as one predicting both classes, with a class covering about a tenth of a subject's samples going unpredicted in 26-47 of 112 subject-cells versus 7-9 for controls. The study also finds the within-subject class contrast follows the encoder rather than the aggregate metric, with aggregate and contrast naming different encoders in 10 of 11 cells, and recommends reporting class-level and subject-level change alongside aggregate scores.