Back to AI News
arxiv

GALA: Gallery-Level Alignment for Real-Life Vision Decoding from EEG

The paper introduces incremental transductive calibration for EEG-based visual decoding, where a decoder is calibrated on unlabeled EEG and a known gallery of candidate images. It proposes GALA, a label-free method using shrinkage whitening, hubness correction, and Sinkhorn-Procrustes alignment with query frequencies estimated from the buffer. On THINGS-EEG-2 with a 200-image gallery, GALA raises top-1 accuracy for a new subject from 28% to 67% over 53 minutes of use. Across 60 evaluation settings, it is reported as the most accurate label-free method, averaging 6.6 points above the best competing method at the end of the stream.

AI Brief

It offers a practical label-free calibration approach that substantially improves cross-subject EEG decoding for deployed BCI systems.

arXiv:2611.24206v1 Announce Type: new Abstract: Neural decoding of visual experience from electroencephalography (EEG) has achieved strong performance in intra-subject settings, but current methods fail to generalize across individuals: on the standard 200-way benchmark THINGS-EEG-2, top-1 accuracy drops from above 80% within subjects to about 32% for an unseen subject. Adapting a pre-trained encoder to new subjects and sessions typically requires labeled data, a bottleneck whose collection time severely limits practical device deployment. In a practical Brain-Computer Interface (BCI), however, the possible outcomes are known in advance and form a gallery of candidates, and the unlabeled EEG of the user accumulates as soon as the device is used. We propose a new setting, incremental transductive calibration, in which the decoder is calibrated regularly on all the unlabeled EEG received so far and on the known gallery, without any labels. This setting is closer to the conditions of a deployed BCI than the zero-shot and batch evaluations in current use. We evaluate it with a protocol in which queries arrive one at a time, with unknown and possibly unequal frequencies, and each query is decoded before it is used for calibration. In this setting, we introduce GALA : GAllery-Level Alignment, a label-free calibration method which registers the unlabeled EEG embeddings onto the gallery through shrinkage whitening, hubness correction and a Sinkhorn--Procrustes alignment with query frequencies estimated from the buffer, updated after every query. On THINGS-EEG-2, with a gallery of 200 images, it raises the top-1 accuracy on a new subject from 28% to 67% over 53 minutes of use. Across 60 evaluation settings that vary the gallery size, the query frequencies and the number of repetitions averaged per query, GALA is the most accurate label-free method in every setting, 6.6 points above the best competing method on average at the end of the stream.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!