Back to AI News
arxiv

An In-Silico Audit of Topographic Organization in a Multimodal Brain-Response Model

An audit of TRIBE v2, a multimodal model predicting fMRI responses across the cortical surface from video, audio and text, tests whether it reproduces classic topographic maps of sensory cortex. The model shows no contralateral hemifield response or polar-angle map, no tonotopic gradient in primary auditory cortex, and an eccentricity-like gradient that appears to reflect global image statistics rather than visual-field position. Motion selectivity is the exception: 22% of the 1% most motion-selective vertices fall in area MT+, which covers only 0.42% of cortex, indicating feature-identity experiments are viable while position-based mapping is not.

AI Brief

It delivers concrete, quantified evidence about which in-silico neuroscience experiments a leading brain-response model can and cannot support, a useful capability boundary for readers tracking AI models of the brain.

arXiv:2611.18105v1 Announce Type: cross Abstract: TRIBE v2 (d'Ascoli et al., 2026) predicts fMRI responses across the cortical surface from video, audio and text. Its authors validated it with category-selective localizers (faces, places, bodies, words) and language contrasts, but not with the classic topographic organization of sensory cortex: retinotopy, tonotopy, and motion selectivity in area MT+. There is a clear architectural reason to expect retinotopy to fail: TRIBE's video features are averaged over space before the response head, which should discard visual-field position. I present mapping stimuli, a fitting pipeline adapted from standard fMRI mapping analyses, and a stand-in model with known ground truth that serves as a positive and negative control, and apply them to TRIBE v2's predictions, comparing the fitted maps with human atlases using spin tests. TRIBE v2 shows a sharp split. There is no contralateral hemifield response and no polar-angle map, robustly across stimulus controls. There is no tonotopic gradient in primary auditory cortex: best frequencies span an interquartile range of only 0.14 octaves across core and belt, and the null persists with loudness-equalized tones. An eccentricity-like gradient appears only when the ring geometry changes, consistent with global image statistics rather than a positional code. In contrast, motion selectivity is strong and precisely localized: 22% of the 1% most motion-selective vertices fall in MT+, which covers 0.42% of cortex. In-silico experiments that depend on feature identity appear viable with TRIBE v2, while those that depend on visual-field or frequency position are not supported by the current model.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!