Probing the "Conscious" Mind: Selective Access and Global Workspace in Vision-Language Models
Researchers introduce the Multimodal Concept Lens (MC-Lens), a multimodal Jacobian lens for studying concept processing in vision-language models. The method maps intermediate vision-encoder and language-decoder states into a shared semantic space defined by the decoder's output vocabulary. Counterfactual interventions indicate that accessed concept information participates in downstream computation, and controlled VLM training shows selective access developing later than concept accessibility. Shared patterns of concept accessibility, query-dependent selectivity and cross-task intervention effects appear across VLM families and sizes despite internal differences.