Back to AI News
arxiv

LANCE: Bridging Low-Level Image Fusion and High-Level Semantic Understanding

Researchers propose LANCE, a framework that uses structured language as an explicit semantic state to connect remote sensing image fusion with downstream semantic tasks. A frozen vision-language model maps inputs to text records, a language-conditioned generator fuses imagery, and a dense verifier re-describes the output, using text-text consistency and contrastive losses without dense annotations or VLM fine-tuning. On seven test sets across four satellite sources, LANCE improves reduced-scale reference metrics by up to 11.7% and boosts downstream detection and open-vocabulary F1 scores over the closest competitor.

AI Brief

Provides a concrete, novel method that unifies image fusion and semantic understanding with measurable improvements on multiple benchmarks.

arXiv:2611.02896v1 Announce Type: new Abstract: Remote sensing image fusion and semantic interpretation are usually optimized separately, so reconstruction quality need not preserve downstream retrieval utility. We propose LANCE, which uses structured language as an explicit, indexable semantic state. A frozen vision-language model maps the input to a closed-vocabulary text record; a language-conditioned generator fuses the imagery; and a dense verifier with a differentiable continuous summarizer re-describes the output. Text-text consistency and anti-collapse contrastive text-mask losses with negative queries close the loop without dense annotations or VLM fine-tuning. A variational EM formulation yields a per-step contraction result under regularity assumptions, distinguishing semantic faithfulness from verifier overfitting. Across seven test sets on GF2, QuickBird, WorldView-III, and WorldView-II, LANCE improves reduced-scale reference metrics by up to 11.7% (median 2.1%) over the strongest learning baseline. Independent evaluation using a held-out VLM and a supervised aerial detector yields gains of +6.4 mAP and +0.072 open-vocabulary F1 over the closest competitor. Text perturbations, cross-verifier transfer, and pseudo-RGB ablations examine the mechanisms underlying these gains. The framework connects image fusion to verifiable semantic representations for multimodal retrieval and knowledge management.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!