ROSE: Risk-Aware Orthogonal Subspace Navigation for Lifelong Knowledge Editing in Multimodal Large Language Models
Researchers propose ROSE, a framework for lifelong knowledge editing in multimodal large language models that restricts parameter updates to the orthogonal complement of previously edited subspaces to reduce interference. ROSE adds a dynamically computed risk mask to protect factual parameter subspaces important for model stability, along with a multi-granularity inference strategy using prototype-anchored semantic gating and perturbation-driven subspace fusion. Experiments on two multimodal benchmarks show the method is competitive with state-of-the-art approaches across five metrics and remains stable over 1,000 sequential updates. Code is publicly released.
It offers a concrete method for sequential multimodal knowledge editing with a stability-focused design and released code, useful to researchers working on model updates without forgetting.
Comments & Questions (0)
No comments yet
Be the first to comment!