GEdit: Geometry-Aware Regularization for Knowledge Editing in LLMs
GEdit is a new framework for knowledge editing in large language models that uses a Low-Rank Plus Diagonal (LR+D) factor model to capture the geometric structure of Transformer FFN hidden representations. It introduces l...