Axis-LoRA: Probing and Adapting Embedding Models for Personal-Memory Retrieval
Researchers find that frozen dense embedding models poorly capture time, place, person, and event axes in personal-memory retrieval, with axis changes barely shifting embeddings. They propose Axis-LoRA, a per-axis adapter with four LoRA branches and a per-query gate, which improves retrieval accuracy on benchmarks like LongMemEval, ATM-Bench, and LoCoMo while training only a small fraction of parameters.