Enhancing Local and Global Structure in Compressed AI Agent Memory
The paper argues that compressing AI agent memory by preserving only nearest neighbors can distort global relationships needed for consolidating, deleting, and comparing memories. It introduces local and global fidelity measures and a locality-aware quantization (LAQ) method derived from a proven bound on far-end rank violations, applied to OPQ codebooks without changing their bytes, rotation, or search procedure. LAQ improved global fidelity in all 52 held-out runs, including the external FinDER memory, and achieved the highest global fidelity among seven equal-size quantizers in all 12 Multi-Doc-2025 runs while scaling to a million passages.