DictLLM: Dictionary-Based Post-Training Compression for LLMs
DictLLM is a new post-training compression method that decomposes weight matrices into a shared dictionary and layer-specific sparse coefficients, using SVD and Hessian-based sparsification and quantization. It achieves...