A Unified Hessian-Guided Framework for Post-Training Quantization
The paper proposes a unified post-training quantization framework for large language models that jointly optimizes quantization ranges, linear transformations, and weight rounding. It derives a Hessian-guided approximati...