MPQ: A Message-Passing View of Post-Training Quantization
Post-training quantization (PTQ) is a key technique for efficiently deploying large language models, as it compresses weights into low-bit representations without retraining.
arXiv - cs.AI2 min read