ShamAN-Q: Shampoo Augmented NanoQuant for Sub-1-bit LLM Weights
We introduce ShamAN-Q, a sub-1-bit post-training quantization method that extends NanoQuant by replacing each its diagonal reconstruction geometry with a tractable dense curvature metric, using a general paradigm popularized by the Shampoo optimizer.
arXiv cs.LG2 min read