AutoEMatic2 min read
AutoEMatic: Runtime-Adaptive Mixed-Precision LLM Inference via Automatic Exponent-Mantissa Refinement
Existing LLM post-training quantization techniques determine precision before inference begins, yet the precision a model requires varies dynamically across prompts, layers, and inference phases.
By Akshat Ramachandran, Reena Elangovan, Rangharajan Venkatesan, Charbel Sakr, Tijmen Blankevoort, Brucek Khailany, Tushar KrishnaarXiv - cs.AI
Read the full story
Originally published by arXiv - cs.AI on Nov 10, 2026.
Comments
Sign in to join the discussion.