Know a great AI tool or AI news source? Submit it to AiByts
AutoEMatic2 min read

AutoEMatic: Runtime-Adaptive Mixed-Precision LLM Inference via Automatic Exponent-Mantissa Refinement

Existing LLM post-training quantization techniques determine precision before inference begins, yet the precision a model requires varies dynamically across prompts, layers, and inference phases.

By Akshat Ramachandran, Reena Elangovan, Rangharajan Venkatesan, Charbel Sakr, Tijmen Blankevoort, Brucek Khailany, Tushar KrishnaarXiv - cs.AI

Read the full story

Originally published by arXiv - cs.AI on Nov 10, 2026.

Read on arXiv - cs.AI(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.