Factorization-Guided Training and Inference for Diffusion-Drafted Speculative Decoding
Speculative decoding accelerates large language model inference through parallel verification of tokens proposed by a drafter. Diffusion drafters further parallelize proposal generation, but greater proposal capacity or higher mean accepted tokens (MAT) need not yield higher throughput.
By Jiakun Fan, Min Xiao, Qiang Wang, Neiwen Ling, Zhichao Liu, Zhihao Jia, Dimitrios S. Nikolopoulos, Zijun WeiarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Oct 21, 2026.
Comments
Sign in to join the discussion.