ChainFlow: Few-Step Latent Flow Matching for Speculative Decoding
Speculative decoding has become a standard way to accelerate LLM inference: a lightweight drafter proposes tokens that the target verifies in one parallel pass.
arXiv - cs.AI2 min read