Know a great AI tool or AI news source? Submit it to AiByts
PolyGraph2 min read

PolyGraph: Plan-Buffered CUDA Graphs for Adaptive Speculative Decoding

Adaptive speculative decoding changes the active batch size B and draft length d from one decode step to the next, whereas a CUDA Graph replays a fixed launch configuration.

By Junchao YangarXiv cs.LG

Read the full story

Originally published by arXiv cs.LG on Oct 21, 2026.

Read on arXiv cs.LG(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.