What a Weight Update Buys: Leverage Across Training Stages
Post-training moves a language model's weights by about a thousandth of their norm and changes its behavior sharply; pretraining moves them by a third and buys a slow drift.
By Shikhar ShiromaniarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Oct 30, 2026.
Comments
Sign in to join the discussion.