Know a great AI tool or AI news source? Submit it to AiByts
quant-ph2 min read

Scaling and Renormalization in Neural Networks: An Effective Renormalization-Group Description of Grokking

Grokking is a delayed transition from memorization to generalization in deep neural networks (NNs). We examine whether scaling and renormalization group (RG) theories can describe this dynamics, establishing a quantitative physical framework for neural generalization transitions.

By Min Chen, Junqi Wang, Zeguan Wu, Wenhao Huang, Junyu LiuarXiv cs.LG

Read the full story

Originally published by arXiv cs.LG on Oct 28, 2026.

Read on arXiv cs.LG(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.