Know a great AI tool or AI news source? Submit it to AiByts
RL5 min read

LoReFT GRAFT Better at Preventing RL Grift

tl;dr. I show that the recently introduced GRAFT method can be improved upon by using a single layer rank 1 Low-rank Linear Subspace Representation Fine Tuning (LoReFT) adapter as the FORGET adapter, using only 0.029% of the parameters of the one used in the GRAFT paper.

By Samuel KnocheLessWrong
LoReFT GRAFT Better at Preventing RL Grift

Read the full story

Originally published by LessWrong on Oct 24, 2026.

Read on LessWrong(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.