Know a great AI tool or AI news source? Submit it to AiByts
AI agents6 min read

Fixed-weight models are adversarially vulnerable: hence misaligned

This post argues that fixed-weight models (at least as we understand them today) will a) always be vulnerable to adversarial examples in their concept-spaces, and b) hence will be misaligned, under sufficient optimisation pressure.Boundaries in concept spaceTo serve any purpose whatsoever, an AI…

By Stuart_ArmstrongAlignment Forum
Fixed-weight models are adversarially vulnerable: hence misaligned

Read the full story

Originally published by Alignment Forum on Sep 28, 2026.

Read on Alignment Forum(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.