Know a great AI tool or AI news source? Submit it to AiByts
LessWrong6 min read

Character Training for Risk-Averse Agents

Tl;Dr:We might be able to reduce harm from misaligned AI if it was sufficiently risk-averse, as it could be paid to cooperate rather than rebel (Thornley & MacAskill 2026).We think character training might be a good way to do this.We use a short spec/constitution to character train Gemma and Qwen…

By arav-dhootLessWrong
Character Training for Risk-Averse Agents

Read the full story

Originally published by LessWrong on Oct 16, 2026.

Read on LessWrong(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.