The Persona Hierarchy Model: Understanding Contextual Generalization in Fine-Tuning LLMs

Language models are routinely fine-tuned under a fixed context, such as a generic system prompt, persona or domain-specific instruction, yet the learned behavior sometimes stays confined to that context and sometimes broadly generalizes to unseen contexts.