ChainLoRA: Geometry-Preserving Task Vector Merging for Continual Learning in LLMs
Continual parameter-efficient fine-tuning for large language models (LLMs) must balance retention of previously acquired knowledge, adaptation to new tasks, and strict parameter budgets.
arXiv - stat.ML2 min read