Machine learningLLMs & Text

KIF: Knowledge Identification and Fusion for Language Model Continual Learning

The paper presents Task Skill Localization and Consolidation (TaSL), a new framework for language models that enhances knowledge transfer and prevents forgetting, improving the balance between old and new knowledge.