Machine learningLLMs & Text

Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?

Research shows that large language models have difficulty acquiring new factual knowledge through fine-tuning, learning new information slower than consistent knowledge, and are more likely to hallucinate, indicating the risks of introducing new facts through fine-tuning.