“Once LLMs learn examples with new knowledge through fine-tuning, their tendency to hallucinate increases, according to Gekhman et al. (2024).”