“An LLM's lack of direct world experience limits its common sense and its ability to find new solutions when facing a situation for the first time.”