“LLMs struggle with long-term planning, effective exploration of solution spaces, and adjusting plans in response to unexpected errors.”