“Naively relying on a large language model's intrinsic capability for self-correction without external feedback may not lead to performance improvement.”