“Current AI models struggle to generalize and perform well on tasks or with knowledge that falls outside of their pre-training corpus or specific reinforcement learning training.”