“An AI trained for the 7-player version of Diplomacy using only self-play (without human data) was "destroyed" when playing against humans, even though the same training approach created a superhuman AI for a 2-player version of the game.”