“The game Diplomacy is arguably the most difficult major AI benchmark because its action space is effectively all possible natural language sentences that can be used for negotiation.”