Demis Hassabis, Andrej Karpathy, and Elon Musk discussed using the game Diplomacy to test AI. One AI researcher took them up on it and built a new game called "AI Diplomacy." He found that OpenAI's o3 ...

By modifying the classic strategy game Diplomacy into a game that AIs could play against one another, we felt we could accomplish two goals at once: We’d be able to measure how models work in a ...