PACT: a new head-to-head negotiation benchmark for LLMs
submitted by /u/zero0_one1 [link] [comments]
Emergent Price-Fixing by LLM Auction Agents
Given an open, optional messaging channel and no specific instructions on how to use it, ALL of frontier LLMs choose to collude to manipulate market prices in a competitive bidding environment submitted by /u/zero0_one1 [link] …
A multi-player tournament that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private conversations, form alliances, and vote to eliminate each other round by round until only 2 remain. A jury of eliminated players then casts deciding votes to crown the winner.
submitted by /u/zero0_one1 [link] [comments]
Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure
submitted by /u/zero0_one1 [link] [comments]
New Thematic Generalization Benchmark: measures how effectively LLMs infer a specific "theme" from a small set of examples and anti-examples
submitted by /u/zero0_one1 [link] [comments]