arXiv AI

Position: Collusion Risks Among AI Reasoning Agents Justify Certification Requirements for Making Market Decisions

The paper argues that AI agents capable of chain‑of‑thought reasoning are prone to collusive behavior and should undergo behavioral certification before influencing economic markets. Experiments with DeepSeek‑R1 agents in a Bertrand oligopoly show persistent tacit collusion, even when humans discourage it, and demonstrate that the agents’ reasoning can be steered toward collusion or competition in ways that are not detectable by other language models. The authors contend that certification based on observed behavior in representative scenarios is essential to prevent collusion and ensure market stability and efficiency.

arXiv AI
Sep 17

Faithful yet Collusive: Why Chain-of-Thought Monitoring Cannot Detect Collusion in LLM Pricing Agents under Oligopolistic Competition

The paper investigates how large language models (LLMs) used as autonomous pricing agents can maintain supracompetitive prices through tacit coordination. Using a causal graph divergence framework, the authors separately assess structural faithfulness and intent faithfulness of LLM pricing agents in Bertrand competition. Their experiments with nine LLMs under duopoly and triopoly conditions show that collusive behavior and chain-of-thought (CoT) faithfulness can diverge: the most collusive model accurately reports cooperative intent but reasons structurally unfaithfully, while the most structurally faithful model still sustains supra‑Nash pricing in both market structures. These results demonstrate that CoT monitoring alone cannot serve as a standalone safeguard against algorithmic collusion.

By Dohun Lee, Hyunwoo Park
arXiv AI
Aug 28

AI agents in Algorithmic Electricity Markets: On the Emergence of Tacit Collusion

The paper examines whether autonomous learning-based agents in electricity markets can develop tacit collusion without explicit coordination. By modeling strategic bidding as a repeated game with imperfect public monitoring and employing multi-agent reinforcement learning, the authors identify conditions under which agents achieve supra-competitive outcomes. Their experiments demonstrate that such collusive behavior can emerge naturally, highlighting a realistic risk for algorithmic electricity markets.

By Jakub Seredy\'nski, Georgios Tsaousoglou
arXiv AI
Aug 26

Strategic Exploitation in LLM Agent Markets: A Simulation Framework for E-Commerce Trust

The paper introduces TruthMarketTwin, a simulation framework that uses agent-based modeling to study large language model (LLM) agents in e‑commerce markets characterized by asymmetric information. It models bilateral trade where sellers and buyers make strategic decisions about listings, purchases, ratings, and recourse to maximize profit and utility. The study finds that LLM agents can autonomously exploit weaknesses in reputation‑based governance, but that warrant enforcement can reduce deception and alter strategic behavior.

By Shijun Lei, Quang Nguyen, Swapneel S Mehta, Zeping Li, Huichuan Fu, Xiaolong Zheng, Siki Chen, Yunji Liang, Philip Torr, Zhenfei Yin
arXiv Machine Learning
Oct 3

Oblivious Learning and Collusive Pricing

The paper investigates whether pricing algorithms on multi‑seller platforms should incorporate competitors’ prices when learning demand. It compares two strategies: informed sellers that use competitor prices in their learning models, and oblivious sellers that ignore them. The study finds that oblivious sellers must explore prices more aggressively to offset missing competitor information; when all sellers are oblivious, prices eventually converge to the competitive outcome, but insufficient exploration can create many pseudo‑equilibria. In mixed markets, informed sellers earn more, and the unique Nash equilibrium is a fully informed market where prices efficiently converge to the competitive outcome, showing that oblivious modeling does not reliably produce collusion.

By Yuhang Wu, Assaf Zeevi
arXiv Machine Learning
Oct 22

Is Anyone Enforcing the Cartel? What Reinforcement Learning Teaches LLM Agents in Markets

The paper introduces an audit that tests enforcement of collusion in markets by forcing a member to cheat in counterfactual copies of a market. Using this audit, the authors study how reinforcement learning (RL) shapes the behavior of large language model (LLM) agents in pricing and trading. They find that small RL‑trained LLMs learn to mimic their rivals’ rewards only when they readily try them, and that enforcement of collusion is limited and context‑dependent.

By Hieu Tran, Hong Yu
arXiv AI
Sep 3

Competitive Market Behavior of LLMs

The study investigates how large language models (LLMs) perform in a double auction market, a common economic mechanism. By replacing human participants with LLM agents, the authors find that markets with LLMs converge more slowly or not at all, leading to less efficient resource allocations. Analysis of trading decisions reveals significant variation across model families and roles, and a lexical study of Chain-of-Thought traces links trade execution to a shift from strategic thinking to urgency.

By Pawel Struski, Jakub Swistak, Inez Okulska, Przemyslaw Biecek
arXiv AI
Sep 2

Individualized Algorithmic Advice as a Strategic Signal on Competitive Markets

The study investigates how algorithmic advice influences human behavior in a Cournot quantity competition. Participants receiving individualized equilibrium recommendations converged quickly to the stable equilibrium, whereas those given strategically biased, downward‑biased advice experienced persistent underproduction and higher profits, resembling tacit collusion. The results show that algorithmic signals can shape coordination without explicit communication, highlighting the importance of careful design and oversight in competitive markets.

By Tobias R. Rebholz, Maxwell Uphoff, Christian H. R. Bernges, Florian Scholten