arXiv AI

Decentralized LLM Workflows via Sequential Auctions

The paper introduces a scalable framework that uses decentralized markets of self‑interested agents to solve multi‑step tasks. It shows that when agents compete through sequential auctions, perfect competition fails because clones drive profits to zero, while no competition also collapses value extraction. By allowing heterogeneous agents to shade bids strategically, the authors demonstrate that imperfect competition can sustain profitable margins while still achieving high task success rates at low costs, evaluating four bidding algorithms across three auction protocols.

arXiv AI
Aug 21

The Bidding Games: Reinforcement Learning for MEV Extraction on Polygon Blockchain

arXiv:2510. 14642v2 Announce Type: replace-cross Abstract: In blockchain networks, the strategic ordering of transactions within blocks has emerged as a significant source of profit extraction, known as Maximal Extractable Value (MEV).

By Andrei Seoev, Leonid Gremyachikh, Anastasiia Smirnova, Yash Madhwal, Alisa Kalacheva, Dmitry Belousov, Ilia Zubov, Aleksei Smirnov, Denis Fedyanin, Vladimir Gorgadze, Yury Yanovich
arXiv Machine Learning
Jul 8

Strategic Bargaining in Multi-Buyer Markets: Reinforcement Learning from Verifiable Rewards for LLM Negotiations

arXiv:2607. 05863v1 Announce Type: new Abstract: Negotiation is a fundamental strategic interaction in management science, characterized by agents attempting to reach agreements while protecting private information, such as reservation costs and hidden valuations.

By Shuze Daniel Liu, Claire Chen, Jiabao Sean Xiao, Xin Chen, David Simchi-Levi
arXiv AI
Oct 2

Learning to Sell: Reinforcement Learning for Strategic Large Language Model Agents in Multi-Product Markets

The paper presents a reinforcement learning framework for training autonomous large language model agents to act as sellers in multi-product bargaining markets. It models the problem as a Partially Observable Markov Decision Process and introduces a structured message protocol to map natural language into a regulated decision space. Using Reinforcement Learning from Verifiable Rewards, the trained agents match limited inventory to buyers more effectively, achieving seller surplus extraction and allocation quality comparable to or better than trillion‑parameter models, and generalize to unseen market conditions.

By Shuze Daniel Liu, Claire Chen, Jiuqi Wang, David Simchi-Levi, Thorsten Joachims
arXiv AI
4d ago

Learning Rewards in Strategic Games

The paper investigates how to infer agents’ underlying incentives in strategic multi‑agent settings, where traditional inverse reinforcement learning (IRL) may fail to produce rewards that guide optimal play. It introduces the concept of strategic identifiability and shows that learning from a fixed pair of policies can be insufficient regardless of sample size. To address this, the authors propose an active IRL algorithm for two‑player repeated Stackelberg games, combining maximum‑likelihood estimation with experimental design to achieve finite‑sample guarantees on sub‑optimality, and validate the approach in an anti‑poaching scenario.

By Antoine Bergerault, Cyrille Kone, Giorgia Ramponi
arXiv AI
Sep 4

Data Market Design through Deep Learning

The paper tackles the data market design problem, which seeks signaling schemes that maximize revenue for an information seller. It applies deep learning to learn these schemes, addressing both obedience and incentive constraints, and demonstrates that the framework can replicate known theoretical solutions, extend to more complex scenarios, and suggest new optimal designs. The study builds on prior auction‑design work and introduces a novel approach for revenue‑optimal data markets.

By Sai Srivatsa Ravindranath, Yanchen Jiang, David C. Parkes