arXiv Machine Learning By Luis F. Paul Tosta, Quinn Arnold, Gianluca Brero

Fast Iterative Combinatorial Auctions via Deep Reinforcement Learning

Read the original on arXiv Machine Learning →

FastCombo is a deep reinforcement learning method for iterative combinatorial auctions that learns price policies offline and applies them online with a single neural‑network forward pass. By formulating the problem as a partially observable Markov decision process, it assigns credit to queries that enable future decisions, thereby reducing the expected number of auction rounds. Experiments show that FastCombo achieves competitive clearing while cutting online price‑selection time by roughly 300–900 times compared to a standard Bayesian baseline.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jun 15

DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation

arXiv:2606. 14192v1 Announce Type: new Abstract: Auto-bidding is a core component of real-time advertising systems, where decisions must optimize long-term performance under budget and cost constraints, while online exploration is prohibitively risky.

By Miduo Cui, Haochen Wang, Shangqin Mao, Xun Yang, Qianlong Xie, Xingxing Wang, Xuri Ge, Ying Zhou, Zhiwei Xu
arXiv Machine Learning
Jul 22

JD-BP: A Joint-Decision Generative Framework for Auto-Bidding and Pricing

arXiv:2604. 05845v2 Announce Type: replace-cross Abstract: Auto-bidding services optimize real-time bidding strategies for advertisers under key performance indicator (KPI) constraints such as target return on investment and budget.

By Linghui Meng, Chun Gan, Shengsheng Niu, Chengcheng Zhang, Chenchen Li, Chuan Yang, Yi Mao, Xin Zhu, Jie He, Zhangang Lin, Ching Law
arXiv AI
Oct 2

Learning to Sell: Reinforcement Learning for Strategic Large Language Model Agents in Multi-Product Markets

The paper presents a reinforcement learning framework for training autonomous large language model agents to act as sellers in multi-product bargaining markets. It models the problem as a Partially Observable Markov Decision Process and introduces a structured message protocol to map natural language into a regulated decision space. Using Reinforcement Learning from Verifiable Rewards, the trained agents match limited inventory to buyers more effectively, achieving seller surplus extraction and allocation quality comparable to or better than trillion‑parameter models, and generalize to unseen market conditions.

By Shuze Daniel Liu, Claire Chen, Jiuqi Wang, David Simchi-Levi, Thorsten Joachims
arXiv AI
Sep 4

Data Market Design through Deep Learning

The paper tackles the data market design problem, which seeks signaling schemes that maximize revenue for an information seller. It applies deep learning to learn these schemes, addressing both obedience and incentive constraints, and demonstrates that the framework can replicate known theoretical solutions, extend to more complex scenarios, and suggest new optimal designs. The study builds on prior auction‑design work and introduces a novel approach for revenue‑optimal data markets.

By Sai Srivatsa Ravindranath, Yanchen Jiang, David C. Parkes
arXiv AI
Aug 18

Q-Regularized Generative Auto-Bidding: From Suboptimal Trajectories to Optimal Policies

arXiv:2601. 02754v3 Announce Type: replace-cross Abstract: With the rapid development of e-commerce, auto-bidding has become a key asset in optimizing advertising performance under diverse advertiser environments.

By Mingming Zhang, Na Li, Zhuang Feiqing, Hongyang Zheng, Jiangbing Zhou, Wang Wuyin, Sheng-jie Sun, XiaoWei Chen, Junxiong Zhu, Lixin Zou, Chenliang Li