arXiv AI By Haochuan Kevin Wang

Advertising to Agents: Measuring Description-Framing Bias in LLM Tool Selection

Read the original on arXiv AI →

The study investigates how sales language in tool registry descriptions influences AI agents’ tool selection. By creating paired listings that differ only in praise, verifiable specifications, or order, the authors found that stacked praise increased a tool’s pick rate by about 43 percentage points, while the first-listed tool was chosen roughly 72 points more often. Structured fields for numeric limits helped agents choose capable tools, but accompanying sales text could negate this benefit.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 24

TRACE: Agentic Catalog Enrichment with Multi-source Evidence Grounding

TRACE is a new framework that uses agentic Large Language Models to automatically enrich e-commerce product catalogs with missing or buried attributes. It employs a ScoutAgent to gather multimodal evidence from merchant catalogs, syndicated feeds, and web search, and a JudgeAgent to verify and publish the proposed attribute values. In offline evaluation, TRACE achieved 98.2% accuracy with 74.7% coverage, and in production it increased enrichment coverage by 90.4% and boosted checkout conversion by 0.48%.

By Rohan Kumar, Steven Xu, Kyle MacDonald, Matthew Long, Bernice Chow, Mac VanRenterghem, Sudeep Das
arXiv AI
Sep 24

Shopping by algorithm: How agentic AI deploys human heuristics as a surrogate consumer

The study investigates how Large Language Models (LLMs) acting as surrogate consumers are influenced by marketing pricing cues such as just‑below pricing and promotional framing. Using a tool called "Tool‑Lab" to trace information acquisition, the researchers found that when no cost is imposed, pricing cues rarely mislead LLMs, but when acquisition costs are introduced under a vague goal prompt, LLMs tend to omit important diagnostic attributes and make suboptimal choices similar to human heuristics. The findings suggest that marketing heuristics in AI‑driven shopping are shaped more by storefront information architecture than by inherent LLM limitations.

By Davood Wadi, Yu Ma
arXiv AI
Sep 17

Whom Do AI Agents Work For? Role Assignment Induces Sponsorship Bias in LLM Recommenders

The paper investigates how role assignment in large language model (LLM) recommenders influences sponsorship bias. By assigning the agent’s principal as either a traveler or a booking platform, the authors find that platform delegation reduces the penalty applied to sponsored listings and weakens consumer skepticism triggered by disclosure. The study also shows that stricter terminology and attribution to the platform widen the divergence in agent evaluations, indicating that current disclosure mandates are insufficient to protect consumers in AI-mediated commerce.

By Davood Wadi, Yu Ma
arXiv Machine Learning
Sep 16

Evaluating Open-Weight E-Commerce Agents with Environment-Grounded Verification

The paper introduces a deterministic, reproducible e‑commerce environment that pre‑commits customer and trajectory parameters, enabling a simulated consumer to attempt purchasing a target cart with the help of an evaluated model. The environment records every assistant action and state, allowing post‑trial evaluation of specific conversation components and applying penalties based on tool‑call accuracy. Using this setup, the authors benchmark eight open‑weight agents (20B–35B parameters) across 160 trials and 44 metrics, revealing nuanced performance issues such as under‑action, over‑purchase, unsupported product attributes, and poor search that are hidden by overall success rates.

By Nimit Shah, Haitz S\'aez de Oc\'ariz Borde