arXiv AI By Yue Zhao, Angela Huyue Zhang, S. Alex Yang, Hua Wei, Xiyang Hu

What LLM Agents See and What Users Say

Read the original on arXiv AI →

The paper investigates how large language model (LLM) agents decide whether to act on user requests when their tool outputs may be ambiguous. Using presupposition theory, the authors show that agents often act without confirmation when a lookup cannot distinguish between one or two records, and that the way search results are presented (listing, counting, or omitting) significantly affects this behavior. Experiments with Claude and GPT models reveal that counting a second record prevents action, while listing both records or user-provided claims can reduce erroneous actions.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 28

Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions

The paper investigates how short memory representations of large‑language‑model (LLM) group discussions affect final decision quality. It introduces CrossProfile, a benchmark of 480 hidden‑profile tasks that separates supporting, decoy, and irrelevant facts while keeping their wording constant. Experiments with Qwen2.5‑7B, Llama‑3.1‑8B, and DeepSeek models show that heuristics based on rarity or relevance both fail in predictable ways, and that the decision model’s social‑proof bias further degrades accuracy. Removing attribution tags or randomizing them improves performance, yet natural transcripts still lose more evidence than no notes at all.

By Anouar Imel, Imad Charradi, Abderrahman Sghir, Khalil El Khammar