arXiv AI

What Makes a Question Curious? Measuring Model Curiosity in Human-LLM Interactions

arXiv Computation and Language
2d ago

CuriousTogether: Implications of Curiosity and Cultural Grounding in Multi-Agent LLM Interactions

CuriousTogether is a framework that evaluates curiosity-driven interactions among multiple large language models (LLMs) across novelty-seeking, epistemic, and social curiosity dimensions. In eight tasks covering reasoning, creative generation, and social bias mitigation, curiosity-guided multi-agent settings outperform non-curious ones on seven of the eight tasks, achieving up to a 20.6% increase in story semantic diversity and a 14.9 percentage point drop in stereotype rates. The study also shows that country-conditioned cultural grounding can improve story generation and social tasks, though it may reduce precision in reasoning, and that inference-time curiosity-based multi-agent approaches offer better quality-token trade-offs compared to single-agent baselines.

By Angana Borah, Zoha Hayat Bhatti, Zhijing Jin, Rada Mihalcea
arXiv AI
Aug 11

How to Ask the AI: A User Perspective Survey for Large Language Model Prompting

arXiv:2608. 07494v1 Announce Type: cross Abstract: AI tools like ChatGPT and DeepSeek, powered by Large Language Models (LLMs), allow users to obtain instant and effective content responses simply by typing requests, such as ``plan a three-day Vienna trip'', ``solve the attached mathematical problem'', ``draft an email to inquire review progress'', etc.

By Yiqun Zhang, Yunfan Zhang, Mingjie Zhao, Sen Feng, Yiu-ming Cheung
arXiv AI
Aug 25

What Models Know, How Well They Know It: Knowledge-Weighted Fine-Tuning for Learning When to Say "I Don't Know"

The paper introduces Knowledge-Weighted Fine‑Tuning, a method that estimates an instance‑level knowledge score through multi‑sampled inference and uses it to scale the learning signal. This approach encourages large language models to explicitly say "I don't know" on out‑of‑scope queries while preserving accuracy on known questions. The authors also propose new evaluation metrics for uncertainty, demonstrating that better discrimination between known and unknown instances improves overall performance.

By Joosung Lee, Hwiyeol Jo, Donghyeon Ko, Kyubyung Chae, Cheonbok Park, Jeonghoon Kim
arXiv Computation and Language
Sep 28

Do we need to answer that question? Salience and Answerability of Potential Questions in Naturalistic Dialogue

The study examines whether the salience of automatically generated potential questions in naturalistic dialogue predicts whether they are answered. Using a dataset of 7,124 questions from the British National Corpus, the authors find a weak but significant positive correlation between salience and answerability, weaker than in monologic text. They also note that more structured interactions show stronger agreement among annotators than less organized dialogues.

By Amandine Decker (LORIA, UL, CNRS, SEMAGRAMME, GU), Maxime Amblard (SEMAGRAMME, LORIA), Ellen Breitholtz (GU)