arXiv Computation and Language

Conversations in Space: Non-Linear LLM Interaction in Everyday Use

The paper introduces CanvasConvo, a system that presents large language model (LLM) conversations in two synchronized views: a traditional linear chat for ongoing dialogue and a spatial canvas that visualizes the conversation’s branching structure. In a five‑day field study with 24 participants, users tended to switch between the views rather than replace chat entirely; chat remained the primary interaction mode while the canvas was used for overview, revisiting, and exploring alternative paths. The results highlight challenges such as entrenched chat habits, smooth transitions between representations, and understanding branch context, offering insights for designing LLM interfaces that blend linear and non‑linear conversation representations.

arXiv AI
Aug 11

How to Ask the AI: A User Perspective Survey for Large Language Model Prompting

arXiv:2608. 07494v1 Announce Type: cross Abstract: AI tools like ChatGPT and DeepSeek, powered by Large Language Models (LLMs), allow users to obtain instant and effective content responses simply by typing requests, such as ``plan a three-day Vienna trip'', ``solve the attached mathematical problem'', ``draft an email to inquire review progress'', etc.

By Yiqun Zhang, Yunfan Zhang, Mingjie Zhao, Sen Feng, Yiu-ming Cheung
arXiv AI
6d ago

Mutable Transcripts: Mitigating Context Pollution through Editable Conversation State

The paper introduces mutable transcripts, an interaction paradigm that lets users edit prior turns in a chat, turning the conversation history into an editable state rather than a fixed record. A prototype was built and tested with 17 participants, who preferred mutable transcripts over standard chat for clarity, confidence, and ease of use, and reported less need to restart conversations. Analysis of user study transcripts shows that mutable transcripts can shorten conversations and remove outdated context, suggesting that user-driven revisions improve interaction quality.

By Dan Barry, Andrew Hines
arXiv AI
Jun 15

From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI

arXiv:2606. 14502v1 Announce Type: new Abstract: Large Language Models (LLMs) are undergoing a fundamental transformation from conversational generators into integrated AI systems capable of reasoning, action, memory, and self-improvement.

By Yongheng Zhang, Ziang Liu, Jiaxuan Zhu, Shuai Wang, Xiangqi Chen, Haojing Huang, Jiayi Kuang, Siyu Chen, Ao Shen, Hao Wu, Qiufeng Wang, Qian-Wen Zhang, Junnan Dong, Wenhao Jiang, Ying Shen, Hai-Tao Zheng, Yinghui Li, Di Yin, Xing Sun, Philip S. Yu
arXiv Computer Vision
Sep 10

The Living Library: Transforming Archival Collections into Conversational Knowledge Systems -- Lessons from the Theodore Roosevelt Presidential Library

The Living Library is an end‑to‑end framework that converts fragmented digital archives into governed, conversational exhibit experiences. Developed at the Theodore Roosevelt Presidential Library, it digitizes a 300,000‑record collection, enriches it with OCR and metadata, and publishes it to a hybrid dense/semantic index. The system supports curator review via the Archivist App, powers a researcher interface, and runs Talk to TR—a museum exhibit where a digital human embodiment of Theodore Roosevelt answers visitors’ questions using Cross‑Era Analogical Grounding and dual‑path retrieval to keep responses grounded and responsive.

By Pengce Wang, Lucia Ronchi Darre, Matt Briney, Michaell Bakalars, Dan Rutkowski, Ursula Hardy, David Wolf, Laura Hoffman, Allen Kim, Shawn Wright, Juan Lavista Ferres
arXiv Computation and Language
Aug 27

Semantic Variability of Replies Across LLMs: Implications for Designing Conversation-Based Assessment

The paper investigates whether replies generated by large language models (LLMs) stay semantically consistent when the underlying model changes. Using real collaborative conversation messages, the authors compared the semantic similarity of LLM replies across different models, both with and without preceding chat history. They found that both the choice of model and the conversational context influence response similarity and alignment with human replies, suggesting that prompting and context alone may not guarantee consistent responses as LLMs evolve.

By Jiangang Hao
arXiv AI
Aug 19

Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges

The article surveys multi‑turn conversational AI, highlighting its shift from isolated text prompts to sustained, multimodal interactions that involve clarifying goals, revising requests, and switching topics. It reviews literature across text‑only dialogue, AudioLLMs, multimodal and omni‑modal systems, and tool‑augmented agents, organizing findings around datasets, models, training, evaluation, and cross‑cutting challenges. The analysis reveals that while multimodal perception and action have progressed rapidly, systems still struggle with persistent memory, cross‑turn grounding, full‑duplex interaction, robust evaluation, and cultural alignment.

By Syeda Faiza Ahmed, Zien Sheikh Ali, Hunzalah Hassan Bhatti, Firoj Alam, Shammur Absar Chowdhury
arXiv AI
Sep 12

Exploring Multimodal Prompt for Visualization Authoring with Large Language Models

The paper investigates how large language models (LLMs) interpret ambiguous or incomplete text prompts for visualization authoring and introduces visual prompts as a complementary modality to improve precision. An empirical study informs the design of VisPilot, a system that allows users to create visualizations using text, sketches, and direct manipulation. A controlled user study and expert evaluation show that multimodal prompts help users convey spatial constraints, local references, and design preferences while maintaining task efficiency comparable to text-only prompting.

By Zhen Wen, Luoxuan Weng, Yinghao Tang, Runjin Zhang, Yuxin Liu, Bo Pan, Minfeng Zhu, Wei Chen