arXiv Computation and Language By Van Bach Nguyen, Qianli Wang, Nils Feldhus, J\"org Schl\"otterer, Christin Seifert

SimXAI: A Simple Drop-in Layer Increases Interaction Quality and Understanding in Conversational XAI

Read the original on arXiv Computation and Language →

SimXAI is a lightweight, LLM‑centric conversational layer that replaces traditional intent recognition, dialogue management, and template‑based response modules in GUS‑style ConvXAI agents. By using a single tool‑calling LLM to interface with existing XAI resources, it provides a modular interface that improves function‑selection accuracy, faithfulness, and handling of context‑dependent requests. In a user study, substituting SimXAI for the conversational layer of the TalkToModel agent led to more accurate task completion in fewer turns, demonstrating enhanced conversational quality while preserving faithfulness.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Oct 21

Rethinking How to Remember: Beyond Atomic Facts in Lifelong LLM Agent Memory

The paper introduces TriMem, a memory system for lifelong LLM agents that stores raw dialogue segments, extracted atomic facts, and synthesized profiles to preserve detail, enable efficient retrieval, and support deep reasoning. It uses TextGrad-based prompt optimization to iteratively refine extraction and profiling prompts without updating model parameters. Experiments on LoCoMo and PerLTQA show TriMem outperforms strong memory baselines across multiple LLM backbones.

By Jingwei Sun, Jianing Zhu, Jiangchao Yao, Tongliang Liu, Bo Han
arXiv AI
Aug 19

Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges

The article surveys multi‑turn conversational AI, highlighting its shift from isolated text prompts to sustained, multimodal interactions that involve clarifying goals, revising requests, and switching topics. It reviews literature across text‑only dialogue, AudioLLMs, multimodal and omni‑modal systems, and tool‑augmented agents, organizing findings around datasets, models, training, evaluation, and cross‑cutting challenges. The analysis reveals that while multimodal perception and action have progressed rapidly, systems still struggle with persistent memory, cross‑turn grounding, full‑duplex interaction, robust evaluation, and cultural alignment.

By Syeda Faiza Ahmed, Zien Sheikh Ali, Hunzalah Hassan Bhatti, Firoj Alam, Shammur Absar Chowdhury
arXiv Machine Learning
Sep 11

Explainability Assistant: A Conversational XAI Interface for Interpreting Energy Consumption Models

The paper introduces the Explainability Assistant, an open‑source conversational XAI system designed to interpret complex energy consumption forecasting models. By leveraging large language model function‑calling, it achieves 94% intent‑parsing accuracy and supports flexible natural‑language interaction across different ML problem types without task‑specific fine‑tuning. A comparative evaluation with energy domain specialists shows improved usability and consistent task accuracy, with all experts preferring the conversational interface over a traditional XAI dashboard.

By Rodion Krjut\v{s}kov, Eduard Barbu, Nikos Sakkas, Sofia Yfanti
arXiv Computation and Language
Sep 23

Hy-MultiTurn: A Six-Dimensional Benchmark for Deep Multi-Turn Dialogue Understanding

Hy‑MultiTurn is a Chinese benchmark designed to evaluate deep multi‑turn dialogue understanding over long interactions. It introduces six controlled evaluation modes—constraint memory, precise execution, constraint synthesis, object localization, action suppression, and reference resolution—across 209 tasks ranging from 12 to 76 turns, incorporating dialogue length, irrelevant distractions, and colloquial phrasing. Testing 22 state‑of‑the‑art models shows the benchmark is highly challenging, with even the best model meeting all criteria only 41.1% of the time and no model excelling in every mode.

By Eileen Ye, Jiawen Tao, Yaoming Li, Chenxu Liu, Wenhan Yu, Yaxin Fan, Xiaokun Yuan, Mengzhou Wu, Yanbing Jiang, Maxm Pan
arXiv AI
Sep 10

An Auditable Symbolic-RAG-Generative AI Architecture for Goal-Oriented Conversation Orchestration

The paper introduces a Symbolic-RAG-Generative architecture called GRACE for goal‑oriented conversational systems. GRACE transforms business intent into a fixed objective set and uses a constrained policy to update the conversation state based on visitor‑authored evidence while ensuring visitor utility. Evaluation on real‑estate and professional‑cleaning dialogues shows high accuracy in state transitions, evidence precision/recall, and monotonicity.

By Ramon Gonzalez (Mentomy AI), Antonio Diaz (Mentomy AI)