arXiv AI

Evidence-Grounded SLM Behavioral Prediction Architecture for Future Assistance Use

The paper introduces Evidence‑Grounded Local Behavioral Prediction (ELBP), a four‑layer architecture that uses deterministic interaction processing, dual‑view behavioral representation, small language model (SLM) prediction, and evidence verification with abstention to forecast future assistance use. Evaluated on three instruction‑tuned SLMs, the best model (Qwen2.5‑3B) achieved an F1‑score of 0.80 and PR‑AUC of 0.84, outperforming raw‑event prompting and XGBoost by significant margins. With evidence verification and selective abstention, the system’s selective F1 rose to 0.84 while maintaining 91% coverage and 96% evidence support, demonstrating that structured behavioral representation and evidence‑verified prediction enhance reliability in on‑device SLM forecasting.

arXiv AI
Sep 4

Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluation

The paper presents a unified framework for proactive service agents, defining proactivity as an agent’s ability to infer service opportunities from incomplete signals and decide whether to remain silent, ask, assist, or act. It models this as a partially observable sequential decision process constrained by authorization and risk, integrating timing, content, and delivery into a single structured action. The authors categorize existing methods along a decision pipeline—state and need estimation, intervention gating, action construction, and feedback adaptation—and propose standardized metrics for evaluating triggering, timing, calibration, user burden, safety, and policy value across diverse interaction modalities.

By Yan Tang, Tingyu Cao, Yuanbo Tang, Huaze Tang, Keer Hu
arXiv AI
Aug 19

Explicit State Elicitation Is Not Enough: A Controlled Audit of Memory-Policy Classification

The paper investigates how personalized agents decide to use, ignore, update, or query retrieved user memory before acting on a task. An empirical audit protocol is developed to test structured intermediate outputs, revealing that while exposing state definitions improves accuracy, an explicit state-output field does not significantly enhance policy accuracy for large language models. The study also shows that example-level accuracy overstates consistency, with full four‑way family success being rare, and that providing benchmark‑associated state labels merely conditions predictions rather than proving internal fidelity.

By Yihang Chen, Pin Qian, Su Wang, Chong Peng, Huan Xu, Shuaiting Li, Yiqi Sun
arXiv AI
Sep 4

Speak for Me: Giving LLMs the Situational Awareness to Participate in a Meeting

The paper introduces CAPA, a Collaborative Agent Predictive Architecture designed to give large language model (LLM) agents situational awareness in online meetings. CAPA uses a Perceiver to update meeting state, a Predictor to forecast conversation flow, a Controller to decide speaking actions, and a Generator to phrase contributions. Evaluated on 137 AMI meetings, CAPA reduces the silence rate from 51.4% to 2.5%, doubles credited recovery, and maintains low hallucination, demonstrating that structured state tracking is key to effective delegation.

By Muneeb Khan, Frederic Kirstein, Terry Ruas, Bela Gipp
arXiv AI
Jul 7

ASK in the Dark: Uncertainty-Gated LLM Assistance under Partial Observability

arXiv:2607. 02686v1 Announce Type: new Abstract: Reinforcement learning agents operating under partial observability must act on incomplete information, making them natural candidates for guidance from small language models (SLMs) that carry broad reasoning priors.

By Juarez Monteiro, Nathan Gavenski, Guilherme Lima, Francisco Galuppo, Odinaldo Rodrigues, Adriano Veloso