arXiv AI

When to Assist and What to Suggest: Joint Gating and Memory-Grounded Hint Generation in One Compact Decoder

The paper introduces a compact decoder that jointly handles gating and memory‑grounded hint generation for proactive assistants. Experiments on 28,058 decision points show that a single 1B‑parameter decoder can match or surpass two‑model pipelines, achieving higher precision and lower compute costs while preserving hint quality. Human evaluations confirm the benefit of memory grounding and demonstrate that the single‑model approach performs comparably to a larger 8B pipeline.

arXiv Computation and Language
Oct 22

MemoProAgent: Toward Memory-Driven Proactive Assistance

MemoProAgent tackles memory‑driven proactive assistance by mining long‑horizon personal memories to decide when an assistant should intervene. The authors introduce MemoProBench, a benchmark pairing egocentric video with year‑long, distractor‑rich user memories and human‑verified trigger windows, and show that existing models perform poorly (≤15%). MemoProAgent uses a graph‑organized memory store and a lightweight RL stage to improve accuracy from <10% to 42.4% without training.

By Shenglai Zeng, Xiao Yang, Tiffany Ma, Xinyuan Zhang, Nanshu Wang, Deren Lei, Kai Sun, Xilun Chen, Tammy Stark, Xianhui Zhu, Yuetai Li, Rulin Shao, Tianxin Wei, Rakesh Wanga, Anuj Kumar, Jiliang Tang, Wen-tau Yih, Xin Luna Dong
arXiv Computation and Language
Oct 19

ProPerAgent: Toward Memory-Driven Proactive Assistance

The paper introduces ProPerMem, a benchmark for memory-driven proactive assistance that pairs egocentric video with long, distractor-rich personal memories and human-verified trigger windows. Baseline models perform poorly, achieving at most 15% accuracy, while an oracle-driven GPT-5.3-Chat model reaches 96% when given evidence inside the trigger window. Building on these insights, the authors develop ProPerAgent, a plug‑and‑play system that retrieves relevant memory from a graph store and uses lightweight reinforcement learning to improve proactive intervention accuracy to 42.4% without training.

By Shenglai Zeng, Xiao Yang, Tiffany Ma, Xinyuan Zhang, Nanshu Wang, Deren Lei, Kai Sun, Xilun Chen, Tammy Stark, Xianhui Zhu, Yuetai Li, Rulin Shao, Tianxin Wei, Rakesh Wanga, Anuj Kumar, Jiliang Tang, Wen-tau Yih, Xin Luna Dong
arXiv AI
Sep 4

Learning What Not to Forget: Long-Horizon Agent Memory from a Few Kilobytes of Learning

The paper introduces LRE (Learned Relevance Eviction), a lightweight, CPU‑only, language‑model‑free scorer that learns which parts of an agent’s interaction history are task‑critical and preserves them verbatim. In experiments, LRE matches or surpasses baseline eviction policies on accuracy‑cost trade‑offs, recovers 93% of full‑history accuracy, reduces worst‑case prompt size by 52%, and outperforms dense and token‑pruning encoders in conversational memory while being 295–1569× smaller. The method also achieves superior budgeted answer quality on LoCoMo reading and can be trained annotation‑free, recovering 95% of supervised scorer performance.

By Nusrat Jahan Lia, Aritra Mazumder
arXiv AI
Oct 12

Kairos: Toward a Byte-Level Foundation Model for Every Modality

Kairos is a byte‑level foundation model that integrates bidirectional gated‑DeltaNet linear attention, sliding‑window attention, block‑wise Attention‑Residual aggregation, a sparse Mixture‑of‑Experts feed‑forward layer, and a multi‑scale byte‑level codec. It is trained with a uniform‑noise denoising objective over a single byte space shared by text, image, audio, video, lidar, and control streams, and the authors provide code‑derived algorithms for each component, including a cross‑session recurrent‑state memory gate. Convergence sanity checks on a 440‑byte text sentence show that the two attention variants reach a minimum loss near 10⁻³, and the implementation appears to optimize, though generalization and multimodal performance remain to be evaluated in future pretraining runs.

By Fabien Furfaro
arXiv Machine Learning
Sep 18

Sample Count Is Not Enough: Candidate-Generation Strategy Shapes the Energy and Performance of LLM Test-Time Scaling

The paper demonstrates that the number of candidates generated during test-time scaling of large language models does not fully capture the system cost. By comparing different generation schedules (e.g., one batched call versus multiple serial calls) while keeping the total candidate count fixed, the authors show that serial calls consume significantly more GPU energy and latency. The study suggests that reporting candidate count alone is insufficient; evaluations should also include generation schedule and GPU-level metrics.

By Mobina Kashaniyan, Ali Jannesari