The paper investigates how much information can be extracted from different internal representations of vision‑language models, focusing on two bottlenecks: low‑dimensional projections of the residual stream (via tuned lenses) and the final top‑k logits. It systematically compares the amount of retained information at these levels and finds that even the easily accessible top‑logit bottleneck can leak task‑irrelevant details from image queries, sometimes matching the leakage seen from full residual projections.
By Masha Fedzechkina, Eleonora Gualdoni, Rita Ramos, Sinead Williamson
The paper introduces GraphMemory, a lightweight graph-based memory system designed to improve token efficiency in test-time continual learning for large language models. By retrieving only relevant subgraphs for each query, GraphMemory keeps the amount of retrieved memory constant as more examples are processed, avoiding the token cost and performance degradation of traditional shared-context approaches. Experiments demonstrate that GraphMemory achieves competitive downstream performance while using roughly 81‑85% fewer memory‑construction tokens than baseline methods.
By Yehya Farhat, Michael Desmond, Anastasios Kyrillidis
PAPER2LLM++ is a framework that enables large language models to continually evolve by learning from new research papers. It treats each paper as a source of evidence and supervision, extracting findings, testing them against the current model, and converting them into learning signals when necessary. A try‑evaluate‑commit loop ensures that updates improve targeted behaviors without forgetting prior gains or harming general capabilities, allowing models to progressively incorporate new findings while retaining earlier improvements.
By Hongji Pu, Yilun Zhao, Wenpeng Yin
arXiv:2610.02800v1 Announce Type: new
Abstract: Speculative decoding accelerates autoregressive generation by using a lightweight draft to propose multiple tokens for parallel verification. However,...
By Chence Yang, Ningxi Cheng, Arash Akbari, Qitao Tan, Qingchan Zhu, Ci Zhang, Changdi Yang, Yanzhi Wang, Wei Niu, Jinhui Wang, Jin Lu, Geng Yuan
arXiv:2610.03128v1 Announce Type: new
Abstract: Quantitative trading strategy design aims to discover trading programs from historical data that remain effective in future markets, which can be viewe...
By Chaoqun Yang, Qian Wang, Fengbin Zhu, Xinyu Lin, Bingsheng He, Roger Zimmermann, Tat-Seng Chua
The paper investigates how modern selective state space models (SSMs), like Mamba2, behave in distributed learning settings. It derives architecture‑aware gradient and smoothness bounds for single‑ and multi‑layer selective SSMs, and provides convergence bounds for FedAvg and FedProx that incorporate recurrent stability, input‑dependent discretization, and state‑projection norms. Numerical experiments validate the theoretical bounds and compare nine federated learning algorithms on Mamba2 language modeling across six text domains, demonstrating that SSM‑specific bounds help interpret practical federated learning behavior.
By Adam Piaseczny, Md Kamran Chowdhury Shisher, Shiqiang Wang, Christopher G. Brinton
The paper introduces PROVE-REC, a two‑pass framework that generates verifiable preference proofs for large language model (LLM) recommendation systems. In Pass A, the model condenses user interaction histories into a compact proof of positive and avoidance claims linked to specific evidence entries. Pass B then uses only this proof and its evidence to predict the next item, ensuring the recommendation follows the reasoning path. Verification steps compare masked evidence and removed claims to confirm grounding and influence, while a ranking‑preservation objective retains useful historical information. Experiments on diverse real‑world datasets show PROVE‑REC outperforms strong baselines by up to 7.45%, producing claims that are both better grounded and more influential to recommendation quality.
By Yu Hou, Nathaniel Kang, Pengkai Wang, Hua Li
The paper introduces an AI-driven framework for thermal‑aware capacity planning in data centers, enabling temperature predictions in milliseconds by learning from key parameters such as rack power, server placement, and HVAC settings. The model is validated against high‑fidelity CFD simulations and achieves a 10,000‑fold speedup while maintaining high accuracy for unseen designs. This rapid prediction capability allows designers and operators to instantly optimize workload distribution and cooling efficiency.
By Yixing Li, Mark Fenton, Matthew Kaufeler, Ka Ming Leung, Xin Ai, Zhiyu Zeng
RASPER is a reward‑aligned summarizer that tailors the extraction of information from unstructured discharge notes to improve downstream clinical predictions. It uses a tunable LLM summarizer trained with reinforcement learning, where the reward comes from the loss of a downstream predictor, and incorporates patient‑specific context via a longitudinal encoder that soft‑prompts the summarizer with structured codes. The approach consistently outperforms strong baselines on readmission prediction and medication recommendation tasks in the MIMIC‑III and MIMIC‑IV datasets.
By Arya Hadizadeh Moghaddam, Mohsen Nayebi Kerdabadi, Chen Chen, Dongjie Wang, Zijun Yao
DyadMem introduces a new benchmark for evaluating how long‑term agents remember user‑specific relational information, called User‑conditioned Relational Agent Memory (URAM). The dataset contains 3,065 episodes, 50,961 sessions, and 61,210 QA pairs, with detailed annotations for memory capture, update, and recall across multi‑session trajectories. Experiments on 20 models show strong performance in a gold‑memory setting but a significant drop in full‑pipeline QA, highlighting gaps in current LLM memory capabilities.
By Yifei Tao, Xinyu Zhong, Henry Hengyuan Zhao, Fanyi Wang, Tengda Guo, Wentao Qiu, Ying Wang, Liujian Tang
The paper introduces ComInsight, a method for generating analytical reports from relational tables by composing verifiable atomic insights. It defines atomic insights as minimal executable analytical units, enumerates them from the database schema, and organizes them into a multi-relational insight graph. Composition operators then fuse these atomic nodes into higher-order conclusions, each accompanied by executable SQL and fine-grained provenance, achieving superior factual correctness, novelty, and structural completeness on three benchmarks.
By Teng Lin, Xinyu Liu, Nan Tang
The paper examines how different author representations affect zero‑shot authorship attribution (AA). It compares a label‑only prompting baseline with three strategies: representative writing samples, LLM‑generated descriptions, and style embeddings (LISA). The study finds that incorporating author‑specific representations improves performance, with a two‑stage LISA framework achieving the best results, while LLM‑generated descriptions offer a more compact but slightly less accurate alternative.
By Nudrat Habib, Tosin Adewumi, Sana Sabah Al-Azzawi, Marcus Liwicki, Elisa Barney
The Writerslogic team participated in the CLEF 2026 SimpleText shared task, tackling both text simplification (Task 1) and complexity spotting (Task 2). For simplification, they built a multi‑candidate pipeline with GPT‑4o‑mini, selecting the best candidate via a reference‑free heuristic, and their Claude Sonnet 4 submission achieved a SARI of 47.43 and BLEU of 14.21, ranking third overall on the Task 1 leaderboard. For complexity spotting, they fine‑tuned a DeBERTa‑v3‑large NLI model on 350 K labeled pairs, achieving a macro F1 of 0.8081 (0.8085 in an ensemble) on binary over‑generation identification and 0.804 accuracy on multi‑class error classification, placing them second among unique teams.
By David L. Condrey
The paper introduces the Language Model Agent Machine (LAM), a framework that quantifies the computational resources consumed by language‑model agents’ harnesses—such as bounded context, memory, tools, and verification. It presents four main theoretical results: (1) communication costs mapped to pebbling lower bounds, (2) memory‑access separations revealing a linear gap between random and non‑speculative access, (3) recomputation bounds for bit‑reversal DAGs that show when storing intermediate state is beneficial, and (4) reliability bounds that yield optimal verification intervals. Experiments on GPT‑6 Astra validate the theory’s predictions for communication, reliability, and trade‑offs in practical tasks.
By Zelin Zhao (Georgia Institute of Technology), Xinyu Guo (Georgia Institute of Technology), Jingyuan Zhang (Georgia Institute of Technology), Yuxuan Zhang (Etude AI), Yongxin Chen (Georgia Institute of Technology)
The article reviews the challenges and opportunities of detecting social bots amid the rise of advanced AI chatbots. It highlights gaps in current detection methods, especially regarding AI-generated conversations, and identifies emerging trends such as synthetic data generation, multimodal cross‑platform detection, low‑resource language support, and federated learning approaches. The authors propose these directions as promising avenues for future research.
By Emilio Ferrara
BioMol-MQA is a new question‑answering dataset focused on polypharmacy that combines a multimodal knowledge graph—containing both text and molecular structure—with challenging questions designed to test large language models’ ability to retrieve and reason over this diverse information. The dataset highlights the limitations of current retrieval‑augmented generation systems, which typically handle only single‑modality text, by demonstrating that existing LLMs perform poorly unless provided with the necessary multimodal background data. This underscores the need for more robust RAG frameworks capable of integrating multiple data types for accurate responses.
By Saptarshi Sengupta, Shuhua Yang, Paul Kwong Yu, Fali Wang, Suhang Wang
The paper introduces Percept-V, a dataset of 6,000 program-generated images across 30 domains designed to test simple visual perception skills from the TVPS-4 framework. Experiments show that state‑of‑the‑art multimodal large language models perform poorly compared to humans, especially as image complexity increases, and that fine‑tuning yields only limited generalization to related datasets. The study highlights specific perception skills that remain challenging for current models.
By Samrajnee Ghosh, Ashish Goswami, Naman Agarwal, Hemanshu Garg, Chinmay Mittal, Mausam, Parag Singla
The paper introduces a PyTorch library that unifies 55 hyperspectral image models across six deep‑learning paradigms, providing a common registry, automatic tensor adaptation, and standardized constructors. It includes 24 benchmark scenes from various sensors, with tools for data preprocessing, patch extraction, and rigorous train‑test partitioning to avoid overlap. Experiments on 1,320 model‑scene combinations show that scene difficulty outweighs architecture choice, with no single paradigm dominating and small models performing competitively with much larger ones.
By Tanishq Rachamalla, Aryan Das, Srishti Kaushik, Swalpa Kumar Roy
EditHero is presented as the first benchmark for long-horizon, part-level 3D editing, featuring natural-language instructions and target images for both geometry and texture. The benchmark uses a deterministic assembly engine that produces the exact target after each edit, and every sequence is manually reviewed. It compares non-agentic top‑down methods with LLM/VLM agent bottom‑up approaches, finding that the latter follow instructions more closely and preserve unedited parts better, though each edit takes minutes.
By Ruihan Yu, Yu-Ju Tsai, Muyao Niu, Runyi Li, Lian Fu, Hanqing Liu, Zheng-Hui Huang, Yonghao Yu, Sho Kuno, Ming-Hsuan Yang, Kaipeng Zhang, Zhixiang Wang
MEA is a multi‑agent framework that automates the selection and configuration of explanation tools for machine learning models across tabular, text, and vision data. A Proposer agent chooses appropriate tools based on the question and modality, while an Actor agent is trained end‑to‑end for faithfulness, producing natural‑language explanations. Experiments show that MEA outperforms existing post‑hoc explainers and closed‑source baselines, achieving significant faithfulness gains on six datasets.
By Yuyang Cheng, Raghav Kaushik Ravi, Srivarshinee Sridhar, Sriparna Saha, Akash Ghosh, Chirag Agarwal