Hugging Face Trending Papers
ConvMem: Convolutional Memory for Long-Context Reasoning
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv Computation and Language
Sep 10
ConvMem: Convolutional Memory for Long-Context Reasoning
arXiv:2609.10441v1 Announce Type: cross Abstract: While Large Language Models (LLMs) have demonstrated impressive capabilities, they often struggle with extremely long contexts due to fixed context l...
arXiv AI
Jul 23
LISA: Linear-Indexed Sparse Attention for Efficient Long-Context Reasoning
arXiv:2607. 19358v1 Announce Type: new Abstract: Recent advances in long chain-of-thought reasoning models such as DeepSeek-R1 have led to increasingly longer inference context lengths under the test-time scaling paradigm.
arXiv AI
Aug 5
PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memory
arXiv:2608. 03048v1 Announce Type: cross Abstract: Long-context reasoning remains a critical bottleneck for large language models, as recent recurrent-memory approaches face two inherent challenges: sequential chunk-wise updates can overwrite early critical evidence with later irrelevant content, and serial inter-chunk dependencies limit parallelism and cause latency to increase with context length.
arXiv Machine Learning
Oct 22
LongZero: Enhancing Long-Context Reasoning in LLMs from Zero Data
LongZero is a reinforcement learning method that enables large language models to improve long‑context reasoning without external data. It works by having the model first generate a compact, structured question‑answer pair with supporting evidence, then expanding that evidence into a long, multi‑document context. The approach combines self‑written multi‑hop reasoning and multi‑round retrieval tasks, trained with GRPO, and outperforms baseline RL methods on five long‑context reasoning benchmarks.
arXiv Computer Vision
Oct 9
Look Back, Think Ahead: Visual Memory on Demand for Efficient Multimodal Reasoning
The paper introduces ViMoD, a lightweight framework that dynamically manages visual memory for multimodal large language models. ViMoD uses Deformable Aggregation of Region-wise Tokens (DART) to create content‑adaptive coarse representations linked to recoverable fine tokens, and Temporal Routing for Adaptive Contextual Evidence (TRACE) to anticipate and adjust evidence needs during reasoning. On the Qwen3‑VL‑4B model, ViMoD achieves superior performance across eight reasoning benchmarks with only a 20% visual token budget and minimal additional parameters.
arXiv AI
Oct 1
StateTree: Enhancing Long-Term Dialogue Reasoning via Reinforcement Learning
StateTree is a reinforcement learning approach that improves long‑term dialogue reasoning by building a tree‑structured auxiliary task from limited dialogue data. The method embeds key‑value records across multiple sessions into a binary tree, requiring the model to traverse from root to leaf, retrieve records, compare timestamps, and identify a target question among distractors. Curriculum RL training increases tree depth, and a compositional variant trains the model to combine partial reasoning fragments, enabling cross‑session retrieval, temporal reasoning, knowledge updates, and multi‑hop reasoning while generalizing from 10K‑token to 128K‑token contexts.