arXiv Computer Vision August 26, 2026 By Sunwoo Kim

Wontopos Tablet 2: Measuring Multilingual and Multimodal Memory Retrieval Without Lexical Matching

Read the original on arXiv Computer Vision →

The paper evaluates the tablet‑2 long‑term memory engine on multilingual text benchmarks and cross‑lingual photo retrieval without lexical matching. Tablet‑2 achieves high accuracy on LongMemEval‑S (95.7%) and moderate accuracy on BEAM‑1M (67.5%), with minimal variance across runs. In multimodal tests, it outperforms BM25 on image‑cell recall and shows significant language‑dependent performance gaps, especially for low‑resource languages.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI

Jun 16

Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented Question Answering

arXiv:2606. 16494v1 Announce Type: cross Abstract: Knowledge-based visual question answering (KB-VQA) lets vision-language systems answer questions that exceed their parametric knowledge by conditioning a reader on passages retrieved from a Wikipedia-scale knowledge base.

By Jieyuan Liu, Jianyang Gu, Shijie Chen, Jefferson Chen, Zhen Wang

llms rag nlp multimodal benchmarks safety

arXiv AI

Jun 4

Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1)

arXiv:2606. 04240v1 Announce Type: cross Abstract: Retrieval over visually-rich documents, pages that interleave text with figures, tables, and charts, is essential for multimodal retrieval-augmented generation, yet most retrievers still discard the visual channel.

By Jingbiao Mei

llms rag fine-tuning multimodal

arXiv AI

Jul 21

Beyond Memory Leaderboards: Evaluating Scientific Memory as Budgeted Context Restoration

arXiv:2607. 16848v1 Announce Type: cross Abstract: Long-term memory is becoming a core component of LLM agents, but most memory benchmarks evaluate conversations or compact summaries, while research agents need to restore evidence from full scientific papers.

By Maksim Sheverev, David Finkelstein, Sergey Nikolenko

llms rag agents benchmarks

arXiv Machine Learning

Aug 4

Do Static Embeddings Add Value to Hybrid Dutch Retrieval?

arXiv:2608. 02112v1 Announce Type: new Abstract: Embedding benchmarks measure standalone model quality, but they do not establish whether a low-cost retriever contributes complementary ranking information once lexical and transformer-based retrieval are already combined.

By Ant\'onio Pereira Barata

llms rag benchmarks

arXiv Machine Learning

Jun 30

MemDelta: Controlled Baselines and Hidden Confounds in Agent Memory Evaluation

arXiv:2606. 29914v1 Announce Type: cross Abstract: Agent memory systems are increasingly evaluated against RAG and full-context baselines, but reported gains often mix changes in the memory method with changes in the language model, embedding model, or retrieval pipeline, making it unclear what is actually being measured.

By Kuan Wang

llms rag agents

Hugging Face Trending Papers

Aug 17

IndicQE-APE: A Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languages

Indic quality estimation (QE) and automatic post-editing (APE) data is spread across separate releases, so no single resource supports training and evaluation across tasks and language pairs on one footing. We consolidate the WMT 2020--2024 shared-task lineage with an extended English--Malayalam resource into \indicqe: $126{,}754$ instances over nine directional pairs, with up to four label types aligned on the same segment, a direct assessment, a human post-edit, word-level OK/BAD tags and an error explanation, and a test set stratified over four difficulty axes.

llms benchmarks

One email a morning, machine-written

Related stories

Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented Question Answering

Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1)

Beyond Memory Leaderboards: Evaluating Scientific Memory as Budgeted Context Restoration

Do Static Embeddings Add Value to Hybrid Dutch Retrieval?

MemDelta: Controlled Baselines and Hidden Confounds in Agent Memory Evaluation

IndicQE-APE: A Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languages