arXiv AI

Exploring Motivations for Algorithm Mention in the Domain of Natural Language Processing: A Deep Learning Approach

arXiv:2606. 29859v1 Announce Type: cross Abstract: With the rise of data-intensive science, algorithms have become central to scientific research.

arXiv Computation and Language
Aug 28

RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature

RATIO (Retrieval Across Typed Ideation Operations) is a large-scale benchmark designed to evaluate how well retrieval systems can support scientific inspiration. It defines relevance through three ideation moves—Address, Broaden, and Specify—each targeting different levels of abstraction in literature retrieval. The benchmark is built from millions of full-text CS papers using a novel discourse-marker distant supervision method, and includes extensive LLM and human vetting to ensure quality.

By Maayan Sharon, Tom Hope