arXiv AI

From Citations to Contributions: LLM-Assisted Credit Scoring of Research Articles

The paper proposes a new method for credit scoring research articles that distinguishes between a paper’s original contribution and the prior work it builds upon. It introduces a hierarchical ‘contribution tree’ framework that conserves importance across a document’s structure and separates original from citation-derived credit. Large language models are employed as noisy comparative estimators to scale the analysis, and the approach is extended to collections of articles via weighted citation graphs to produce corpus-level contributions and normalized influence scores.

arXiv AI
Sep 25

Learning to Ideate for Scientific Impact

The paper "Learning to Ideate for Scientific Impact" explores using delayed signals of scientific uptake—specifically citation-normalized impact—as feedback to steer large language models toward generating high‑impact research ideas. The authors build a dataset of over 100,000 computer science papers, train a reward model to predict citation impact from goal‑idea pairs, and align an idea generator via supervised fine‑tuning and reinforcement learning. Evaluation with a reference‑grounded protocol shows that the RL‑tuned model consistently produces ideas with higher estimated impact than baseline models.

By Shubham Kale, Aniketh Garikaparthi, Manasi Patwardhan
arXiv AI
Oct 31

Attribution Gradients: Incrementally Unfolding Citations for Critical Examination of Attributed AI Answers

The paper introduces attribution gradients, a method to enhance AI-generated answers by consolidating evidence counts, supporting or contradicting excerpts, source links, and contextual explanations into a single view. It also enables the unraveling of second‑degree citations directly within the answer. A lab study shows that using the full gradient improves readers’ critical engagement and deepens their understanding compared to standard citation and document QA designs.

By Hita Kambhamettu, Alyssa Hwang, Philippe Laban, Andrew Head
arXiv Computation and Language
Sep 2

The Scientific Contribution Graph: Automated Literature-based Technological Roadmapping at Scale

The paper introduces the Scientific Contribution Graph, a large-scale resource that extracts 6 million scientific contributions from 655 k open-access papers across multiple disciplines and links them with 36 million prerequisite edges. It frames automated technological roadmapping as the task of identifying contributions and their prerequisites, and presents a new scientific prerequisite prediction task where models forecast which existing technologies enable future discoveries. The authors report that current models achieve a 0.48 MAP score on temporally-filtered backtesting, indicating rapid progress in this area.

By Peter A. Jansen