arXiv AI By Ziyu Chen, Yilun Zhao, Arman Cohan

Measuring the Gap Between Human and LLM Research Ideas

Read the original on arXiv AI →

arXiv:2607. 01233v1 Announce Type: cross Abstract: LLMs are increasingly used to brainstorm research ideas, but existing evaluations mostly judge individual ideas by novelty, feasibility, or expert preference.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 24

LitPivot: Developing Well-Situated Research Ideas Through Dynamic Contextualization and Critique within the Literature Landscape

LitPivot is a tool that supports researchers in developing well-situated research ideas by dynamically linking literature exploration with idea refinement. It introduces literature-initiated pivots, where engaging with relevant papers prompts revisions to an idea, and vice versa, updating the set of pertinent literature. In a lab study with 17 participants, users produced higher-rated ideas and reported a stronger understanding of the literature space, while an open-ended study with five participants illustrated how LitPivot facilitates iterative idea evolution.

By Hita Kambhamettu, Bhavana Dalvi Mishra, Andrew Head, Jonathan Bragg, Aakanksha Naik, Joseph Chee Chang, Pao Siangliulue
arXiv AI
Sep 25

Learning to Ideate for Scientific Impact

The paper "Learning to Ideate for Scientific Impact" explores using delayed signals of scientific uptake—specifically citation-normalized impact—as feedback to steer large language models toward generating high‑impact research ideas. The authors build a dataset of over 100,000 computer science papers, train a reward model to predict citation impact from goal‑idea pairs, and align an idea generator via supervised fine‑tuning and reinforcement learning. Evaluation with a reference‑grounded protocol shows that the RL‑tuned model consistently produces ideas with higher estimated impact than baseline models.

By Shubham Kale, Aniketh Garikaparthi, Manasi Patwardhan