arXiv AI

MindFlow: Mind Supernet Powered Thinking Flows for Research Idea Innovation

MindFlow is a framework that treats research idea generation as a graph-structured flow of modular thinking operators, guided by a probabilistic mind supernet. It dynamically samples thinking flows for a given topic and optimizes them through a tournament-based ranking to favor higher-quality ideas. The approach also introduces an evaluation protocol that jointly assesses problem finding and solving, moving beyond simple title or abstract judgments.

arXiv Computation and Language
Aug 27

Mind2Report: Expert-Level Commercial Report Synthesis via Cognitive Deep Research Agent

Mind2Report is a cognitive deep research agent designed to produce expert-level commercial reports from large, noisy web sources. It first clarifies detailed commercial intent to build a structured outline, then recursively gathers and validates evidence into a research memory that evolves with the outline, enabling iterative synthesis of comprehensive reports. The authors also introduce QRC‑Eval, a benchmark of 200 real-world commercial tasks, and show through extensive experiments that Mind2Report outperforms existing proprietary and open-source deep research agents, with ablation studies confirming the contribution of each component.

By Mingyue Cheng, Daoyu Wang, Qi Liu, Shuo Yu, Xiaoyu Tao, Yuqian Wang, Chengzhong Chu, Yu Duan, Mingkang Long, Enhong Chen
arXiv Machine Learning
Jul 17

Idea2Plan: Exploring AI-Powered Research Planning

arXiv:2510. 24891v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have demonstrated significant potential to accelerate scientific discovery as valuable tools for analyzing data, generating hypotheses, and supporting innovative approaches in various scientific fields.

By Jin Huang, Silviu Cucerzan, Sujay Kumar Jauhar, Ryen W. White
arXiv AI
Sep 1

Ideation Arena: Evaluating LLM Generated Research Ideas with Battle-style Human Expert Assessment

Ideation Arena is a battle-style platform that evaluates research ideas generated by large language models (LLMs) and research agents through pairwise human assessment. The system builds shared literature contexts, collects over 6,000 double-blind comparisons from 105 computer science researchers, and constructs an Elo rating leaderboard to rank proposal-stage expert preferences. It also introduces Ideation Arena Eval, a benchmark to test whether automated evaluators align with human preferences, finding that current LLM judges achieve at best 72.56% Soft Accuracy on overall quality.

By Zhiyu Chen, Keyu Zhao, Jigao Fu, Dong Liang, Yanbiao Wu, Jiaoyang Li, Haidong Xue, Xinhua Zeng, Yuanyi Zhen, Fengli Xu, Yong Li