arXiv AI

InsightRAG: Aggregating Distributed Scholarly Judgments for Scientific Survey Generation

arXiv AI
Aug 20

Self-prompting and cross-model consensus enable reproducible data extraction from scientific literature with large language models

The paper investigates how large language models can extract contextualized data from scientific literature. It presents four workflows: expert‑written prompts, self‑generated prompts, autonomous literature discovery, and dataset creation from guidelines. While models perform well with prompts, they struggle with context, hallucinate references, and still need human oversight for final validation.

By Valentin Romanov, Monique Bax, Steven Niederer
arXiv Computation and Language
3d ago

SurveyGraph: Generating Academic Surveys via Methods-Entity Knowledge Graphs

SurveyGraph introduces a framework that uses a Methods‑Entity Knowledge Graph (MEKG) to encode relationships such as follow‑on, competition, and shared‑resource links between research methods. The graph enables core‑paper discovery, hybrid outlining, and evidence‑gated narrative synthesis, outperforming flat lexical baselines in recall and achieving strong citation support and semantic edge validation. The study demonstrates MEKG’s effectiveness through controlled benchmarks, diagnostic tests, and human adjudication, positioning it as an auditable structural layer for survey generation.

By Yifan Yuan, Yancheng Zhu, Zuoyu Zhang, Xiaogang Peng
Hugging Face Trending Papers
Aug 19

Self-prompting and cross-model consensus enable reproducible data extraction from scientific literature with large language models

The paper evaluates browser-based large language models (LLMs) for extracting detailed, contextualized data from scientific papers. It presents four workflows: (1) expert-curated prompts yield good extraction but struggle with nuance; (2) LLMs can generate effective prompts from simple instructions; (3) autonomous literature discovery is challenging, with missing or hallucinated references; (4) LLMs can build new datasets from guidelines that align closely with human experts, yet still need human oversight. The study outlines a practical, auditable workflow where experts set standards, models cross-check extractions, and researchers resolve disputes, enabling scalable scientific data curation.

arXiv AI
Oct 19

Optimist Deep Research: An Iterative, State-Centric Agent for Autonomous Literature Research

Optimist Deep Research is an open‑source agent that conducts literature research as an iterative, state‑centric process. It breaks a research question into a tree of subquestions, uses search intents to query multiple scholarly databases, and merges results into a provenance‑preserving document registry. The agent iteratively expands the registry via citation snowballing, evaluates evidence, and refines the research plan through a critic that can add, split, rephrase, deprioritize, or close subquestions, ultimately producing a report with every citation linked to a retrieved document.

By Gihan Panapitiya
Hugging Face Trending Papers
Aug 19

DeepWeaver: Bridging the Evidence Synthesis Gap in Open-Ended Question Answering

DeepWeaver addresses the evidence synthesis gap in open‑ended question answering by weaving noisy retrieved evidence into comprehensive answers. It introduces Thought Block Chains (TBCs) that organize claims, key information, and citations, allowing the system to revise and expand evidence before final generation. Evaluations on LoQA and DeepResearch Bench show improved content sufficiency, citation grounding, and detail preservation across multiple LLMs.

Hugging Face Trending Papers
3d ago

SurveyGraph: Generating Academic Surveys via Methods-Entity Knowledge Graphs

SurveyGraph introduces a framework that uses a Methods-Entity Knowledge Graph (MEKG) to generate academic surveys, addressing limitations of flat document retrieval by encoding method-level follow‑on, competition, and shared‑resource relations. The graph enables core‑paper discovery, retrieval, hybrid outlining, and evidence‑gated narrative synthesis, and is evaluated on retrieval, semantic edges, citation grounding, coverage, and generation components. Experiments show MEKG‑anchored fusion balances recall and structural density, graph‑aware retrieval nearly doubles recall over flat baselines, and a semantic evidence gate achieves an AUC of 0.75, with audits indicating strong citation support and relation accuracy.

arXiv AI
Aug 20

DeepWeaver: Bridging the Evidence Synthesis Gap in Open-Ended Question Answering

DeepWeaver is a framework designed to improve open‑ended question answering by weaving noisy retrieved evidence into comprehensive, well‑cited answers. It introduces Thought Block Chains (TBCs) that organize claims, key information, and supporting evidence, and uses subordinate TBCs to refine and expand the evidence before final generation. Evaluations on LoQA and DeepResearch Bench show that DeepWeaver enhances content sufficiency, citation grounding, and detail preservation across multiple LLMs.

By Xujia Wang, Yizhe Zhang, Bin Xu, Lei Hou, Juanzi Li