arXiv Computation and Language By Haolin Chen, Hongyi Dong, Yu Zhu, Yijia Hong, Leiqing Niu, Jiyuan Ye

Ontology-Guided Multi-Agent Extraction of Evaluation Objects from Academic Review Texts: Evidence from Chinese Library and Information Science

Read the original on arXiv Computation and Language →

The paper introduces an ontology‑guided multi‑agent framework for extracting evaluation objects from academic review texts, addressing challenges such as abstractness, context‑dependency, and ambiguous type boundaries. The system combines candidate discovery, ontology‑constrained classification, and domain review, achieving high precision (90.33%) and recall (84.55%) and outperforming rule‑based and zero‑shot baselines. Ablation studies show that the multi‑agent workflow boosts recall and stability, while ontology‑based constraints improve fine‑grained classification and reduce category confusion.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
6d ago

FlyAOC: Evaluating Agentic Ontology Curation of Drosophila Scientific Knowledge Bases

FlyAOC is a benchmark that tests AI agents on end‑to‑end ontology curation of Drosophila scientific literature. Given a gene symbol, a brief description, a large paper corpus, and ontology resources, agents must search for evidence and produce structured annotations such as function terms, expression patterns, and historical synonyms. The benchmark contains 7,397 expert‑curated annotations across 100 genes and evaluates different agent harnesses, revealing system‑level failure modes that single‑task evaluations miss.

By Xingjian Zhang, Sophia Moylan, Ziyang Xiong, Qiaozhu Mei, Yichen Luo, Jiaqi W. Ma
arXiv AI
Jul 14

Automated Textbook Auditing with Multi-Agent LLM Systems

arXiv:2607. 11276v1 Announce Type: cross Abstract: Ensuring the quality of educational materials requires more than standard proofreading: textbooks must be audited for factual accuracy, domain-specific technical correctness, and linguistic quality simultaneously -- a task that general-purpose grammar checkers cannot address.

By Ciprian Cristescu, Adrian-Marius Dumitran, Angela-Liliana Dumitran, Gabriel Stefan
arXiv AI
Aug 18

An Agentic Framework Using Rules and LLMs for Embedding and Annotating Descriptive Document Layouts: A Plant Science Use Case

arXiv:2608. 14587v1 Announce Type: new Abstract: Background: Recent advances in information retrieval (IR) leverage both dense and sparse representations, large language models (LLMs), and specialized retrieval models to improve ranking accuracy, relevance, and cross-lingual performance.

By Nicolas Turenne, Youcef Sklab, Eric Chenin, Jean-Daniel Zucker
arXiv AI
Jul 20

Behavioral Controllability of Agentic Models for Information Extraction: From Fixed Workflows to Reflective Agents

arXiv:2607. 15715v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly used for complex information-extraction tasks, yet it remains unclear whether agentic components such as reflection and memory lead to observable and controllable improvements over fixed LLM workflows.

By Lujia Zhang, Xingzhou Chen, Hongwei Feng