Hugging Face Trending Papers

From Single- to Cross-Document: Benchmarking Multi-Granularity Event Analysis of Large Language Models

Event analysis is an essential and fundamental direction of information extraction, involving various event-centric tasks at different granularity of documents. While large language models (LLMs) have preliminarily achieved promising performance in part of these tasks individually, their capability in event analysis still lacks comprehensive understanding due to restricted document granularity, task designs, and data source of existing benchmarks.

arXiv Computation and Language
Aug 25

A Scalable Cross-Domain Event Extraction System via a Unified Generative Training Framework

The paper introduces a scalable cross‑domain event extraction system built on a unified generative sequence‑to‑sequence framework. It jointly handles event detection and argument extraction, allowing both pipeline and end‑to‑end configurations. By fine‑tuning pretrained language models on multiple event datasets from diverse domains, the system retains domain‑specific semantics while generalizing across large, evolving label spaces, and offers a web‑based application for researchers to upload documents, extract events, visualize triggers and arguments, and compare configurations.

By Siting Liang, Omar Adjali, Omair Shahzad Bhatti, Daniel Sonntag
arXiv Computation and Language
Aug 25

A Multi-Domain and Multi-Task Generative Framework with Explicit Task and Domain Conditioning for Cross-Domain Event Extraction

The paper introduces a unified multi-domain and multi-task generative framework for event extraction that incorporates explicit domain conditioning signals and task-specific prompts. This design allows a single model to adapt dynamically to different event schemas without needing full event label sets during inference, supporting both pipeline and end-to-end extraction. Experiments on various benchmarks show competitive performance, strong cross-domain generalization, and practical scalability while maintaining domain-specific precision.

By Siting Liang, Omar Adjali, Daniel Sonntag
arXiv AI
Sep 15

Enhancing Event Candidate Acquisition for Event Linking

The paper introduces MACE, a Multi-Agent Candidate Event acquisition method designed to improve event linking by refining event structure before the linking step. MACE employs evidence-specialized large language model agents to gather time, location, participant, and event-type evidence, exposes intermediate queries to candidate-event lookup tools, and allows a coordinator to revise the evidence set before final candidate construction. Experiments on two event linking benchmarks demonstrate that integrating MACE consistently boosts accuracy across different event linking models without altering the underlying models.

By Ziyang Zhang, Yinan Liu, Boyi Xue, Yingxuan Huang, Bin Wang, Xiaochun Yang
arXiv Computation and Language
Aug 24

Granuscore: A Reference-Free Measure of Granularity for Text Analysis and Question Answering

Granuscore is a reference‑free metric that measures the granularity of text by exploiting the structure of a hierarchical embedding space. It successfully reproduces known hierarchical orderings on the Granola‑EQ dataset, distinguishes granularity across different discourse contexts, and explains sentence‑specificity variations beyond sentence length. The authors also apply Granuscore to four question‑answering benchmarks, revealing systematic differences in granularity among questions, gold answers, and model outputs, thereby offering a new lens for assessing QA dataset difficulty.

By Lukas Ellinger, Alexander Fichtl, Miriam Ansch\"utz, Georg Groh
arXiv AI
Sep 2

Automated Event Log Generation from Unstructured Text Using Finetuned LLMs

The paper introduces a scalable framework that uses finetuned large language models (LLMs) to translate unstructured textual resources into structured event logs for process mining. By creating a new text-to-log dataset and finetuning LLMs on it, the authors demonstrate that the resulting models produce high‑fidelity event logs, outperforming few‑shot or zero‑shot prompting methods. This approach enables previously unused organizational data, such as incident tickets and manuals, to be incorporated into process mining workflows.

By Maximilian Seeth, Gabriel Marques Tavares, Daniel Schuster
arXiv Computation and Language
Sep 11

CMNIE: An Information Extraction Benchmark for Chinese Military News

CMNIE is a new benchmark for extracting structured information from Chinese military news, covering event triggers, arguments, named entities, and entity relations under a unified schema. The dataset contains 13,000 manually annotated instances with 7 event types, 10 argument roles, 7 entity types, and 8 relation types. Experiments show that current supervised models, zero‑shot LLMs, and fine‑tuned LLMs struggle with relation extraction and exact span matching, highlighting the challenge of joint structured extraction in this domain.

By Yan Yu, Mengna Zhu, Zhenyu Song, Hao Yang, Haiwen Chen, Mao Wang
arXiv AI
Aug 24

MGAL: A Multilingual Granularity-Aware Long-Context Benchmark

MGAL is a new multilingual benchmark for evaluating long‑context large language models, built from United Nations reports in six official UN languages and covering 8K to 128K tokens. It tests four linguistic granularities—word, sentence, paragraph, and document—while also stratifying examples by their position within the document (begin, middle, end). Experiments show that models excel at word‑level tasks but struggle with coarser granularity, and that closed‑source models outperform others in lower‑resource languages, revealing challenges such as local semantic crowding and a fluency‑consistency gap.

By Chunhan Li, Chenglin Xu, Zongyang Zhang, Jiale Liu, Zhuoxi Rao, Xudong Jia, Junxiu He, Menglin Yang, Wenjuan Gong, Zhengzhe Liu, Chengwei Qin