arXiv Computation and Language

CLUE: A Contrastive Learning Framework for Unsupervised Event Type Induction and Annotation

The paper introduces CLUE, a contrastive learning framework that automates event type induction, naming, and annotation without relying on domain experts. It proposes a joint embedding representation that captures both verb-centric and semantic aspects of events, and uses contrastive loss–guided clustering to induce event types. The framework also includes a method for refining and naming the induced event types, and experimental results demonstrate its effectiveness.

arXiv Computation and Language
Aug 25

A Scalable Cross-Domain Event Extraction System via a Unified Generative Training Framework

The paper introduces a scalable cross‑domain event extraction system built on a unified generative sequence‑to‑sequence framework. It jointly handles event detection and argument extraction, allowing both pipeline and end‑to‑end configurations. By fine‑tuning pretrained language models on multiple event datasets from diverse domains, the system retains domain‑specific semantics while generalizing across large, evolving label spaces, and offers a web‑based application for researchers to upload documents, extract events, visualize triggers and arguments, and compare configurations.

By Siting Liang, Omar Adjali, Omair Shahzad Bhatti, Daniel Sonntag
arXiv Computation and Language
Aug 25

A Multi-Domain and Multi-Task Generative Framework with Explicit Task and Domain Conditioning for Cross-Domain Event Extraction

The paper introduces a unified multi-domain and multi-task generative framework for event extraction that incorporates explicit domain conditioning signals and task-specific prompts. This design allows a single model to adapt dynamically to different event schemas without needing full event label sets during inference, supporting both pipeline and end-to-end extraction. Experiments on various benchmarks show competitive performance, strong cross-domain generalization, and practical scalability while maintaining domain-specific precision.

By Siting Liang, Omar Adjali, Daniel Sonntag
arXiv AI
Sep 15

EventVL: Understand Event Streams via Multimodal Large Language Model

EventVL introduces the first generative event-based multimodal large language model (MLLM) designed for explicit semantic understanding of event streams. The framework leverages a newly annotated dataset of nearly 1.4 million event–image/video–text pairs and incorporates an Event Spatiotemporal Representation to capture comprehensive event information, along with Dynamic Semantic Alignment to refine sparse semantic spaces. Experiments demonstrate that EventVL outperforms existing MLLM baselines in event captioning and scene description generation tasks, advancing the field of event vision.

By Pengteng Li, Yunfan Lu, Pinghao Song, Wuyang Li, Huizai Yao, Hui Xiong
arXiv Computer Vision
Sep 16

Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation

Hyper-RED introduces a scalable image-to-event pretraining framework that transfers high‑order semantic structures via hypergraphs, avoiding rigid pixel‑wise alignment. By constructing image, event, and cross‑modal hypergraphs and applying a hypergraph relational distillation loss, the method preserves local relational consistency and event‑specific characteristics while inheriting image‑derived semantic organization. Experiments across five event datasets show consistent scaling from ViT‑S to ViT‑L and state‑of‑the‑art performance.

By Meisen Wang, Zhiqiang Tian, Wei Bao, Chengjie Wang, Shaoyi Du, Siqi Li
arXiv Computer Vision
Sep 21

MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction

MemeTAG introduces a dual‑objective framework for classifying harmful memes by combining keyword generation from a pretrained Vision‑Language Model with an Aggregated Tag Inference Network (ATIN) that condenses these keywords into a rich semantic embedding. The embedding is used as a target for an auxiliary reconstruction loss, encouraging deep alignment between visual and textual features. This approach, along with a three‑stage training strategy, achieves new state‑of‑the‑art results on the HarMeme, Hateful Memes Challenge, and PrideMM datasets.

By Akshit Sharma, Prashant W. Patil
arXiv Computer Vision
Aug 25

Mapping the Concept Landscape: Structural Perception of Global Distributions for Transparent Data Pruning

The paper introduces Mapping the Concept Landscape (MCL), a framework that replaces high‑dimensional feature embeddings with explicit sample‑level graphs of entities, events, and attributes for image‑caption pairs. By aggregating these graphs into a dataset‑level graph, MCL captures the global distribution of semantic concepts and identifies rare concepts. A greedy algorithm then selects samples to maximize coverage of under‑represented concepts, achieving better pruning efficiency and providing a transparent audit trail.

By Dongyue Wu, Tao Ma