← Back to all news
arXiv AI By Pengteng Li, Yunfan Lu, Pinghao Song, Wuyang Li, Huizai Yao, Hui Xiong

EventVL: Understand Event Streams via Multimodal Large Language Model

Read the original on arXiv AI →

EventVL introduces the first generative event-based multimodal large language model (MLLM) designed for explicit semantic understanding of event streams. The framework leverages a newly annotated dataset of nearly 1.4 million event–image/video–text pairs and incorporates an Event Spatiotemporal Representation to capture comprehensive event information, along with Dynamic Semantic Alignment to refine sparse semantic spaces. Experiments demonstrate that EventVL outperforms existing MLLM baselines in event captioning and scene description generation tasks, advancing the field of event vision.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Computer Vision
Sep 23

TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action

arXiv:2505.01583v2 Announce Type: replace Abstract: Understanding causal event relationships and achieving fine-grained temporal grounding in videos remain challenging for vision-language models (VLM...

By Jen-Hao Cheng, Yi-Hao Peng, Huapeng Zhou, Vivian Wang, Huayu Wang, Hsiang-Wei Huang, Wenhao Chai, Hou-I Liu, Kuang-Ming Chen, Cheng-Yen Yang, Yi-Ling Chen, Vibhav Vineet, Qin Cai, Jenq-Neng Hwang
llmscomputer-visionmultimodalbenchmarks
More like this →
arXiv Computer Vision
Sep 16

Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation

Hyper-RED introduces a scalable image-to-event pretraining framework that transfers high‑order semantic structures via hypergraphs, avoiding rigid pixel‑wise alignment. By constructing image, event, and cross‑modal hypergraphs and applying a hypergraph relational distillation loss, the method preserves local relational consistency and event‑specific characteristics while inheriting image‑derived semantic organization. Experiments across five event datasets show consistent scaling from ViT‑S to ViT‑L and state‑of‑the‑art performance.

By Meisen Wang, Zhiqiang Tian, Wei Bao, Chengjie Wang, Shaoyi Du, Siqi Li
efficiencymultimodalbenchmarkssafety
More like this →
arXiv AI
2d ago

MEV: A Multi-Event Video Dataset for Long-Take Generation

MEV is a multi‑event video dataset created to support long‑take video generation. It contains high‑quality real‑world videos where subjects perform distinct, non‑overlapping events with precise temporal boundaries and fine‑grained procedural annotations. The dataset includes a comprehensive annotation pipeline that segments videos into temporally grounded events and generates structured captions at both global and event levels, enabling event‑centric evaluation and improved long‑take event transitions in generation experiments.

By Peiyuan Zhu, Shaoan Xie, Yifan Shen, Wen Tian, Zijian Li, Guangyi Chen, Kun Zhang
diffusionfine-tuning
More like this →