← Back to all news
arXiv Computer Vision By Xinyu Zhang, Junjie Chen, Jiawei Ge, Qianlong Li, Libin Ma, Baokun Pan, Yahui Luo

Grounded Product Understanding in Livestream Videos

Read the original on arXiv Computer Vision →

The paper introduces GPUB, a large-scale benchmark for grounded product understanding in e‑commerce livestream videos, featuring 3,000 livestreams, 31K fashion products, and multi‑moment temporal annotations. It defines three evaluation tasks, with the main task (GPrU) requiring simultaneous product identification and moment localization. Existing multimodal models perform poorly on GPrU, prompting the authors to develop UniPro, which improves performance by learning product‑aligned, temporally structured representations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv AI
Aug 24

TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming

TLive-Omni is an omni‑modal understanding model designed for e‑commerce live streaming, integrating image, video, audio, and text inputs into a unified representation. It introduces Per‑vGrid for timestamped token organization, a three‑stage supervised training pipeline, and a Faithful‑RFT reinforcement fine‑tuning stage to enhance answer faithfulness and expression quality. The model is supported by a scenario‑oriented capability taxonomy and a compact data production engine that generates training signals for tasks such as speech recognition, product visual grounding, and omni‑modal QA, achieving strong performance on live‑commerce benchmarks and good generalization to general tasks.

By Yibo Hu, Yu Qian, Mao Gu, Yingfan Tao, Yuhao Chen, Yongdong Luo, Zhuoqun Liu, Meiguang Jin, Junfeng Ma
fine-tuningmultimodalbenchmarkssafety
More like this →
arXiv AI
Jun 19

VCG: A Multimodal Retrieval Framework for E-Commerce Video Feeds under Extreme Cold-Start Conditions

arXiv:2606. 19627v1 Announce Type: cross Abstract: The digital commerce landscape is shifting from static, search-driven catalogs to dynamic, immersive video feeds.

By Katya Mirylenka, Egor Malykh, Mahdyar Ravanbakhsh, Michael Gygli, Marco-Andrea Buchmann, Andrew Dzhoha, Svitlana Borzenko, Francesca Catino, Mohamed Gaafar, Maarten Versteegh, Thomas Kober, Dario d'Andrea, Ellie Langhans
llmsragmultimodal
More like this →