Hugging Face Trending Papers

HiVE-VQA: Hierarchical Interaction via Volumetric Embedding for Video Quality Assessment

Read the original on Hugging Face Trending Papers →

HiVE-VQA introduces a new approach to no-reference video quality assessment by leveraging a single frozen JEPA-based video foundation model. The method extracts token grids from multiple depths of a pre‑trained V-JEPA 2.1 encoder, stacks them into a hierarchical spatio‑temporal volume, and fuses them with a lightweight 3D convolutional head. With only 5.2 M trainable parameters, HiVE-VQA outperforms 17 state‑of‑the‑art methods on both intra‑dataset and cross‑dataset benchmarks, demonstrating that depth‑wise hierarchical fusion from a frozen backbone is both effective and efficient.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv Computer Vision
Sep 16

High-Fidelity Video Quality Assessment with VQA-Specific Saliency

High-Fidelity Video Quality Assessment (HFVQA) is a new framework that uses fixed-size spatio‑temporal patches across multiple scales, including the original resolution, to preserve low‑level quality cues and semantic context. It incorporates a lightweight auxiliary network that learns VQA‑specific saliency directly from quality supervision, enabling the model to focus on the most important spatio‑temporal regions. By combining high‑fidelity cues with task‑specific saliency, HFVQA achieves state‑of‑the‑art performance on standard no‑reference VQA benchmarks while processing only about 12% of the candidate patches, making it computationally efficient.

By Hakan Emre Gedik, Shashank Gupta, Alan Bovik
arXiv AI
Sep 4

LRConv-NeRV: Low Rank Convolution for Efficient Neural Video Compression

LRConv-NeRV introduces low‑rank separable convolutions into the NeRV neural video decoder, replacing selected dense 3x3 layers to reduce computational load and memory usage. By applying low‑rank factorization progressively from the largest to earlier decoder stages, the method offers controllable trade‑offs between reconstruction quality and efficiency. Experiments show that applying LRConv only to the final decoder stage cuts decoder complexity by 68% and model size by 9.3% with negligible quality loss, while INT8 quantization preserves performance close to the dense baseline.

By Tamer Shanableh
arXiv Computer Vision
6d ago

Rethinking Evaluation for Video Capsule Endoscopy: Validation Protocol, Source-Video Diversity, and Cross-Dataset Shift

The paper introduces DMSNet, a deformable adaptive multi‑scale edge‑guided attention network for video capsule endoscopy (VCE) classification. It evaluates DMSNet and 18 other architectures on the Kvasir‑Capsule dataset using both random frame‑level and source‑video‑disjoint validation protocols, reporting MCC scores of 0.442 and 0.456 respectively. The study also examines cross‑dataset performance on CV2024, the impact of source‑video diversity, and shows that model rankings and accuracy vary significantly with validation protocol, training source diversity, and external dataset shift.

By Smriti Regmi, Debesh Jha
arXiv Computer Vision
Aug 25

VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding

arXiv:2607.14935v2 Announce Type: replace Abstract: Recent advances in video understanding have spanned motion, long video, and streaming interaction, driving this field toward real-world application...

By Xinhao Li, Yuhan Zhu, Xiangyu Zeng, Yuhao Dong, Haoning Wu, Zhiqiu Zhang, Yuandong Yang, Changlian Ma, Qingyu Zhang, Yansong Shi, Xinyu Chen, Haoran Chen, Zizheng Huang, Jun Zhang, Kun Ouyang, Lin Sui, Ziang Yan, Yicheng Xu, Chenting Wang, Yinan He, Hongjie Zhang, Yi Wang, Yu Qiao, Yali Wang, Ziwei Liu, Kai Chen, Limin Wang