arXiv Computer Vision By Ambuj Mehrish, Anindya Nag, Sebastiano Vascon

Query-Conditioned Spherical Centroid Aggregation for Multimodal Retrieval

Read the original on arXiv Computer Vision →

The paper introduces SCALAR, a query‑conditioned spherical centroid aggregator that assigns relevance‑based weights to each available modality before computing a spherical centroid. SCALAR supports arbitrary modality subsets, is trained with rank‑8 LoRA adapters on masked views, and achieves positive aggregation gains on four of five benchmarks, outperforming prior symmetric aggregators. With only 4.8 million trainable parameters, SCALAR attains the highest text‑to‑video R@1 on three benchmarks and surpasses the released GRAM checkpoint under test‑time modality dropout by 3.2 to 10.9 R@1.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 19

MLLM Frame Subset Ensembling for Audio-Visual Video QA and MLLM-based Reranking for Ad-hoc Video Search in TRECVID 2025

The paper describes the CERTH-ITI team’s approach to the TRECVID 2025 Ad-hoc Video Search (AVS) and Video Question Answering (VQA) tracks. For AVS, a two-stage framework uses foundation vision‑language models for initial retrieval and a Multimodal‑LLM for reranking, improving contextual matching without training. In VQA, an audio‑visual MLLM is fine‑tuned and enhanced with inference‑time scaling; answer generation employs majority voting over responses from random frame subsets, while multiple‑choice responses use mean‑pooling logits, yielding top performance on VQA metrics.

By Andreas Goulas, Damianos Galanopoulos, Ioannis Patras, Vasileios Mezaris