Synthetic-to-Real Text-Based Person Anomaly Search via Multi-Model Retrieval Fusion and Cross-Encoder Reranking
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The paper introduces a multi‑model retrieval and reranking system for text‑based person anomaly search that bridges the synthetic‑to‑real domain gap. It adapts the Qwen3‑VL‑Embedding‑8B model to synthetic descriptions via contrastive learning and domain randomization, fuses scores from six Qwen3‑VL checkpoints and a frozen SigLIP2 model, and then reranks candidates with a Qwen3‑VL‑Reranker‑8B cross‑encoder. A synthetic distractor‑matched validation protocol is used to tune hyper‑parameters, yielding a 94.78% mAP and 90.85% R@1 on the AI City Challenge 2026 Track 4 test set, placing eighth on the public leaderboard.
arXiv:2608.23503v1 Announce Type: new Abstract: Text-based person anomaly search requires distinguishing individuals based on fine-grained, context-dependent behaviors rather than mere appearance. Ex...
arXiv:2608. 12843v1 Announce Type: cross Abstract: Text-based person anomaly retrieval aims to retrieve pedestrians exhibiting anomalous behaviors from a large image gallery using natural language descriptions.
SCOUT is a frozen‑encoder approach for sim‑to‑real text‑based person retrieval that predicts cross‑modal embeddings instead of fine‑tuning cross‑encoders. It uses a trainable predictor to map patch tokens from a frozen video encoder (V‑JEPA) into the embedding space of a frozen text encoder (EmbeddingGemma), guided by a bidirectional InfoNCE objective. The method achieves state‑of‑the‑art results on the AI City Challenge 2026 Track 4, with a full retrieve‑fuse‑rerank pipeline reaching 84.25 mAP@10 and a single frozen model alone scoring 60.63, while training costs are modest (≈95 GPU‑hours).
The paper introduces PRAISE, a test‑time adaptation framework for vision‑language model based person re‑identification. PRAISE constructs an Attribute‑Conditioned Subspace (ACS) from a bank of attribute prompts, reshaping query‑gallery affinities without requiring identity or attribute labels. Experiments on image‑to‑image and text‑to‑image ReID benchmarks show that PRAISE consistently improves retrieval performance over existing backbones and TTA baselines.
arXiv:2610.10163v1 Announce Type: new Abstract: Linking people's appearance and actions to character identities is essential for understanding video narratives. We present a framework for identity-aw...