← Back to all news
arXiv AI By Tianyi Xu, Rong Shan, Junjie Wu, Jiadeng Huang, Teng Wang, Jiachen Zhu, Wenteng Chen, Minxin Tu, Quantao Dou, Zhaoxiang Wang, Changwang Zhang, Weinan Zhang, Jun Wang, Jianghao Lin

PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval

Read the original on arXiv AI →

PhotoBench is a new benchmark built from authentic personal photo albums that moves beyond simple visual matching to focus on personalized, intent-driven retrieval. It incorporates a multi-source profiling framework that combines visual semantics, spatial‑temporal metadata, social identity, and temporal events to generate complex queries reflecting users’ life trajectories. Evaluation on PhotoBench reveals two key limitations: a modality gap where unified embedding models fail on non‑visual constraints, and a source fusion paradox where agentic systems struggle with tool orchestration.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Computer Vision
6d ago

Weaving Visual Narratives: Agentic Image Bundle Composition Beyond Atomic Visual Matching

The paper introduces Image Bundle Composition (IBC), a new paradigm that moves beyond point-wise image matching to dynamically assemble cohesive image bundles from large, unstructured photo collections. It presents IBCBench, a benchmark with over 109,000 images and 667 verified queries, and proposes BundleWeaver, an agentic framework that uses a Large Language Model for relational role discovery and a Vision‑Language Model for bundle verification. Experiments show that BundleWeaver outperforms existing embedding and decompose‑and‑rerank methods, underscoring the importance of relational composition over atomic scoring.

By Rong Shan, Tianyi Xu, Congmin Zheng, Wenteng Chen, Jiachen Zhu, Junjie Wu, Teng Wang, Weiwen Liu, Changwang Zhang, Weinan Zhang, Jun Wang, Jianghao Lin
llmsragagentsmultimodalbenchmarks
More like this →
Hugging Face Trending Papers
Aug 5

CoCo-IR: Contextual Composed Image Retrieval

Current instruction-based image retrieval systems are powerful but limited to single-turn interactions, failing to capture the iterative nature of complex, real-world visual searches. To overcome this limitation, we introduce Contextual Composed Image Retrieval (CoCo-IR), a novel task that enables users to progressively refine search results through interactions.

ragagentsmultimodalbenchmarks
More like this →