arXiv Computation and Language
5d ago

ZoomCap: Evidence-Routed Visual Zooming for Recoverable Visual Information Transfer

ZoomCap is a method for fine‑grained captioning that treats missing visual evidence as recoverable information. It uses a draft caption to guide conditional knowledge retrieval, OCR‑aware reading, coverage‑gap recovery, and adaptive visual zooming, focusing deeper crops on complex regions and deriving spatial relations from grounded geometry. The accompanying FactCycle framework evaluates caption claims against the source image and a reconstruction, distinguishing fabrication from generator loss, and the approach shows strong performance gains in both general and medical vision‑language pre‑training.

By Hao Shi, Jiafeng Wang, Yuzhuo Fu, Tao Zhang, Jian Bai, Juelu Zhang, Qing Cui, Chao Huang