arXiv Computer Vision By Brian Tang, Kang G. Shin

Hawkeye: Reading Illegible Text with Vision Language Models

Read the original on arXiv Computer Vision →

The paper introduces BSTRB, a benchmark of 8,398 noisy image samples with high‑fidelity annotations from 1,699 real‑world video sequences, designed to evaluate Vision‑Language Models (VLMs) on degraded text. It presents Hawkeye, a VLM fine‑tuned on BSTRB that reads and reasons about illegible text by using contextual priors and pixel‑level alignment. Hawkeye performs comparably to larger VLMs overall and surpasses them on text at or below 20 pixels, making it suitable for real‑time deployment in noisy egocentric settings.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 1

ClearText-Video: A Large-Scale Text-Centric Video Dataset Bridging Video Restoration and Scene-Text Enhancement

ClearText-Video (CTVid) is a large-scale, scene-text-aware benchmark that examines text-centric video understanding under varying quality conditions. It comprises 4,639 real-world egocentric videos, over 550,000 frames, 1.6 million human-verified scene-text annotations, and more than 220,000 spatial/temporal question–answer pairs in Chinese and English. For each high-quality video, CTVid provides matched degraded- and restored-quality variants, enabling studies of Text-Centric Video Restoration and Multi-Quality VideoQA, and revealing that visual enhancement does not always improve textual fidelity or downstream reasoning.

By Jinlong Li, Jiaming Ding, Dingfu Lu, Malcolm Hsiu, Chuang Ke, Kangning Yang, Bochen Guan, Lan Fu, Jie Cai, Huiming Sun, Zibo Meng
arXiv Computer Vision
4d ago

FlexReader: Towards Adaptive Decoding Paths for Efficient Arbitrary-Length Scene Text Recognition

FlexReader is a scene text recognition model that supports multiple decoding strides, allowing a single model to balance accuracy and efficiency across various datasets. It introduces a Sub-string Perception module to extract target substrings from visual features and uses parallel decoding blocks to independently decode each character. During inference, an Adaptive Prefix Decoding strategy selects the optimal stride at each step based on confidence, enabling robust recognition of long, curved, or occluded text while speeding up decoding up to 6× compared to autoregressive methods.

By Zhibin Ma, Pengwen Dai, Zhigang Yao, Xugong Qin, Wenqi Ren, Xiaochun Cao
arXiv Computer Vision
Oct 12

TextVBench: Evaluating Text Rendering and Preservation in Video Generation

TextVBench is a new benchmark and evaluation framework for assessing how well video generation models render and preserve text. It introduces two tracks—TextVBench‑T2V for prompt‑specified text creation and maintenance, and TextVBench‑Ref2V for preserving text from reference images—using a multi‑target, multi‑instance spatiotemporal correspondence approach. The framework employs target‑conditioned candidate selection, supports multiple OCR regions per target, and separates spatial and temporal fidelity, summarizing results with a length‑weighted harmonic score and detailed diagnostics.

By Ruiqiang Zhang, Hengyi Wang, Chang Liu, Guanjie Wang, Zehua Ma, Weiming Zhang