arXiv AI

WorldSR: Harnessing World Knowledge Search for Grounded Image Super-Resolution

arXiv Machine Learning
Aug 26

NAIMA: Semantics Aware RGB Guided Depth Super-Resolution

The paper introduces NAIMA, a guided depth super‑resolution framework that leverages global contextual semantic priors from pretrained vision transformer token embeddings. Its Guided Token Attention (GTA) module uses depth encodings as queries to attend over semantic tokens, with a zero‑initialized gate controlling the influence of semantic evidence. NAIMA achieves competitive in‑distribution performance while delivering superior cross‑dataset generalization without relying on decoded priors or auxiliary objectives.

By Tayyab Nasir, Daochang Liu, Ajmal Mian
arXiv Computer Vision
Oct 12

WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generation

WorldGenBench is a benchmark that tests text‑to‑image models on their ability to combine factual grounding with contextual reasoning. It introduces the Knowledge Checklist Score to evaluate whether generated images reflect both explicit and implicit semantic elements. The study finds that while some proprietary models perform well, most open‑source systems struggle, especially with culturally diverse and scientific content, revealing common failure modes such as semantic hallucination and underrepresentation of non‑Western knowledge.

By Ruoshi Xu, Daoan Zhang, Che Jiang, Biaoxiang Chen, Zijian Jin, Yutian Lu, Jianguo Zhang, Liang Yong, Jiebo Luo, Shengda Luo
arXiv Computer Vision
Aug 31

Video Generative Models as Geometry Learner

The paper introduces GeoNeXt, a framework that repurposes pretrained video generative models for geometry estimation by framing it as a next‑frame prediction task. Unlike prior methods that either train separate depth/normal models or fine‑tune image diffusion backbones, GeoNeXt jointly models images and geometric targets, leveraging the structured knowledge of video models for more data‑efficient learning. Experiments show zero‑shot monocular depth and surface normal estimation that outperforms existing generative approaches and rivals discriminative state‑of‑the‑art methods while using far less training data.

By Haosen Yang, Jifei Song, Zhensong Zhang, Xiatian Zhu, Jiankang Deng
arXiv Computation and Language
Oct 16

OmniVerifier-C1: Decomposed Graded Verifier for Rule-Governed Generative World Modeling

The paper introduces OmniVerifier-C1, a graded visual verifier that decomposes complex prompts or environmental rules into fine‑grained components and assigns continuous pointwise scores, moving beyond binary True/False judgments. Experiments show that this structured, interpretable output improves generalization to out‑of‑domain multimodal critic tasks and outperforms binary verifiers in text‑to‑image scenarios. In rule‑governed generative world modeling, the authors demonstrate that a pairwise verification approach yields more accurate critiques than pointwise scoring, with empirical validation on tasks such as Maze and Sudoku.

By Bowei Liu, Xinchen Zhang, Xuhuan Li, Tianlin Zhang, Kaian Jiang, Jingwei Liu, Congyang Zhao, Yifei Qian, Junhong Liu, Zhiheng Li, Yujiu Yang, Yang Cai, Ling Yang
Hugging Face Trending Papers
Oct 13

OpenDepth: Repurposing Image Editing Priors for Robust Open-World Monocular Depth Estimation

OpenDepth repurposes Image-to-Image (I2I) editing priors to improve monocular depth estimation in open-world conditions. By aligning shallow features in a Diffusion Transformer and adding a joint RGB reconstruction task, the method decouples environmental style from geometry, enabling robust depth inference across varied lighting and weather. The approach achieves new state‑of‑the‑art performance on standard and extreme weather benchmarks, maintaining structural integrity in zero‑shot settings.

arXiv Computer Vision
2d ago

ImagineAgent: What if Agents Could Imagine? Reinforcing Open-Vocabulary HOI Comprehension through Generation

arXiv:2602.11499v3 Announce Type: replace Abstract: Multimodal Large Language Models have shown promising capabilities in bridging visual and textual reasoning, yet their reasoning capabilities in Op...

By Zhenlong Yuan, Yue Wang, Dapeng Zhang, Kejin Cui, Rui Chen, Jing Tang, Lei Sun, Hongwei Yu, Chengxuan Qian, Xiangxiang Chu, Shuo Li, Yuyin Zhou
arXiv AI
Jul 8

Rethinking Visual Autoregressive Sampling with Information-Grounding Guidance

arXiv:2509. 23876v3 Announce Type: replace-cross Abstract: Autoregressive (AR) models based on next-scale prediction have emerged as a powerful tool for image generation, but they face a critical weakness: information inconsistencies between patches across timesteps introduced by progressive resolution scaling.

By Ky Dan Nguyen, Hoang Lam Tran, Anh-Dung Dinh, Daochang Liu, Weidong Cai, Xiuying Wang, Chang Xu