arXiv Computer Vision
Oct 12

WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generation

WorldGenBench is a benchmark that tests text‑to‑image models on their ability to combine factual grounding with contextual reasoning. It introduces the Knowledge Checklist Score to evaluate whether generated images reflect both explicit and implicit semantic elements. The study finds that while some proprietary models perform well, most open‑source systems struggle, especially with culturally diverse and scientific content, revealing common failure modes such as semantic hallucination and underrepresentation of non‑Western knowledge.

By Ruoshi Xu, Daoan Zhang, Che Jiang, Biaoxiang Chen, Zijian Jin, Yutian Lu, Jianguo Zhang, Liang Yong, Jiebo Luo, Shengda Luo
arXiv Computer Vision
Sep 25

GeoNLI - A Natural Language Interpreter for Satellite Imagery

GeoNLI introduces a unified, modular pipeline that combines advanced SAM variants with multimodal large language models to perform satellite image captioning, visual question answering (VQA), and visual grounding. The EarthMind model achieves strong results on captioning and VQA, while multiple RemoteSAM-SAM and DiffuSAM pipelines are used for grounding, ultimately employing a majority‑voting ensemble across several models. The system reports 82% captioning accuracy, 83.32% VQA accuracy, and 64.94% grounding accuracy, demonstrating improved consistency over task‑specific approaches.

By Ashutosh Gandhe, Anupam Rawat, Geet Sethi, Kabir Nasiruddin, Madhav Kotecha, Panav Shah, Rakshit Sawarn, Soumitra Nayak