Benchmarks and evaluation

Leaderboards, eval harnesses and ablations — the contested business of deciding which model is actually better.

28,111 stories · RSS feed

arXiv Computer Vision

Oct 27

Learning Universal Features for Generalizable Image Forgery Localization

arXiv:2504.07462v2 Announce Type: replace Abstract: In recent years, advanced image editing and generation methods have rapidly evolved, making detecting and locating forged image content increasingl...

By Hengrun Zhao, Yunzhi Zhuge, Yifan Wang, Lijun Wang, Huchuan Lu, Yu Zeng

benchmarks

arXiv Computer Vision

Oct 27

AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Driving

arXiv:2509.13769v2 Announce Type: replace Abstract: While reasoning technology like Chain of Thought (CoT) has been widely adopted in Vision Language Action (VLA) models, it demonstrates promising ca...

By Yuechen Luo, Fang Li, Shaoqing Xu, Zhiyi Lai, Lei Yang, Qimao Chen, Ziang Luo, Zixun Xie, Shengyin Jiang, Jiaxin Liu, Long Chen, Bing Wang, Ken Deng, Zhi-xin Yang

agents nlp reinforcement-learning robotics fine-tuning benchmarks

arXiv Computer Vision

Oct 27

FMC-DETR: Frequency-Decoupled Multi-Domain Coordination for Aerial-View Object Detection

arXiv:2509.23056v3 Announce Type: replace Abstract: Remote sensing object detection is a critical technology for real-world applications such as natural resource monitoring, traffic management, and U...

By Ben Liang, Hongguang Wei, Yuan Liu, Bingwen Qiu, Yihong Wang, Xiubao Sui, Qian Chen

llms computer-vision benchmarks

arXiv Computer Vision

Oct 27

Out of the box age estimation through facial imagery: A Comprehensive Benchmark of Vision-Language Models vs. out-of-the-box Traditional Architectures

arXiv:2602.07815v3 Announce Type: replace Abstract: Facial age estimation plays a critical role in content moderation, age verification, and deepfake detection. However, no prior benchmark has system...

By Simiao Ren (Manlin), Xingyu Shen (Manlin), Ankit Raj (Manlin), Albert Dai (Manlin), Caroline (Manlin), Zhang, Yuan Xu, Zexi Chen, Siqi Wu, Chen Gong, Yuxin Zhang

llms multimodal benchmarks

arXiv Computer Vision

Oct 27

U-VLM: Hierarchical Vision Language Modeling for Report Generation

arXiv:2603.00479v2 Announce Type: replace Abstract: Automated radiology report generation is key for reducing radiologist workload and improving diagnostic consistency, yet generating accurate report...

By Pengcheng Shi, Minghui Zhang, Kehan Song, Jiaqi Liu, Yun Gu, Xinglin Zhang

llms computer-vision multimodal benchmarks

arXiv Computer Vision

Oct 27

DOCFORGE-BENCH: A Comprehensive 0-shot Benchmark for Document Forgery Detection and Analysis

arXiv:2603.01433v3 Announce Type: replace Abstract: We present DOCFORGE-BENCH, the first unified zero-shot benchmark for document forgery detection, evaluating 14 methods across eight datasets spanni...

By Zengqi Zhao, Weidi Xia, En Wei, Yan Zhang, Jane Mo, Tiannan Zhang, Yuanqin Dai, Zexi Chen, Yiran Tao, Simiao Ren

llms diffusion robotics fine-tuning benchmarks

arXiv Computer Vision

Oct 27

Can a Teenager Fool an AI? Evaluating Low-Cost Cosmetic Attacks on Age Estimation Systems

arXiv:2602.19539v2 Announce Type: replace Abstract: Age estimation systems are increasingly deployed as gatekeepers for age-restricted online content, yet their robustness to cosmetic modifications h...

By Xingyu Shen, Tommy Duong, Xiaodong An, Zengqi Zhao, Zebang Hu, Haoyu Hu, Ziyou Wang, Finn Guo, Simiao Ren

llms multimodal benchmarks safety

arXiv Computer Vision

Oct 27

A physics-informed, behavior-aware digital twin for robust multimodal forecasting of core body temperature in precision livestock farming

arXiv:2604.04098v3 Announce Type: replace Abstract: Precision livestock farming requires accurate and timely heat stress prediction to ensure animal welfare and optimize farm management. This study p...

By Riasad Alvi, Mohaimenul Azam Khan Raiaan, Sadia Sultana Chowa, Arefin Ittesafun Abian, Reem E Mohamed, Md Rafiqul Islam, Yakub Sebastian, Sheikh Izzal Azid, Sami Azam

multimodal benchmarks

arXiv Computer Vision

Oct 27

ICPR 2026 Competition on Low-Resolution License Plate Recognition

arXiv:2604.22506v2 Announce Type: replace Abstract: Low-Resolution License Plate Recognition (LRLPR) remains a challenging problem in real-world surveillance scenarios, where long capture distances,...

By Rayson Laroca, Valfride Nascimento, Donggun Kim, Sanghyeok Chung, Subin Bae, Uihwan Seo, Seungsang Oh, Chi M. Phung, Minh G. Vo, Xingsong Ye, Yongkun Du, Yuchen Su, Zhineng Chen, Sunhee Heo, Hyangwoo Lee, Kihyun Na, Khanh V. Vu Nguyen, Sang T. Pham, Duc N. N. Phung, Trong P. Le, Vy N. Vo Tran, David Menotti

benchmarks

arXiv Computer Vision

Oct 27

When the Forger Is the Judge: GPT-Image-2 Cannot Recognize Its Own Faked Documents

arXiv:2604.25213v2 Announce Type: replace Abstract: OpenAI's GPT-Image-2 has effectively erased the visual boundary between authentic and AI-edited document images: a single number on a receipt can b...

By Jiaqi Wu, Yuchen Zhou, Dennis Tsang Ng, Xingyu Shen, Kidus Zewde, Ankit Raj, Tommy Duong, Simiao Ren

llms computer-vision benchmarks

arXiv Computer Vision

Oct 27

A Novel Geographic Graph-Regulated Disentangling Mamba Model with Sparse Tokens for Enhanced Tree Species Classification from MODIS Time Series

arXiv:2605.05549v2 Announce Type: replace Abstract: Tree species classification from Moderate Resolution Imaging Spectroradiometer (MODIS) time series is critical for environmental monitoring, yet ch...

By Motasem Alkayid, Zhengsen Xu, Naser El-Sheimy, Lincoln Linlin Xu

fine-tuning benchmarks

arXiv Computer Vision

Oct 27

A Marine Debris Detection Framework for Ocean Robots via Self-Attention Enhancement and Feature Interaction Optimization

arXiv:2605.07388v2 Announce Type: replace Abstract: Marine debris detection for ocean robot is crucial for ecological protection, yet performance is often degraded by low-quality images with blur, co...

By Yuyang Li, Jiashu Han, Yinyi Lai, Wenbin Kang, Zenghui Liu

computer-vision robotics efficiency benchmarks

arXiv Computer Vision

Oct 27

Towards Generalist Game Agents: A Survey of Foundation Models in Virtual Worlds

arXiv:2605.09965v3 Announce Type: replace Abstract: The real world unfolds along a single set of physics laws, yet human intelligence demonstrates a remarkable capacity to generalize experiences from...

By Kuan Zhang, Dongchen Liu, Qiyue Zhao, Tianyu Xin, Yue Su, Haisheng Wang, Han Yin, Hongbo Ma, Peize Li, Tianjun Gu, Xiangnan Wu, Xinran Zhang, Yongxuan Li, Zirong Chen, Yiming Li

agents reinforcement-learning benchmarks

arXiv Computer Vision

Oct 27

ReMATF: Recurrent Motion-Adaptive Multi-scale Turbulence Mitigation for Dynamic Scenes

arXiv:2605.21440v2 Announce Type: replace Abstract: Atmospheric turbulence severely degrades video quality by introducing distortions such as geometric warping, blur, and temporal flickering, posing...

By Zhiming Liu, Zhicheng Zou, Nantheera Anantrasirichai

benchmarks

arXiv Computer Vision

Oct 27

One Sentence, One Drama: Personalized Short-Form Drama Generation via Multi-Agent Systems

arXiv:2605.22144v2 Announce Type: replace Abstract: Existing approaches for digital short-drama production typically rely on one-shot LLM generated scripts and loosely coupled pipelines, which fail t...

By Yufei Shi, Weilong Yan, Naixuan Huang, Yucheng Chen, Chenyu Zhang, Tao He, Si Yong Yeo, Ming Li

llms agents diffusion benchmarks

arXiv Computer Vision

Oct 27

HorizonStream: Long-Horizon Attention for Streaming 3D Reconstruction

arXiv:2605.23889v2 Announce Type: replace Abstract: Online 3D reconstruction requires estimating camera pose and scene geometry under strict causal and bounded-memory constraints. Existing methods of...

By Chong Cheng, Peilin Tao, Nanjie Yao, Guanzhi Ding, Xianda Chen, Yuansen Du, Xiaoyang Guo, Wei Yin, Weiqiang Ren, Qian Zhang, Zhengqing Chen, Hao Wang

llms benchmarks

arXiv Computer Vision

Oct 27

VaViT: Vanilla ViT for Automotive Point Cloud Semantic Segmentation

arXiv:2605.31177v2 Announce Type: replace Abstract: Plain Transformers have become the de-facto architecture for processing text, audio, image, and video, offering a unified backbone for multimodal l...

By Gilles Puy, Nermin Samet, Alexandre Boulch, Spyros Gidaris, Tuan-Hung VU, Renaud Marlet

llms computer-vision nlp multimodal benchmarks

arXiv Computer Vision

Oct 27

Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectification

arXiv:2608.05776v2 Announce Type: replace Abstract: Autoregressive continuation provides a natural path toward minute-scale audio-visual generation by repeatedly extending a short-window generator co...

By Lisai Zhang, Yidi Wu, Qi Liu, Xin Ma, Yang Ding, Gang Yue, Siqian Yang, Jingyuan Chen, Lin Ma, Yaohui Wang

llms rag diffusion multimodal benchmarks

arXiv Computer Vision

Oct 27

ScenePercept: Scenario-Conditioned Perceptual Assessment of Real-World User-Generated Content Images

arXiv:2610.17661v2 Announce Type: replace Abstract: The rapid development of mobile imaging and social platforms has led to explosive growth in user-generated content images, making their systematic...

By Shuhan Xia, Yu Chen, Xiang Wang, Shuai Li, Peipie Li, Zekun Li

benchmarks safety

arXiv Computer Vision

Oct 27

WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform

arXiv:2605.17912v2 Announce Type: replace-cross Abstract: World models have emerged as a central paradigm for embodied intelligence, enabling agents to predict action-conditioned future and reason ab...

By Zhuohang Li, Yiding Ma, Yu Shang, Lei Jin, Shengyuan Wang, Jianjie Fang, Zhaolu Wang, Xvyuan Liu, Yinzhou Tang, Xin Jin, Ziyou Wang, Weikang Su, Xin Zhang, Haisheng Su, Weizhen He, Wei Wu, Haoyi Duan, Gordon Wetzstein, Xihui Liu, Dhruv Shah, Zhaoxiang Zhang, Zhibo Chen, Jun Zhu, Yonghong Tian, Tat-Seng Chua, Xin Wang, Wenwu Zhu, Chen Gao, Yong Li

agents reinforcement-learning robotics multimodal benchmarks

Get the daily briefing