Benchmarks and evaluation

Leaderboards, eval harnesses and ablations — the contested business of deciding which model is actually better.

28,127 stories · RSS feed

arXiv Computer Vision

Oct 15

MonoMIP: Multi-Height Inverse Perspective Mapping for Monocular 3D Object Detection

arXiv:2610.19071v1 Announce Type: new Abstract: Monocular 3D object detection methods increasingly rely on depth-guided transformers, but they operate entirely in the perspective image plane where sp...

By Emir Ulurak, Furkan K{\i}ra\c{c}

llms computer-vision benchmarks

arXiv Computer Vision

Oct 15

Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensors

arXiv:2610.19201v1 Announce Type: new Abstract: We present LidarVerse, a real-time unified LiDAR world model for sensor simulation across tasks and sensors. Existing LiDAR simulators largely follow o...

By Henry Che, Xuanchi Ren, Sanja Fidler, Shenlong Wang, Laura Leal-Taix\'e, Shengyu Huang

diffusion nlp benchmarks

arXiv Computer Vision

Oct 15

Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation

arXiv:2610.19290v1 Announce Type: new Abstract: We present Kandinsky S2V 1.0, an open family of speech-to-video models for controllable audio-driven human animation, comprising Kandinsky S2V 1.0 Lite...

By Nikolay Semenov, Artem Riabinin, Sergey Bassenko, Anna Averchenkova, Julia Agafonova, Anastasia Aliaskina, Kirill Kozlov, Lev Novitskiy, Nikita Samsonov, Nikolai Gerasimenko, Denis Dimitrov

diffusion benchmarks

arXiv Computer Vision

Oct 15

NavAble: A Large-Scale Dataset and Synthetic Data Generation Pipeline for Blind Navigation

arXiv:2610.19330v1 Announce Type: new Abstract: Reliable recognition of accessibility-critical objects (e.g., audible pedestrian signals, door-activation buttons, and handrails) is essential for assi...

By Hochul Hwang, Jahir Sadik Monon, Soowan Yang, Shiven Umeshbhai Patel, Anh Nhat Hong Nguyen, Kien Nguyen, Keshav Garg, Dylan Gage, Duretti Hordofaa, Anshu Anjna, Eshed Ohn-Bar, Donghyun Kim

computer-vision robotics fine-tuning multimodal benchmarks

arXiv Computer Vision

Oct 15

DeBoneDiT: Depth-Driven Conditional Bridge Diffusion Transformers for Bone Suppression in Chest X-Ray Images

arXiv:2610.19466v1 Announce Type: new Abstract: Chest X-Ray (CXR) is a primary modality for diagnosing pulmonary diseases, yet the overlap of bony structures often obscures critical radiographic find...

By Yifei Sun, Fenglei Fan, Junhao Jia, Wenming Deng, Hongxia Xu, Changmiao Wang, Ruiquan Ge

llms diffusion nlp benchmarks

arXiv Computer Vision

Oct 15

VideoHarness-SRSI: Structured Recursive Self-Improvement for Video Understanding Harness

arXiv:2610.19424v1 Announce Type: new Abstract: LLM system capabilities depend not only on model parameters but also on the executable harnesses that organize information acquisition, tool use, reaso...

By Zihao Lin, Haoyu Dong, Haobo Xu, Chi-Chih Chang, Xuying Ning, Yinglong Xia, Shuang Yang, Zhuokai Zhao, Xinying Song, Dongfang Liu, Lifu Huang, Yang Song, Qifan Wang

llms agents multimodal benchmarks

arXiv Computer Vision

Oct 15

Holi-Spatial 360: Generative Reconstruction from Sparse Panoramas for Spatial Rendering and Intelligence

arXiv:2610.19502v1 Announce Type: new Abstract: Spatial intelligence requires scalable 3D environments that are both photorealistic and semantically grounded, yet existing indoor datasets are dominat...

By Yuanyuan Gao, Zhirui Liu, Yuning Gong, Yifei Liu, Yifan Zhan, Kuixuan Jiao, Xiaolong Zhou, Yifan Yang, Hongjie Zhang, Xue Yang, Dan Xu, Zhihang Zhong

fine-tuning multimodal benchmarks

arXiv Computer Vision

Oct 15

TextVerifier: Seeing Beyond Recognition to Verify Chinese Text Rendering

arXiv:2610.19551v1 Announce Type: new Abstract: Text-to-image models increasingly generate readable Chinese text that still contains local rendering defects, such as a character with an extra or miss...

By Yiyang Chen, Guo-Hua Wang, Yaoli Liu, Qing-Guo Chen, Zhao Xu, Weihua Luo, Xiujun Ma

llms diffusion computer-vision multimodal benchmarks

arXiv Computer Vision

Oct 15

Learning Visual Speech Representations via Cross-Modal Distillation and Joint Face-Lip Modeling

arXiv:2610.19559v1 Announce Type: new Abstract: Lipreading remains challenging due to the inherent ambiguity of visual speech cues and their sensitivity to head pose and video resolution. In this wor...

By Jing-Xuan Zhang, Genshun Wan, Jianqing Gao, Jia Pan, Yumei Zhang, Lichen Zhang

llms efficiency multimodal benchmarks safety

arXiv Computer Vision

Oct 15

MagicGarment: Benchmarking Single-Image Standalone 3D Garment Reconstruction

arXiv:2610.19623v1 Announce Type: new Abstract: Single-image 3D reconstruction has advanced rapidly, yet standalone garments remain challenging due to thin-shell geometry, open boundaries, and layere...

By Jia Chen, Ruyang Zhao, Jun Bai, Chao Huang, Saishang Zhong, Xinrong Hu

fine-tuning multimodal benchmarks

arXiv Computer Vision

Oct 15

Adaptive Observation Control for Active Visual Recognition

arXiv:2610.19624v1 Announce Type: new Abstract: Visual recognition models usually process a fixed view under a fixed computation budget, although images often benefit from different scales and amount...

By Dikai Li, Weijia Wang, Yuan-Gen Wang

benchmarks

arXiv Computer Vision

Oct 15

MicroSDF: Microfacet-Driven Hybrid Neural SDFs for Mixed-Reflectance Surface Reconstruction

arXiv:2610.19681v1 Announce Type: new Abstract: Accurate 3D reconstruction in real-world environments remains a significant challenge due to the coexistence of reflective and non-reflective surfaces,...

By Lejia Ye, Yuhua Xu, Yulan Guo, Lian Xu, Xiaohu Zhang

benchmarks

arXiv Computer Vision

Oct 15

OmniPoser: Flexible Human Motion Recovery in the Wild with Masked Flow Matching

arXiv:2610.19857v1 Announce Type: new Abstract: Recovering 3D human motion from sparse wearable sensors is challenging due to the inherent noise, occlusion, and instability of real-world tracking sig...

By Minghao Liu, Tutian Tang

diffusion multimodal benchmarks

arXiv Computer Vision

Oct 15

CoDy: Codec Dynamics as Complementary Priors for Unsupervised Temporal Action Localization

arXiv:2610.19880v1 Announce Type: new Abstract: Unsupervised temporal action localization (UTAL) aims to identify action categories and localize their temporal boundaries without annotation supervisi...

By Tianyu Yan, Qingyi Yang, Qin Yang, Xufei Guo, Yuan Tang, Rui Wang, Yixue Hao, Long Hu

efficiency benchmarks

arXiv Computer Vision

Oct 15

GDBA-Net: A Gated Dual-Branch Adaptation of SAM2 for Robust Cross-Domain Nuclei Segmentation

arXiv:2610.20073v1 Announce Type: new Abstract: Accurate nuclei segmentation underpins quantitative computational pathology, yet remains challenging due to morphological variability, weak boundaries,...

By Biplab Poudel, Betserai Albert Magarire, Anish Kumar Shah, Jiacheng Xie, Dong Xu

llms computer-vision benchmarks

arXiv Computer Vision

Oct 15

StreamErase: Towards Ultra-Fast Streaming Video Erasing

arXiv:2610.20137v1 Announce Type: new Abstract: Current video object removal methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction....

By Zhuobai Dong, Xiaobing Tu, Xiantao Zhang, Jinkui Ren, Yinggui Wang, Yue Ma, Linfeng Zhang

llms diffusion efficiency benchmarks

arXiv Computer Vision

Oct 15

Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation

arXiv:2610.20335v1 Announce Type: new Abstract: Document understanding systems are typically evaluated as separate components via layout analysis, optical text recognition, reading-order prediction,...

By Yuheng Chen, Yufan Chen, Zhuojun Cai, Ruiping Liu, Junwei Zheng, Jiale Wei, Di Wen, Weijia Fan, Kunyu Peng, Jiaming Zhang, Rainer Stiefelhagen

multimodal benchmarks

arXiv Computer Vision

Oct 15

ReferFlow: Beyond Final-Target Localization for Complex Referring Expressions

arXiv:2610.20352v1 Announce Type: new Abstract: Multimodal Large Language Models have made significant progress in referring expression comprehension (REC), yet most REC benchmarks still focus on fin...

By Tianyi Gao, Han Fang, Xin Wei, Yaoyao Zhong, Zhaoyan Pan, Weijie Zhu, Hongbo Sun, Zhiyu Lin, Kaicheng Yang, Jinglin Xu, Ye Yuan, Hao Li, Hao Sun, Jingmin Xin

llms multimodal benchmarks

arXiv Computer Vision

Oct 15

GeoThinker-$F$: Endogenous Predictive World Representations for Fast Spatial Intelligence

arXiv:2610.20592v1 Announce Type: new Abstract: Existing geometry-aware Multimodal Large Language Models (MLLMs) increasingly rely on external 3D encoders to provide structural priors, but executing...

By Haoyuan Li, Qihang Cao, Huanyuan Zhou, Xin Hu, Sijia Chen, Zihan Guo, Kun Xiang, Yunshuang Nie, Tao Tang, Xinlong Zheng, Jia-Wang Bian, Xianming Liu, Xiaodan Liang

llms multimodal benchmarks

arXiv Computer Vision

Oct 15

DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning

arXiv:2610.20598v1 Announce Type: new Abstract: Achieving general spatial intelligence requires a unified understanding of both static 3D and dynamic 4D. However, we find that existing models struggl...

By Qihang Cao, Haoyuan Li, Zihan Guo, Sensen Gao, Zihui Gao, Huixin Zhang, Fan He, Jianhua Han, Hang Xu, Xiaodan Liang, Jia-Wang Bian

multimodal benchmarks

Get the daily briefing