Benchmarks and evaluation

Leaderboards, eval harnesses and ablations — the contested business of deciding which model is actually better.

23,273 stories · RSS feed

arXiv Machine Learning

Jun 8

Generative Molecular Morphing for Flexible-Size Design via Unbalanced Optimal Transport

arXiv:2606. 07239v1 Announce Type: new Abstract: The success of generative molecular design hinges on a model's steerability toward high-reward samples.

By Malte Franke, Stefan P. Schmid, Zarko Ivkovic, Kjell Jorner, Andreas Krause

diffusion benchmarks

arXiv Machine Learning

Jun 8

Implicit Neural Optimal Transport via Fixed-Point Optimization

arXiv:2605. 10792v2 Announce Type: replace-cross Abstract: We propose an implicit neural formulation of optimal transport that eliminates adversarial min--max optimization and multi-network architectures commonly used in existing approaches.

By Yesom Park, Eric Gelphman, Stanley Osher, Samy Wu Fung

benchmarks safety

arXiv Machine Learning

Jun 8

Learn to Match: Two-Sided Matching with Temporally Extended Feedback

arXiv:2606. 06744v1 Announce Type: new Abstract: Two-sided matching markets often involve information that unfolds over time through interviews, repeated interaction, learning, and separation.

By Haijing Zong, Yancheng Liang, Boyang Zhou, Natasha Jaques

agents reinforcement-learning benchmarks

arXiv AI

Jun 8

MotionEnhancer: Leveraging Video Diffusion for Motion-Enhanced Vision-Language Models

arXiv:2606. 06853v1 Announce Type: cross Abstract: The new era has witnessed a remarkable capability to extend Vision-Language Models (VLMs) for tackling tasks of video understanding.

By Yifan Xu, Chao Zhang, Ruifei Ma, Fei Gao, Zhifei Yang, Jiaxing Qi, Zhipeng Chen

llms agents diffusion multimodal benchmarks safety

arXiv AI

Jun 8

Forecasting as Rendering: A 2D Gaussian Splatting Framework for Time Series Forecasting

arXiv:2603. 02220v2 Announce Type: replace-cross Abstract: Time series forecasting remains a challenging problem due to the intricate entanglement of intra-period fluctuations and inter-period trends.

By Yixin Wang, Yifan Hu, Peiyuan Liu, Naiqi Li, Tao Dai, Shu-Tao Xia

benchmarks safety

arXiv Machine Learning

Jun 8

Reinforcement Learning from Denoising Feedback

arXiv:2605. 25638v2 Announce Type: replace-cross Abstract: Policy loss estimation remains a fundamental and long-standing challenge in reinforcement learning (RL) for diffusion language models (DLMs).

By Qi He, Huan Chen, Ya Guo, Huijia Zhu, Yi R. Fung, Baojian Zhou

llms diffusion reinforcement-learning benchmarks

arXiv AI

Jun 8

Robust Driving Control for Autonomous Vehicles: An Intelligent General-sum Constrained Adversarial Reinforcement Learning Approach

arXiv:2510. 09041v3 Announce Type: replace-cross Abstract: Deep reinforcement learning (DRL) has demonstrated remarkable success in developing autonomous driving policies.

By Junchao Fan, Qi Wei, Ruichen Zhang, Yang Lu, Jianhua Wang, Xiaolin Chang, Bo Ai

agents reinforcement-learning robotics benchmarks safety

arXiv AI

Jun 8

Latent-space Attacks for Refusal Evasion in Language Models

arXiv:2605. 21706v2 Announce Type: replace Abstract: Safety-aligned language models are trained to refuse harmful requests, yet refusal behavior can be suppressed by steering their internal representations.

By Giorgio Piras, Raffaele Mura, Fabio Brau, Maura Pintor, Luca Oneto, Fabio Roli, Battista Biggio

llms multimodal benchmarks safety

arXiv AI

Jun 8

FIGMA: Towards FIne-Grained Music retrievAl

arXiv:2606. 06615v1 Announce Type: cross Abstract: Retrieving music using natural language descriptions has improved with contrastive audio-text models such as CLAP, but current systems remain limited to coarse semantic queries.

By Nishit Anand, Ashish Seth, Sreyan Ghosh, Dinesh Manocha, Ramani Duraiswami

benchmarks safety

arXiv AI

Jun 8

DiBS: Diffusion-Informed Branch Selection

arXiv:2606. 06518v1 Announce Type: new Abstract: Sudoku is a representative constraint satisfaction problem that requires global structural reasoning under strict discrete constraints.

By Bo Liu, Yuan Xie, Yuan Gao, Xiaolong Luo, Peng Ye, Tao Chen, Fujun Han

diffusion benchmarks

arXiv AI

Jun 8

FAIR-Calib: Frontier-Aware Instability-Reweighted Calibration for Post-Training Quantization of Diffusion Large Language Models

arXiv:2606. 06547v1 Announce Type: cross Abstract: Diffusion Large Language Models (dLLMs) refine tokens iteratively but commit them irreversibly, leading to a "stability lag" where early decisions remain fragile even after being written.

By Haoyu Huang, Linlin Yang, Sheng Xu, Boyu Liu, Guodong Guo, Zhongqian Fu, Hang Zhou, Baochang Zhang

llms diffusion efficiency benchmarks

arXiv AI

Jun 8

TRUE: A Trustworthy Unified Explanation Framework for Large Language Model Reasoning

arXiv:2602. 18905v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have demonstrated strong capabilities in complex reasoning tasks, yet their decision-making processes remain difficult to interpret.

By Yujiao Yang

llms benchmarks safety

arXiv Machine Learning

Jun 8

Architecture Shapes Transfer Specificity in Implicit Neural Representations

arXiv:2606. 06827v1 Announce Type: new Abstract: Transfer in coordinate networks is often measured by warm-start gain, but whether that gain reflects source-specific structure or generic weight reuse is less clear.

By D Yang Eng

benchmarks

arXiv AI

Jun 8

Automated Root-Cause Subclassification and No-Code Fix Generation for Invalid Bug Reports

arXiv:2605. 17561v2 Announce Type: replace-cross Abstract: Issues faced when using software are reported in the form of bug reports.

By Mahmut Furkan Gon, Emre Dinc, Tevfik Emre Sungur, Eray Tuzun

llms rag agents benchmarks

arXiv AI

Jun 8

How reliable are LLMs when it comes to playing dice?

arXiv:2606. 07515v1 Announce Type: cross Abstract: We investigate the probabilistic reasoning capabilities of large language models through a controlled benchmarking study on discrete probability problems.

By Luca Avena, Gianmarco Bet, Bernardo Busoni

llms rag benchmarks safety

arXiv Machine Learning

Jun 8

Ablation Study of Block Size, Weight Precision, and Scale Precision in NVFP4 Inference for Low-Power Edge-Efficient Neural Networks

arXiv:2606. 06527v1 Announce Type: cross Abstract: Energy-efficient edge inference requires reducing arithmetic cost, memory traffic, and hardware overhead.

By Ovishake Sen, Venkata Nithin Kamineni, Daniel Lobo, Swarup Bhunia, Rickard Ewetz, Baibhab Chatterjee

benchmarks

arXiv Machine Learning

Jun 8

AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning

arXiv:2512. 13278v2 Announce Type: replace-cross Abstract: Agentic reinforcement learning has advanced large language models (LLMs) to reason through long chain-of-thought trajectories while interleaving external tool use.

By Jiaru Zou, Ling Yang, Yunzhe Qi, Sirui Chen, Mengting Ai, Ke Shen, Jingrui He, Mengdi Wang

llms agents reinforcement-learning fine-tuning multimodal benchmarks

arXiv Machine Learning

Jun 8

Unsupervised Continual Clustering via Forward-Backward Knowledge Distillation

arXiv:2606. 07474v1 Announce Type: new Abstract: Unsupervised Continual Learning (UCL) aims to enable neural networks to learn sequential tasks without labels or access to past data.

By Mohammadreza Sadeghi, Sareh Soleimani, Zihan Wang, Narges Armanfard

efficiency benchmarks safety

arXiv Machine Learning

Jun 8

Probabilistic Gaussian Homotopy: A Probability-Space Continuation Framework for Nonconvex Optimization

arXiv:2603. 13546v2 Announce Type: replace Abstract: We introduce Probabilistic Gaussian Homotopy (PGH), a probability-space continuation framework for nonconvex optimization.

By Eshed Gal, Samy Wu Fung, Eldad Haber

diffusion benchmarks

arXiv AI

Jun 8

EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation

arXiv:2606. 06872v1 Announce Type: cross Abstract: Estimating hand-surface contact pressure from an egocentric view is crucial for AR/VR devices, robotic imitation, and ergonomic analysis.

By Yuan Zeng, Zilue Gao, Yujia Shi, Zongqing Lu, Wenming Yang, QingMin Liao

diffusion robotics efficiency multimodal benchmarks

Get the daily briefing