Benchmarks and evaluation

Leaderboards, eval harnesses and ablations — the contested business of deciding which model is actually better.

28,127 stories · RSS feed

arXiv AI
Oct 15

PRAISE: A Reproducible Workflow for Non-Programmer Scientists to Implement Published AI Models

arXiv:2610.16980v1 Announce Type: new Abstract: Artificial Intelligence (AI) models are increasingly developed, published and used across scientific fields. Researchers, students and industry profess...

By Max Achterweust, Stefan Groot Nibbelink, Vincent J. de Beer, Stefan Schipper, Zeynep Y\"uksektepe, Pedro Andrade da Silva, Aurelia Peppelaar, Martijn J. van der Willigen, Christophe B. Minkenberg, Robert F. van der Willigen
arXiv AI
Oct 15

WorkRover: Scaling Long-Horizon Cowork Agent Training Via Recursive Environment Evolution

arXiv:2610.18067v1 Announce Type: new Abstract: Scaling interactive environments is important for training long-horizon agents through reinforcement learning. These environments often require further...

By Hang He, Linting Wang, Guanming Liu, Bo Mao, Jinxiu Liu, Yiran Suo, Maosen Zhou, Zhiheng Xi, Guanting Dong, Zhou Shao, Rui Zheng, Jie Zhou, Chengcheng Wan, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang