Benchmarks and evaluation

Leaderboards, eval harnesses and ablations — the contested business of deciding which model is actually better.

28,127 stories · RSS feed

arXiv Machine Learning
Oct 21

HypoNet Nankai PS: rapid hypocenter determination for the Nankai Trough using physics-informed neural networks with three-dimensional P- and S-wave velocity models

arXiv:2610.27561v1 Announce Type: cross Abstract: Rapid and accurate hypocenter determination based on three-dimensional (3D) seismic velocity models is essential for seismic monitoring in subduction...

By Ryoichiro Agata, Ayako Nakanishi, Dan Bassett, Satoru Baba, Yasuyuki Nakamura, Gou Fujie
arXiv Machine Learning
Oct 21

TerraNostra-Bench: Benchmarking Spatial Downscaling and Temporal Rollout for Global 1-km Land-Use Reconstruction

arXiv:2610.27793v1 Announce Type: cross Abstract: Uncertainty in the terrestrial carbon cycle remains a major constraint in climate projections, partly due to imperfect land surface representations i...

By Amirpasha Mozaffari, Marina Casta\~no, Stefano Materia, Joan Vedr\'i, Jordi Varela-Agrelo, Dario Garcia-Gasulla, Etienne Tourigny, Mario Acosta, Amanda Duarte
arXiv Computation and Language
Oct 21

The Bottleneck Is Retrieval, Not Reading: Diagnosing Evidence-Based Generation with RAG for Long Context Question Answering

arXiv:2610.26951v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) is the dominant paradigm for grounding large language models in external corpora, but its similarity-driven, chunk...

By Debopriyo Banerjee, Owais Aijaz, Ahmer Tabassum, Zhuohan Xie, Preslav Nakov, Veselin Stoyanov
arXiv Computation and Language
Oct 21

African Languages AI Safety Readiness Report

arXiv:2610.27269v1 Announce Type: new Abstract: With the widespread adoption of large language models (LLMs) across languages and domains, AI safety has emerged as a critical global concern. However,...

By Israel Abebe Azime, Jesujoba O. Alabi, Tajuddeen Gwadabe, David Ifeoluwa Adelani