Leaderboards, eval harnesses and ablations — the contested business of deciding which model is actually better.
arXiv:2610.16038v1 Announce Type: cross Abstract: E-commerce user preferences evolve dynamically within sessions, exhibiting concurrent and multi-centric interest distributions. While existing multim...
arXiv:2610.16129v1 Announce Type: cross Abstract: Deploying LLM agents in non-stationary environments requires continually revising their instructions as the task drifts, yet rewriting after every re...
arXiv:2610.16213v1 Announce Type: cross Abstract: Embedded platforms increasingly host safety-related streaming functions next to less critical ones. Whether a safety architecture pattern, such as a...
arXiv:2610.16251v1 Announce Type: cross Abstract: Deep-search agents are commonly trained by distilling tool-use trajectories from stronger teacher models. However, structurally complex questions may...
arXiv:2610.16330v1 Announce Type: cross Abstract: Feed-forward transformer models have driven remarkable progress in 3D vision,yet their quadratic complexity renders them impractical for long video s...
arXiv:2610.16484v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) models scale model capacity efficiently by activating only a small subset of experts for each input, while still requiring a...
arXiv:2610.16601v1 Announce Type: cross Abstract: Processing multilingual text requires both identifying a broad range of languages and distinguishing the language of each token in inputs containing...
arXiv:2610.17440v1 Announce Type: cross Abstract: Dual-encoder vision-language models systematically fail at negation, scoring ''a cat without a dog'' nearly identically to ''a cat with a dog.'' We s...
arXiv:2610.17456v1 Announce Type: cross Abstract: Language models are often evaluated alone but increasingly deployed together, routed between, made to debate, ensembled, or collaboratively trained....
arXiv:2610.17521v1 Announce Type: cross Abstract: Evaluating VLA policies on real robots is costly, time-consuming, and difficult to reproduce, making real-to-sim simulation essential for scalable ev...
arXiv:2610.17841v1 Announce Type: cross Abstract: Evaluating fashion retrieval systems remains challenging due to the limited availability of benchmarks that capture the fine-grained, open-ended quer...
arXiv:2610.17573v1 Announce Type: cross Abstract: Self-supervised pretraining has expanded the pool of 3D medical foundation models, but published evaluations use different datasets, endpoints and fi...
arXiv:2506.00482v2 Announce Type: replace-cross Abstract: LLM benchmarks are often treated as coherent measurement units, yet they are heterogeneous collections of instances spanning diverse domains,...
arXiv:2610.17696v1 Announce Type: cross Abstract: Identifying protein-ligand binding sites (pockets) is important for understanding protein function and developing drugs. However, no public method ha...
arXiv:2610.17694v1 Announce Type: cross Abstract: We introduce HelpMeOut, an embodied AI benchmark for error-aware monitoring of household task execution. Existing embodied household benchmarks typic...
arXiv:2610.17685v1 Announce Type: cross Abstract: Enterprise agents face safety risks that cannot be determined from individual actions alone. Existing safety benchmarks largely evaluate action-local...
arXiv:2610.17747v1 Announce Type: cross Abstract: Failure-attribution benchmarks ask an LLM judge which step or agent caused a failure. A high score should mean the judge checked the faulty step agai...
arXiv:2610.17739v1 Announce Type: cross Abstract: Estimating potential outcomes under alternative treatment sequences is essential for personalized decision-making, but remains challenging with high-...
arXiv:2610.18097v1 Announce Type: cross Abstract: Post-training is crucial for improving text-to-image models, yet existing pipelines typically rely on manually curated training data and fixed traini...
arXiv:2610.18238v1 Announce Type: cross Abstract: Vision-language models (VLMs) have been widely adopted for document parsing and optical character recognition (OCR), as they can accurately extract p...