Leaderboards, eval harnesses and ablations — the contested business of deciding which model is actually better.
arXiv:2610.19185v1 Announce Type: new Abstract: Evaluation of large language models (LLMs) remains largely pre-scientific: it involves many design decisions, with little guidance on how to make them....
arXiv:2610.19408v1 Announce Type: new Abstract: Diffusion large language models (dLLMs) have advanced rapidly, yet strengthening their reasoning through reinforcement learning (RL) remains an open ch...
arXiv:2610.19291v1 Announce Type: new Abstract: In so-called "Industry 4.0," integrated sensors, analytics tools, and other digital technologies supplement industrial workflows, potentiating enhanced...
arXiv:2610.19741v1 Announce Type: new Abstract: Visible reasoning traces of Chinese reasoning-oriented LLMs are typically written in modern vernacular Chinese, which may be verbose under limited deco...
arXiv:2610.19314v1 Announce Type: new Abstract: Large language model (LLM) evaluators are increasingly used to assess personalized assistants, yet whether they can reliably judge personalization has...
arXiv:2610.19427v1 Announce Type: new Abstract: Legal reasoning is a fundamental capability for large language models (LLMs) to complete legal AI tasks such as legal judgment prediction. In legal pra...
arXiv:2610.19380v1 Announce Type: new Abstract: User feedback enables LLMs to refine reusable personalized skills, but often mixes persistent preferences with request-specific corrections. Indiscrimi...
arXiv:2610.19399v1 Announce Type: new Abstract: Korean neologisms arise through diverse mechanisms, a demanding test of language models beyond lexical memorization. To enable systematic evaluation, w...
arXiv:2610.19510v1 Announce Type: new Abstract: Block-diffusion language models denoise a whole block of token positions in parallel so each forward pass can emit many tokens. However, blocks are sti...
arXiv:2610.19561v1 Announce Type: new Abstract: An early mistake in the generated reasoning can constrain all subsequent reasoning. Repeated-generation methods, like MCMC-based approaches, attempt to...
arXiv:2610.19638v1 Announce Type: new Abstract: We present J-tau, the first publicly available Japanese benchmark for evaluating tool-using LLM agents in interactive customer-support scenarios. While...
arXiv:2610.19735v1 Announce Type: new Abstract: Scenario-based validation is essential for automated road vehicles but cannot cover the full variability of openworld traffic. We present MakSafe, a fo...
arXiv:2610.19723v1 Announce Type: new Abstract: Interpreting an ambiguous utterance in real-world interactions often requires context beyond a single utterance. When the utterance refers to objects i...
arXiv:2610.19792v1 Announce Type: new Abstract: Speculative decoding's effectiveness is governed by two quantities: the acceptance rate of drafted tokens and the cost of producing them. We show the t...
arXiv:2610.19848v1 Announce Type: new Abstract: We present OpenTWBench, an open evaluation suite for Taiwan-domain knowledge in large language models, built around two benchmarks. tw-exam-bench conta...
arXiv:2610.19906v1 Announce Type: new Abstract: LLMs have achieved strong performance on chemical prediction benchmarks. However, existing evaluation methods typically provide target entity identity...
arXiv:2610.19157v1 Announce Type: cross Abstract: Code generation models are actively being used in professional and educational settings. However, the competence of large language models (LLMs) to g...
arXiv:2610.20051v1 Announce Type: new Abstract: In recent years, with advances in multimodal interaction technologies and the growing demand for intelligent emotional support, Multimodal Emotional Su...
arXiv:2610.20186v1 Announce Type: new Abstract: Skills are widely assumed to play a central role in career transitions, motivating their use in career path prediction (CPP) systems. In this work, we...
arXiv:2610.20279v1 Announce Type: new Abstract: Part-of-speech tagging is a fundamental sequence labeling task and an important component for many downstream natural language processing applications....