Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

26,848 stories · RSS feed

arXiv AI

Oct 5

Learning to Revise Reasoning with Segment-wise On-Policy Distillation

arXiv:2610.02703v1 Announce Type: new Abstract: On-policy distillation (OPD) improves large language model reasoning by training students on their own rollouts with dense token-wise supervision from...

By Yuxiang Zhang, Ding Cao, Shuting Cui, Lei Wang, Weijieying Ren, Tianxiang Zhao

llms efficiency benchmarks

arXiv AI

Oct 5

Law And Order: Tax Law Autoformalization

arXiv:2610.02792v1 Announce Type: new Abstract: Legal systems are increasingly implemented through software, yet scalable methods for translating legal texts into accurate symbolic representations re...

By Sophia Simeng Han, Yoshiki Takashima, Anjiang Wei, Zhaoyu Li, Michael Genesereth

llms

arXiv AI

Oct 5

Are you Synthesizing or Recalling? Evaluating LLMs on Algorithmic Code Retrieval

arXiv:2610.02438v1 Announce Type: cross Abstract: Large language models (LLMs) have demonstrated strong performance in code generation, where success depends on both recalling relevant algorithmic kn...

By Nickil Maveli, Antonio Vergari, Shay B. Cohen

llms fine-tuning benchmarks

arXiv AI

Oct 5

FinDialogLens: Event Extraction over Multi-Party Dialogue for Missed-Trade Identification in Financial Chatrooms

arXiv:2610.02455v1 Announce Type: cross Abstract: Multi-party financial chatrooms are vital for sales-and-trading professionals, but their complexity makes manual recovery of missed trades infeasible...

By Chin-Lun Fu, Hong Ni, Behrouz Madahian

llms fine-tuning

arXiv AI

Oct 5

From Fragments to Global Maps: Learning Vectorized Map Aggregation with Large Language Models

arXiv:2610.02513v1 Announce Type: cross Abstract: Large-scale vectorized HD maps provide structured road information that is essential for perception, localization, and planning in autonomous driving...

By Ziwei Li, Yi-Tang Chen, Xiaoqi Wang, Wenbin He, Han-Wei Shen, Liu Ren

llms agents nlp robotics

arXiv Machine Learning

Oct 5

ChronoSpike: An Adaptive Spiking Graph Neural Network for Dynamic Graphs

arXiv:2602.01124v4 Announce Type: replace Abstract: Dynamic graph representation learning requires capturing both structural relations and temporal evolution, yet existing approaches face a core trad...

By Md Abrar Jahin, Taufikur Rahman Fuad, Jay Pujara, Craig Knoblock

llms efficiency benchmarks safety

arXiv Machine Learning

Oct 5

WakeKV: Reactive, Reversible KV Residency for Heads That Change Their Minds

arXiv:2610.02713v1 Announce Type: cross Abstract: Most KV-cache compression methods classify attention heads once, either offline or during prefill, and keep this classification fixed throughout gene...

By Utkarsh Ranjan

llms efficiency

arXiv AI

Oct 5

Student-Guided Teacher Distillation for Efficient LLM Task Routing: Positioning Against Jev-Style System-1 Classifiers

arXiv:2610.02516v1 Announce Type: cross Abstract: Zero-shot classifiers are useful for routing user requests to specialized LLM tasks, but scoring every request against a large candidate set is expen...

By Haifeng Wu, Srinivasan Manoharan, Jian Wan, Fangbo Tu, Junhua Zhao, Xin Chen

llms rag reinforcement-learning efficiency safety

arXiv AI

Oct 5

OpenGameEval: Benchmarking Agentic Programming and Exploration in a Stateful Game Engine

arXiv:2610.02563v1 Announce Type: cross Abstract: We present OpenGameEval, a benchmark and evaluation framework for agentic game development inside Roblox Studio. It runs language models as agents in...

By Eray Turkel, Mengsha Sun, Kartik Ayyar, Sean Dunigan, Jack Lu, Vlad Shcherban, Hsiang-Shun Shih, Xin Wang, Tiantian Zhang

llms agents benchmarks

arXiv Machine Learning

Oct 5

MintEval: Do LLMs Implement the Trading Strategy You Asked For? A Behavioural-Equivalence Benchmark for Natural-Language-to-Strategy Code

arXiv:2610.03080v1 Announce Type: cross Abstract: Large language models are moving from producing trading signals to writing the code that executes them. The failure mode of the second role is silent...

By Siyu Wang, Yifan Wang, Yuecheng He

llms benchmarks

arXiv Machine Learning

Oct 5

ParaGeo: Decomposing Paralinguistic Variation into a Shared Latent Geometry

arXiv:2610.03125v1 Announce Type: cross Abstract: Speech delivery varies with both the requested paralinguistic attribute and the linguistic content. We introduce ParaGeo, a matched-content decomposi...

By Yuhan Liu, Yuxuan Ou, Ruoxi Su, Mohamed Ahmed Zaki, Yunbo Long

llms benchmarks

arXiv Machine Learning

Oct 5

Does Physics Live in the Activations? Localizing Physical Quantities in Video Diffusion Models

arXiv:2610.03154v1 Announce Type: cross Abstract: Video generation models produce strikingly realistic sequences and are increasingly proposed as world models, yet recent benchmarks reveal pronounced...

By Jonas Kneifl, Jakub Skalski, Bart{\l}omiej Twardowski, Kamil Deja

llms diffusion benchmarks

arXiv Machine Learning

Oct 5

Can AI Understand the Language of Origami?

arXiv:2603.13856v3 Announce Type: replace Abstract: Building AI systems that can plan, act, and create in the physical world requires more than pattern recognition. Such systems must reason about the...

By Naaisha Agarwal, Yihan Wu, Xin Guan, Ayaan Garg, Yikuan Hu, Mohan Li, Vincenzo Collura, Wang-Zhou Dai, Yao-Xiang Ding, Emanuele Sansone

llms multimodal benchmarks

arXiv AI

Oct 5

MuonIO: Principled Norm-Aware Descent for Embedding Tables and Language Model Heads

arXiv:2610.02705v1 Announce Type: cross Abstract: The Muon optimizer derives its update rule for hidden linear layers by solving a local linearization of the loss penalized by the spectral norm, moti...

By Linkai Ma, Xinyu Luo, Mengbo Wang, Ananth Grama, Petros Drineas, Brian Bullins

llms rag

arXiv AI

Oct 5

ConvoDrift: A Multi-Turn Conversational Dataset for Modeling Stylistic Tone Evolution

arXiv:2610.02873v1 Announce Type: cross Abstract: The evolution of linguistic style in conversations is an underexplored issue in NLP. Most style-control datasets focus on sentences or assume a stati...

By Vihindi Kotalawala, Pamoda Dilranga, Gayani Thoradeniya, Prasan Yapa

llms nlp safety

arXiv AI

Oct 5

Fast Models, Slow Evidence: A Paired and Self-Audited Evaluation of System-1 Decision Models for LLM Agent Harnesses

arXiv:2610.02267v1 Announce Type: new Abstract: Agent harnesses make many small, typed decisions per task: which model to call, which tool to use, whether retrieved text is relevant, whether an input...

By Jiawei Li

llms rag agents

arXiv AI

Oct 5

Choosing Before Acting: Comparative Value Estimation for Long-Horizon Tool-Use Agents

arXiv:2610.02330v1 Announce Type: new Abstract: Large language models (LLMs) rely on long-horizon tool invocation sequences for complex tasks, where each invocation can alter the task state and condi...

By Yu Li, Zheng Zhang, Xin Liu, Shengtian Yang, Guangfeng Cai, Lei Feng

llms agents benchmarks

arXiv AI

Oct 5

Tailoring the Quantization Space for 1-Bit KV Cache Compression

arXiv:2610.03027v1 Announce Type: cross Abstract: The key-value (KV) cache becomes a major memory bottleneck in long-context LLM inference, placing substantial pressure on memory capacity and bandwid...

By Minsoo Cheong, Donghyun Son, Sungjoo Yoo

llms efficiency benchmarks

arXiv AI

Oct 5

WebFovea: When the Model Is Right but the Click Is Wrong -- Reliable Round Trips for Vision-Based Web Agents on Live Websites

arXiv:2610.03036v1 Announce Type: cross Abstract: We present WebFovea, a vision-based web agent that placed 2nd in the WebRetriever Challenge 2026 with a final score of 57.0 out of 100. The challenge...

By Jiangang Han

llms agents multimodal benchmarks safety

arXiv Computation and Language

Oct 5

Last Layer Logits to Logic: Empowering LLMs with Logic-Consistent Structured Knowledge Reasoning

arXiv:2511.07910v3 Announce Type: replace Abstract: Large Language Models (LLMs) achieve excellent performance in natural language reasoning tasks through pre-training on vast unstructured text, enab...

By Songze Li, Zhiqiang Liu, Zhaoyan Gong, Xiaoke Guo, Zhongpu Bo, Zhengke Gui, Lei Liang, Huajun Chen, Wen Zhang

llms nlp benchmarks

Get the daily briefing