Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

28,264 stories · RSS feed

arXiv AI

Oct 5

Hypothesis-guided discovery of cognitive algorithms via program refinement

arXiv:2610.02523v1 Announce Type: new Abstract: Developing cognitive models of algorithmic reasoning from behavioral data is a central problem in cognitive science that challenges current methods. Tr...

By Huiwen Alex Yang, Mark K. Ho, Bill D. Thompson

llms agents

arXiv AI

Oct 5

Revisiting Visual Representation Enhancement of VLMs via Kernel Canonical Correlation Analysis

arXiv:2610.02718v1 Announce Type: cross Abstract: Vision-language models such as CLIP exhibit strong semantic generalization, but remain limited in fine-grained visual perception. A recent work named...

By Peilin Yang, Xiaoyu Liu, Jian Sun, Qinghua Tao

llms rag fine-tuning multimodal safety

arXiv AI

Oct 5

Improving the Energy-Efficiency of the Code Generated by LLMs through Effective Prompting

arXiv:2610.02571v1 Announce Type: cross Abstract: As AI-assisted programming becomes increasingly mainstream, the environmental impact of AI-generated software has emerged as an important considerati...

By Ritika Rekhi, Bing Zhang, Md Arman Islam, Jaya Krishna Pasham, Yeswanth Chitturi, Akshay Paramesha, Isha Valiveti, Asif Imran, Bekir Turkkan, Tevfik Kosar

llms

arXiv AI

Oct 5

EchoDistill: Robust Large Audio Language Models via Noisy-to-Clean Self-Distillation

arXiv:2605.23954v2 Announce Type: replace-cross Abstract: Large Audio Language Models (LALMs) remain vulnerable to acoustic noise, which can obscure task-relevant evidence and produce unreliable resp...

By Kaiwen Luo, Chunxi Luo, Liang Lin, Yuxuan Li, Zhenhong Zhou, Junhao Dong, Yingjie Zhou, Zhendong Chu

llms efficiency benchmarks

arXiv AI

Oct 5

LEAF: A Living Benchmark for Event-Augmented Forecasting

arXiv:2605.16358v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are increasingly applied to real-world forecasting tasks, yet evaluating their true predictive capability remain...

By Mingtian Tan, Mihir Parmar, Palash Goyal, Chun-Liang Li, Nanyun Peng, Thomas Hartvigsen, Jinsung Yoon, Tomas Pfister

llms agents benchmarks

arXiv AI

Oct 5

Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis

arXiv:2604.10800v2 Announce Type: replace-cross Abstract: Learned classifiers deployed in agentic pipelines face a fundamental reliability problem: predictions are probabilistic inferences, not verif...

By Jugal Gajjar

llms rag agents

arXiv AI

Oct 5

Evaluation format, not model capability, drives measured triage failure in the assessment of consumer health AI

arXiv:2603.11413v4 Announce Type: replace-cross Abstract: A recent Nature Medicine study reported that ChatGPT Health under-triages 51.6% of emergencies and concluded that consumer-facing AI triage p...

By David Fraile Navarro, Jialei Sheng, Farah Magrabi, Enrico Coiera

llms benchmarks safety

arXiv AI

Oct 5

ANCRe: Adaptive Neural Connection Reassignment for Efficient Depth Scaling

arXiv:2602.09009v2 Announce Type: replace-cross Abstract: Scaling network depth has been a central driver behind the success of modern foundation models, yet recent investigations suggest that deep l...

By Yilang Zhang, Bingcong Li, Niao He, Georgios B. Giannakis

llms diffusion

arXiv AI

Oct 5

$T^5$: Twin-Critic Training for Token-Level Thoughts in Reinforcement Mid-Training

arXiv:2609.32791v2 Announce Type: replace Abstract: Reinforcement mid-training lets language models learn internal thoughts from unlabeled text, but efficient token-level credit assignment remains ch...

By Nan Qiao, Yebin Yang, Weinong Wang, Shuning Wang, Shangpin Peng, Fengyuan Lu, Xinming Wang, Zhehan Kan, Ruixu Zhang, Songyang Zhang, Sheng Yue, Yonglong Tian, Ju Ren

llms reinforcement-learning benchmarks

arXiv Machine Learning

Oct 5

SlimKV: Joint Token-Feature KV Cache Compression with Reconstruction-Free Beacon Attention

arXiv:2610.02953v1 Announce Type: new Abstract: Long-context LLM serving is increasingly bottlenecked by KV-cache memory, especially in resource-constrained scenarios. Among existing KV-cache compres...

By Zihan Teng, Jiayu Zhao, Wentao Ren, Minhao Fan, Tianrui Ma, Song Chen, Weichen Liu

llms rag efficiency

arXiv Machine Learning

Oct 5

Muon Learns Facts Better: Understanding the Role of Spectral Orthogonalization

arXiv:2610.02798v1 Announce Type: new Abstract: The Muon optimizer applies spectral orthogonalization to matrix-valued updates and has shown strong performance in large-scale neural network training,...

By Xuheng Li, Qiwei Di, Yuan Cao, Quanquan Gu

llms rag

arXiv Machine Learning

Oct 5

All Work And No Play Makes Jack a Dull Boy: Understanding and Preventing Catastrophic Strategy Collapse in RLVR

arXiv:2610.02835v1 Announce Type: new Abstract: During post-training of large language models (LLMs) with Reinforcement Learning with Verifiable Rewards (RLVR), GRPO-style algorithms can exhibit seve...

By Qiyuan Huang, Tianshi Xu, Meng Li

llms reinforcement-learning efficiency

arXiv Machine Learning

Oct 5

Hesitation Has a Geometry: Entropy-Trained Hyperbolic Probes for Sparse Activation Steering

arXiv:2610.02391v1 Announce Type: new Abstract: When a large language model solves a mathematical problem, its reasoning is largely hierarchical, and the solution often branches at a few tokens where...

By Zeyong Zhang, Tung Sum Thomas Kwok, Tengfei Ma, Mengjia Xu

llms

arXiv Machine Learning

Oct 5

Teaching LLMs to See Graphs: Unifying Text and Structural Reasoning

arXiv:2605.10247v2 Announce Type: replace Abstract: Applying Large Language Models (LLMs) to graph-structured data usually involves multi-step pipelines in which textual node attributes are compresse...

By Dario Vajda

llms fine-tuning benchmarks

arXiv Machine Learning

Oct 5

From Patching to Pruning Visual Computation in Vision Language Models

arXiv:2610.03389v1 Announce Type: cross Abstract: Vision language models (VLMs) incur substantial inference cost because every visual token is processed by the attention and MLP projections of every...

By Rahul Chowdhury, Timothy A Rupprecht, Xuan Shen, Shaoyi Huang, Pu Zhao, Yanzhi Wang

llms efficiency multimodal benchmarks safety

arXiv Machine Learning

Oct 5

RMCW: A Deletion-Robust Watermark Based on Reed--Muller Codes for Language Models

arXiv:2610.02817v1 Announce Type: cross Abstract: Large Language Model (LLM) watermarking provides a lightweight mechanism for identifying text generated by a specific model, but its robustness remai...

By Yi Wang, Baicheng Chen, Yu Wang, Jian Zhao, Yilei Chen, Tianxing He

llms safety

arXiv Machine Learning

Oct 5

Localized Conformal Safety Monitoring with Vision-Language Models for Autonomous Driving

arXiv:2610.02765v1 Announce Type: cross Abstract: Monitoring planned driving trajectories requires accurately estimating the collision likelihood with actors whose motion is itself impacted by the eg...

By Lu\'is Marques, Rong Fang, Disha Kamale, Dmitry Berenson

llms agents robotics multimodal safety

arXiv Machine Learning

Oct 5

Metropolis-Hastings Dominates Importance Resampling for Policy Composition

arXiv:2610.03480v1 Announce Type: new Abstract: Post-training a large language model (LLM) often requires exploring trade-offs between multiple rewards, but retraining for each trade-off is expensive...

By Alexey Kurennoy, Ramil Yarullin, Fergal Reid

llms safety

arXiv Computation and Language

Oct 5

Evaluating Multi-Dimensional Generalization of Large Language Models in Temporal Extraction Tasks

arXiv:2610.02549v1 Announce Type: new Abstract: Time and event expression extraction are fundamental temporal reasoning tasks, but the problem remains difficult due to annotation ambiguity, domain se...

By Fahmid Shahriar Iqbal, Ritam Dutt, Soumitra Das, Arnav Verma, Sagnik Ray Choudhury

llms safety

arXiv Computation and Language

Oct 5

Passing the Test You Trained On: Re-evaluating Prompt-Injection Detectors for LLM Agents

arXiv:2610.03448v1 Announce Type: cross Abstract: LLM agents increasingly screen tool outputs with small prompt-injection detectors, and teams choose among detectors by their scores on public benchma...

By Zhuowen Liu

llms agents benchmarks

Get the daily briefing