Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

20,725 stories · RSS feed

arXiv AI

Jul 21

Learning from World Feedback: Why Model Uncertainty Fails as a Risk Signal in Model-Based RL

arXiv:2607. 16591v1 Announce Type: cross Abstract: The RLxF programme argues that learning signals should come from world feedback rather than from internal model proxies.

By Zhaohui Wang

llms reinforcement-learning safety

arXiv AI

Jul 21

Solver-Hard Is Not Model-Hard: A Hardness-Controlled Diagnostic for LLM Constraint Reasoning

arXiv:2607. 17047v1 Announce Type: cross Abstract: LLM constraint reasoners are often evaluated near the random-SAT phase transition, confounding density and solver hardness.

By Lucky Verma

llms

arXiv AI

Jul 21

CARV: A Diagnostic Benchmark for Compositional Analogical Reasoning in Multimodal LLMs

arXiv:2603. 27958v2 Announce Type: replace Abstract: Analogical reasoning tests a fundamental aspect of human cognition: mapping the relation from one pair of objects to another.

By Yongkang Du, Xiaohan Zou, Minhao Cheng, Lu Lin

llms multimodal benchmarks

arXiv AI

Jul 21

Arbor: A Framework for Reliable Navigation of Critical Conversation Flows

arXiv:2602. 14643v4 Announce Type: replace Abstract: Large language models struggle to maintain strict adherence to structured workflows in high-stakes domains such as healthcare triage.

By Lu\'is Silva, Diogo Gon\c{c}alves, Catarina Farinha, Clara Matos, Lu\'is Ungaro

llms agents

arXiv AI

Jul 21

Lil: Less is Less When Applying Post-Training Sparse-Attention Algorithms in Long-Decode Stage

arXiv:2601. 03043v4 Announce Type: replace-cross Abstract: Large language models (LLMs) demonstrate strong capabilities across a wide range of complex tasks and are increasingly deployed at scale, placing significant demands on inference efficiency.

By Junhao Hu, Fangze Li, Mingtao Xu, Feifan Meng, Shiju Zhao, Tiancheng Hu, Ting Peng, Anmin Liu, Wenrui Huang, Chenxu Liu, Ziyue Hua, Tao Xie

llms benchmarks

arXiv AI

Jul 21

Is "Knowing It's Malicious Enough?" Evaluating LLMs for Fine-Grained Malware Behavior Auditing

arXiv:2509. 14335v2 Announce Type: replace-cross Abstract: Automated malware classifiers achieve strong detection performance, but auditing requires more than flagging a sample: analysts must explain malicious behaviors and justify them with code evidence.

By Xinran Zheng, Xingzhi Qian, Yiling He, Shuo Yang, Lorenzo Cavallaro

llms agents benchmarks

arXiv AI

Jul 21

Spatiotemporal Knowledge Graphs as Persistent Scene Memory for Embodied Question Answering

arXiv:2510. 01483v3 Announce Type: replace-cross Abstract: Vision-language models (VLMs) demonstrate strong image-level scene understanding, but reasoning over long egocentric video remains costly: because VLMs maintain no persistent memory or explicit spatial representation, all sampled frames must be re-processed for every new query.

By Mohamad Al Mdfaa, Svetlana Lukina, Timur Akhtyamov, Arthur Nigmatzyanov, Dmitrii Nalberskii, Sergey Zagoruyko, Gonzalo Ferrer

llms agents nlp robotics multimodal benchmarks

arXiv AI

Jul 21

RobustVLA: On Robustness of Vision-Language-Action Model against Multi-Modal Perturbations

arXiv:2510. 00037v5 Announce Type: replace-cross Abstract: In Vision-Language-Actionf(VLA) models, robustness to real-world perturbations is critical for deployment.

By Jianing Guo, Zhenhong Wu, Chang Tu, Yiyao Ma, Xiangqi Kong, Zhiqian Liu, Jiaming Ji, Shuning Zhang, Yuanpei Chen, Kai Chen, Qi Dou, Yaodong Yang, Xianglong Liu, Huijie Zhao, Weifeng Lv, Simin Li

llms diffusion reinforcement-learning robotics multimodal safety

arXiv AI

Jul 21

Trusting sovereign language models as scientific instruments: evidence from Portugal's AMALIA

arXiv:2607. 08731v2 Announce Type: replace-cross Abstract: National language models are becoming publicly funded epistemic infrastructure.

By Manuel Pita

llms

arXiv AI

Jul 21

Short-Term Electricity Demand Forecasting for New England: A Comprehensive Machine Learning Benchmark with Weather, Calendar, and COVID-19 Indicators

arXiv:2606. 20918v2 Announce Type: replace-cross Abstract: Accurate short-term electricity demand forecasting is critical for reliable power system operation, energy market planning, and infrastructure optimization.

By Reza Ghanavati, Behrooz Mosallaei

llms benchmarks

arXiv Machine Learning

Jul 21

LLM-as-a-Coach: Experiential Learning for Non-Verifiable Tasks

arXiv:2607. 18110v1 Announce Type: new Abstract: Reinforcement learning (RL) on open-ended tasks compresses an LLM's rubric-based evaluation into a scalar reward, discarding rich textual feedback and conflating responses with distinct quality profiles.

By Tianzhu Ye, Li Dong, Guanheng Chen, He Zhu, Xun Wu, Shaohan Huang, Furu Wei

llms reinforcement-learning efficiency

arXiv Machine Learning

Jul 21

PoLoRA: A Preconditioned Orthogonalized LoRA Optimizer

arXiv:2607. 17620v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) makes finetuning large language models cheaper by adding to each weight matrix a trainable low-rank update parameterized as the product of two matrices.

By Nikhil Ghosh, Tetiana Parshakova, Robert M. Gower

llms fine-tuning

arXiv Machine Learning

Jul 21

Patch Policy: Efficient Embodied Control via Dense Visual Representations

arXiv:2607. 18236v1 Announce Type: cross Abstract: Pretrained dense visual features from Vision Transformers (ViTs) are powerful yet have been underutilized in robot learning.

By Gaoyue Zhou, Zichen Jeff Cui, Ada Langford, Bowen Tan, Yann LeCun, Lerrel Pinto

llms robotics fine-tuning efficiency multimodal benchmarks

arXiv Machine Learning

Jul 21

SciForma: Structure-Faithful Generation of Scientific Diagrams

arXiv:2607. 18091v1 Announce Type: cross Abstract: Structural fidelity is essential to scientific methodology diagrams.

By Yuxuan Luo, Peng Zhang, Xinjie Zhang, Xun Guo, Zhouhui Lian, Yan Lu

llms reinforcement-learning fine-tuning

arXiv AI

Jul 21

Committed Before Reasoning: Behavioral Reproduction and Preliminary Activation-Level Evidence of Answer Pre-Commitment in an Open-Weight LLM

arXiv:2607. 16451v1 Announce Type: cross Abstract: Chat models sometimes commit to an answer and then produce reasoning that justifies it rather than deriving it -- even when the answer contradicts a task premise.

By Heejin Jo

llms safety

arXiv Machine Learning

Jul 21

An Adjoint-Sensitivity Framework for Lost-in-the-Middle Phenomena in Causal Residual Transformers

arXiv:2607. 17696v1 Announce Type: cross Abstract: We develop an adjoint-sensitivity framework for positional influence in causal residual Transformers and separate unconditional analytic results from conditional boundary-shape conclusions.

By Cheng Huan, Hongwei Yuan

llms safety

arXiv Machine Learning

Jul 21

AGG: Jacobian-Aggregated Group Gradient for Efficient GRPO Training of Diffusion Models

arXiv:2607. 17572v1 Announce Type: new Abstract: Group Relative Policy Optimization (GRPO) is a powerful reinforcement learning algorithm for aligning generative models with human preferences.

By Ruiyi Ding, Jie Li, He Kang, Ziyan Liu, Chengru Song, Yuan chen

llms diffusion reinforcement-learning benchmarks

arXiv Machine Learning

Jul 21

GeneSpeak-FP: Target and Compound Retrieval from Observed Cell-Level Perturbation Signatures

arXiv:2607. 17671v1 Announce Type: new Abstract: Large-scale single-cell perturbation atlases make it possible to ask an inverse question: given an observed transcriptional response, which annotated targets and compounds in a fixed library are most consistent with that response?

By Kseniia Vaniushkina, Jeongmin Lim, Jinyong Park

llms rag safety

arXiv Machine Learning

Jul 21

Node4All: Learning Node Representation Beyond Datasets

arXiv:2607. 17272v1 Announce Type: new Abstract: Node representation learning has advanced rapidly, yet most existing methods rely on per-dataset training and hyperparameter tuning.

By Dooho Lee, Jaemin Yoo

llms benchmarks

arXiv Machine Learning

Jul 21

HyBDM: Multi-Scale Hybrid Experts for Time Series Forecasting with Bidirectional Dependency Modeling

arXiv:2607. 16882v1 Announce Type: new Abstract: Time series forecasting (TSF) is vital to many applications, yet existing models often struggle to capture the heterogeneous long-range global patterns and short-range local variations in multivariate time series.

By Wenqiang Ma, Chen Cheng, Xue Cheng, Jiarui Ye

llms benchmarks

Get the daily briefing