Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

32,584 stories · RSS feed

arXiv AI
Sep 16

little m: An AI Agent for Industrial Process Optimization

The paper introduces little m, an AI agent that helps formulate industrial process control models by combining a domain-specific knowledge repository with LLM-driven interaction. It tackles the challenge of converting messy real-world specifications, including natural language and spatial diagrams, into rigorous mathematical optimization models. The authors also present IPC-Bench, a multimodal dataset of 50 canonical scenarios, and show through automated and human evaluations that little m outperforms state‑of‑the‑art LLMs in generating semantically correct models.

By Yongchao Ye, Xinyu He, Dutliff Boshoff, Way Kuo, Lishuai Li
arXiv AI
Sep 16

Vroom-Vroom at SHROOM-Visions: A Multi-Judge Committee for Detecting Hallucinated Spans in Vision-Language Outputs

The paper reports a submission to the SHROOM-Visions shared task, aiming to detect and classify hallucinated character spans in vision‑language model outputs across four languages. The authors use multiple fine‑tuned vision‑language models as independent annotators, combine their predictions via character‑level majority voting, and also investigate activation probes. Their method achieved first place in three of the four languages and consistently ranked on the podium for all languages and metrics, with analysis showing that model disagreement mirrors human annotator disagreement.

By Toqeer Ehsan, Nico Penttil\"a, Richard Schmidt, Arash Hajikhani, Victoria Palacin
arXiv Machine Learning
Sep 16

Goal-oriented probabilistic forecasting for dynamic PRB allocation in 5G networks

The paper introduces a goal‑oriented probabilistic forecasting framework for dynamic physical resource block (PRB) allocation in 5G networks. By training DeepAR and Temporal Fusion Transformer models with the Pinball Loss function and selecting an optimal allocation quantile based on an operator’s cost matrix, the approach aligns forecasting with operational objectives. Experiments on real beam‑level 5G traffic data show reduced operational cost compared to MSE‑trained baselines while preserving calibrated uncertainty estimates.

By Oier Larumbe-Lizarraga, Roberto Pereira, Cristian J. Vaca-Rubio
arXiv Computer Vision
Sep 16

Unifying Semantic Priors and High-Frequency Traces: Enhancing V-JEPA with Mixture-of-Experts for Robust Synthetic Image Forensics

The paper introduces MoE-JEPA, a dual‑stream deepfake detection model that combines a V‑JEPA backbone with a Residual Mixture‑of‑Experts mechanism and a noise stream branch. It further incorporates a Gated Attention Multiple Instance Learning module to refine spatial semantic understanding. On the SID‑Set benchmark, MoE‑JEPA achieves a new state‑of‑the‑art accuracy of 95.54%, outperforming much larger models.

By Simone Teglia, Irene Amerini
arXiv Computer Vision
Sep 16

Unsafe by Reciprocity: How Generation-Understanding Coupling Undermines Safety in Unified Multimodal Models

The paper examines how the tight integration of multimodal understanding and image generation in Unified Multimodal Models (UMMs) can create new safety vulnerabilities. It introduces RICE, an attack framework that exploits bidirectional interactions between generation and understanding to propagate unsafe signals across modalities. Experiments demonstrate high attack success rates in both Generation‑to‑Understanding and Understanding‑to‑Generation pathways, revealing previously overlooked safety weaknesses in UMMs.

By Kaishen Wang, Heng Huang
arXiv AI
Sep 16

Text-Driven Artistic Staging: 3D Posing, Lighting, and Camera References from Paintings

The paper presents a method for generating 3D staging—human poses, lighting, and camera setup—directly from affective textual descriptions. It builds a dataset of 11,911 text–staging pairs derived from 2,328 figurative paintings, reconstructing SMPL bodies, estimating illumination, and recovering camera parameters. A flow‑matching transformer is trained to produce variable‑size scenes and multiple staging alternatives, achieving a 32.2% retrieval R@1 on held‑out prompts, outperforming a CLIP‑based baseline.

By Yunge Wen
arXiv Machine Learning
Sep 16

GrowMTP: Can RL Grow Its Own Draft Head?

GrowMTP is a method that trains a draft head entirely within the reinforcement learning (RL) loop, using supervision from the RL verification step and a rollout distribution that is narrower than pretraining. By detaching draft‑head updates from the policy backbone, it enables online training of the draft head from scratch. Experiments on Qwen3‑4B, MiMo‑7B‑SFT, and Qwen3.5‑4B‑Base show rollout speedups ranging from 1.36× to 2.13× and overall end‑to‑end speedups from 1.20× to 1.60×, making it a modular acceleration component for RL frameworks lacking pretrained draft heads.

By Minghua He, Lingzhe Zhang, Yuan Liu, Xiao Zhou, Aiwei Liu
arXiv AI
Sep 16

Bridging Learned Visual Perception and Symbolic Belief-Space Planning

The paper introduces a new paradigm called VLM-as-probabilistic-grounder, which models the uncertainty of Vision‑Language Model (VLM) predicate groundings as a probability distribution over symbolic states. This probabilistic grounding allows belief‑space planning, producing more robust plans in partially observable settings. Experiments in simulated household robot environments demonstrate that this approach improves robustness and task success compared to deterministic grounding methods.

By Guy Azran, Michael Navat, Sarah Keren
arXiv AI
Sep 16

Self-Emergence Agent Architecture:Behavior-Inertia HMM, Reflexive Metacognition,and Social-Contrastive Self-Modeling

The paper introduces the Self‑Emergence Agent Architecture (SEAA), a framework that combines a Hidden Markov Model for behavioral inertia, a reflexive metacognition loop that updates the HMM, and a social environment where agents compare behaviors. This closed loop enables agents to develop distinct, stable personalities and social structures without external prompts. Experiments with both a language‑model‑free prototype and hosted LLMs demonstrate spontaneous symmetry breaking and the emergence of consensus hubs and outliers.

By Xiaoyang Liu
arXiv AI
Sep 16

LimiX-2: A Contextual Mechanism Network Towards General Structured-Data Intelligence

arXiv:2609. 17488v1 Announce Type: new Abstract: We introduce LimiX-2, a new model in the LimiX family, developed through model and data scaling guided by our previously established scaling laws.

By Xingxuan Zhang, Gang Ren, Hao Yuan, Hao Zou, Hongze Tan, Hui Wang, Jianhao Song, Jiansheng Li, Jiayao Zhang, Jinghan Zhang, Kaifang Li, Lang Mo, Li Mao, Mingchao Hao, Nuo Xu, Rui Ding, Ruiji Zhang, Shuyang Li, Siyu Mei, Tianyang Zhang, Weiyang Mu, Yancheng Dong, Yongxian Wei, Yuan Xue, Yuanrui Wang, Yue He, Zijia Yang, Ziyun Li, Dongzhe Li, Fuqiang Wang, Jiandong Liu, Jiawei Chen, Jiaxin Du, Kaijie Cheng, Kehan Li, Lei Sun, Linjun Zhou, Ningbo Dai, Qi Wang, Renzhe Xu, Shaoxing Du, Shumeng Yang, Wang Lu, Wenjing Chu, Xiannan Huang, Xiaoyu Lin, Xing Ai, Xinyan Han, Xuanyue Li, Xuanyue Su, Xukun Zhang, Yan Lu, Yaxin Zhang, Yi Qin, Yifei Huang, Yihan Xu, Yongle Lv, Yuanyuan Jiang, Yushan Han, Peng Cui
arXiv Computation and Language
Sep 16

surprisal is Not a Theory

The article argues that Surprisal Theory, often presented as a computational-level explanation, is not a theory in its own right. It contends that using large language model (LLM) surprisals without considering the underlying representational and algorithmic choices obscures the theory’s commitments. The authors demonstrate through three analyses that algorithm and architecture significantly influence language model probabilities, urging researchers to reassess treating LLM surprisals as interchangeable.

By Andr\'es Bux\'o-Lugo, Aniello De Santo, Morgan Grobol, Ryan J. Hubbard, Cassandra L. Jacobs
arXiv Computer Vision
Sep 16

EgoPathBench: Evaluating Zero-Shot Egocentric Waypoint Decision-Making in Vision-Language Models

EgoPathBench is a new dataset and benchmark that tests zero‑shot egocentric waypoint decision‑making in vision‑language models. Each task presents an egocentric RGB image, a natural‑language goal, and numbered visible waypoints, and models must return traversable candidates or an ordered route. The benchmark evaluates candidate feasibility, edge legality, and goal arrival under point‑agent or embodied geometry, covering 31,852 training, 1,345 validation, and 1,111 benchmark questions. "whyItMatters":"The benchmark reveals that current VLMs perform poorly on integrated navigation tasks, highlighting a gap in spatial intelligence that can be addressed by fine‑tuning with the released training data."

By Yang Zhao, Zhuo Chen, Xubo Yang
arXiv AI
Sep 16

Permutation-Based Stegomalware in Large Language Models: Threats and Countermeasures

The paper investigates the threat of stegomalware—malicious payloads hidden in large language model weights—and explores permutation symmetry as a defense. It demonstrates that carefully chosen permutations can neutralize stegomalware across all weights, unlike prior methods that left many weights untouched. Conversely, the same symmetry can be exploited to embed malware losslessly, without retraining or payload-specific extraction scripts, while only minimally affecting model performance.

By Danny Wood, James Stringer
arXiv AI
Sep 16

Beyond the Name: Demographic Leakage in De-Identified R\'esum\'es and Evaluation Artifacts in LLM Bias Audits

The paper examines whether removing declared language fields from de‑identified résumés eliminates demographic leakage in large language models. By keeping language attributes identical and varying only unstructured prose across five ethnocultural groups and three cue‑salience levels, the authors find that non‑language text still allows target‑group recovery (average 0.757, reaching 1.000 under high salience). They also show that evaluation design—such as allowing or forbidding ties—dramatically affects LLM‑as‑a‑judge outcomes, underscoring the importance of evaluation protocol in bias audits.

By Qiangju Chen, Yang Xiao
arXiv AI
Sep 16

Repurposing Deep Limit Order Book Forecasting for Scenario-Conditioned Market Impact Modeling

The paper demonstrates that deep limit order book forecasting models can be repurposed to quantify scenario-conditioned market impact without retraining. By injecting counterfactual order‑book messages into a trained Transformer forecaster, the authors compare predictive distributions before and after the injection, defining a short‑horizon model‑implied market impact. The approach achieves a Spearman correlation of 0.99 and 97.2% directional agreement with historical outcomes for non‑neutral scenarios, and captures incremental sequence‑dependent variation beyond scenario identity and pre‑event forecasts.

By Eljas Linna, Kestutis Baltakys, Derrick Manoharan, Alexandros Iosifidis, Juho Kanniainen
arXiv AI
Sep 16

ResLRP: The Role of Residual Cancellation in Attribution Instability in Vision Transformers

The paper introduces ResLRP, an extension of Layer-wise Relevance Propagation that explicitly handles residual connections in Vision Transformers to prevent attribution explosion. It demonstrates that residual cancellation causes instability in ViT explanations, and that ResLRP improves faithfulness and localization across a wide range of ViT architectures, including Vision Language Models. The method also provides a diagnostic measure for predicting attribution degradation and successfully localizes Sparse Autoencoder features.

By Jim Berend, Reduan Achtibat, Daniel Sch\"affer, Alexander Binder, Wojciech Samek, Sebastian Lapuschkin, Maximilian Dreyer
arXiv AI
Sep 16

Easy to Catch a Liar, Hard to Clear an Honest One: Language Models Diagnosing a Corrupted Reward Channel from a Verified Record

The paper investigates whether frozen language models can detect a corrupted reward signal by using a single verified record in a two‑option game. In the game, a payout swap and a lying reporter produce identical histories, but a single line confirming the true outcome allows the models to almost perfectly identify the liar. However, the models frequently misclassify honest reporters as liars, with error rates ranging from 26% to 58% depending on model size and wording, indicating a significant limitation in their ability to interpret verified data.

By Arman Nik Khah