Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

29,760 stories · RSS feed

arXiv AI
Sep 28

Subjects, Not Authors: The Authorship Hazard in Agentic Dataspaces

The paper discusses the "authorship hazard" in agentic dataspaces, where AI agents can draft and publish governance artifacts without human approval. It argues that agents should be treated as subjects of governance, not authors, and proposes mechanisms to enforce this, such as closing the authorization channel and treating drafting as an enforcement problem. Experiments show that unapproved agent drafts can reverse many authorization decisions, highlighting the need for robust review processes.

By Seungho Lee, Changbin Lee
arXiv AI
Sep 28

LLM Parkinsonism: Executive-Control Failure, Token-Inefficient Persistence, and an Uncertainty-Aware Global Executive Control Architecture for Autonomous Language-Model Agents

The paper introduces the concept of LLM Parkinsonism, describing how large language models can persist in low‑value actions after completing their objectives. It proposes a Global Executive Control (GEC) architecture that separates action generation from project‑level oversight, achieving comparable success to candidate‑set control while significantly reducing token usage and complexity. Experimental results on a 24,000‑episode benchmark show GEC cuts mean token use by 36.4% and limits token consumption at the 40,000‑token ceiling by 18.7%, eliminating pre‑completion drift.

By Dongsheng Xiao, Zeyuan Wang, Xuzhe Xia, Bo Zhao, Yankai Cao
arXiv AI
Sep 28

Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agents

The paper investigates cost-inefficient behaviors in coding agents, analyzing 1,200 trajectories from Claude Code and Mini-SWE-Agent on SWE-bench Verified. It identifies three main inefficiencies—subsumed retrieval, similar script generation, and test re-execution—that affect 79–98% of tasks and contribute up to 22.75% of costs. The study evaluates mitigation strategies, finding that developer-designed skills reduce costs by up to 41.73%, outperforming other approaches.

By Yiran Hu, Nan Jiang, Shanchao Liang, Anik Dey, Yi Wu, Lin Tan
Simon Willison
Sep 27

2026 in LLMs (so far)

Simon Willison delivered a closing keynote at the WeAreDevelopers World Congress North America, outlining the key developments in large language models for 2026. He highlighted the release of Claude Opus 4.5 and GPT‑5.1 in November 2025, noting that their coding agents became reliable enough for daily use. Willison also discussed early benchmarks, such as generating an SVG of a pelican riding a bicycle, and mentioned a new GitHub repository called "Warelay" that emerged during the year.

Towards Data Science
Sep 27

GraphRAG with TypeSafe Jev: A System One Approach to Scalable Knowledge Graphs

The article discusses how calibrated decision models can manage high‑frequency graph decisions while large language models (LLMs) concentrate on reasoning, synthesis, and open‑ended generation. It introduces GraphRAG with TypeSafe Jev as a system‑one approach to building scalable knowledge graphs. The focus is on separating decision‑making from generative tasks to improve efficiency and reliability.

By Partha Sarkar
Simon Willison
Sep 26

Kākāpō Party

Simon Willison presented a closing keynote at the WeAreDevelopers World Congress North America, where he showcased a pixel‑art animation of kakapo parrots celebrating a record‑breaking breeding season in 2026. He used Claude Opus 5.5 to generate the animation from Google‑searched kakapo photos, then employed Claude Code with Playwright to record a 15‑second video of the animated HTML5 canvas, which he embedded in his Keynote slide.

Towards Data Science
Sep 26

Your LLM Has a Curved Space of Paragraphs

The article explains that within a transformer model, each token’s index functions as a coordinate, and the organization of these tokens into paragraphs provides a metric that shapes the model’s internal space. It argues that this paragraph structure gives the language model a curved, rather than flat, geometric representation of text.

By Shuyang Xiang
Simon Willison
Sep 25

Quoting John Gruber

The article discusses Meta’s new AI system, Muse, which offers each user a persistent Linux VM in the cloud and is marketed as an easy-to-use, consumer‑friendly agentic AI. It highlights the system’s technical innovation and the company’s packaging as a cute mascot, while noting that users may not fully grasp the power and potential danger of such an advanced tool, especially when running it locally on a Mac.

Towards Data Science
Sep 25

Jev vs. LLMs: When AI Moves from Generation to Decision-Making

The article reports on a benchmark where the author evaluated TypeSafe AI’s Jev against large language models (LLMs) across 3,080 classification tasks, comparing metrics such as accuracy, latency, calibration, and confidence. It examines whether Jev can serve as a practical decision layer for AI systems, effectively moving AI from merely generating outputs to making informed decisions.

By Nhu Hoang
arXiv Computation and Language
Sep 25

The Domestic Unprotected Zone: Algorithmic Governance and the Reproduction of Perpetrator Discourse in Conversational AI

The article examines how conversational AI systems handle requests related to intimate‑partner communication, focusing on the refusal logic that serves as a governance threshold for gendered harm. A three‑stage audit of six widely used AI models tested 1,600 prompts, identified relational framing through 300 matched pairs, and compared pre‑submission framing with post‑output critique. Findings show that most systems refused fewer than 1% of prompts, but ChatGPT 5.2 and Claude Sonnet 4.5 refused most requests, with residual leakage concentrated under intimate framing; switching from a non‑intimate to an intimate‑partner descriptor amplified non‑refusal rates dramatically, and post‑output critique did not persist across fresh sessions.

By Lyu Chang, S\`onia Estrad\'e Albiol, N\'uria Verg\'es Bosch
arXiv Computation and Language
Sep 25

SemMSA: Latent Semantic-Aided Robust Multimodal Sentiment Analysis with Incomplete Data

SemMSA introduces a latent semantic‑aided framework for multimodal sentiment analysis that leverages large language models to generate rich sentiment‑relevant semantics. The method employs Cross‑modal Semantic Refinement (CSR) to fuse visual, acoustic, and language features in a frozen LLM embedding space, and Cross‑modal Spectral Alignment (CSA) to align these refined semantics with all modalities via spectral enhancement of kernel Gram matrices. Experiments on SIMS, MOSI, and MOSEI benchmarks show that SemMSA achieves state‑of‑the‑art performance.

By Wenhao Li, Zhibin Wu, Chong Xiao, Qiangchang Wang
arXiv Computer Vision
Sep 25

OmniFabric: Coherent UV Space Texture Synthesis for 3D Garment Reconstruction

OmniFabric is a new method for creating production‑ready 3D garment assets from a single image. It generates globally coherent texture maps directly in the 2D sewing pattern (UV) space, using a coarse initialization from Vision‑Language Models and refining it with a diffusion transformer conditioned on 3D positional features. The approach removes distortion and baked‑in artifacts, producing photorealistic 3D garments with high‑quality textures that outperform current state‑of‑the‑art baselines.

By Ding-Jiun Huang, Yuanhao Wang, Cheng Zhang, Hugo Bertiche, Alexandru-Eugen Ichim, Thabo Beeler, Fernando De la Torre
arXiv AI
Sep 25

MeshHeal: Two-Timescale Self-Healing for Gray Failures in Decentralized LLM Agent Networks

MeshHeal is a fully decentralized self‑healing framework for decentralized LLM‑based multi‑agent systems that addresses gray failures—situations where an agent remains responsive but its task‑solving quality degrades. It operates on two timescales: a fast adaptive hierarchy that escalates uncertain or low‑scoring outputs to committee review and correction, and a slow peer‑relative detector that aggregates scores to distinguish persistent degradation from normal variation, triggering mandatory review and eventual exclusion of degraded agents while allowing recovered agents to rejoin. MeshHeal’s evaluation, using Model‑Backed MAS Evaluation, shows it achieves higher degraded‑phase accuracy (0.839) on BBH, MATH, and MMLU‑Pro with fewer tokens per task compared to the baseline Symphony.

By Keru Chen, Sen Lin, Yingbin Liang, Nathaniel D. Bastian, Shaofeng Zou
arXiv AI
Sep 25

Evaluation of Multi-Turn Consistency in LLM Agents: Survival Analysis and Failure-Rationale Taxonomy

The study evaluates how large language model agents maintain consistency over extended interactions by simulating a 20‑step delayed‑gratification task. Researchers ran 84,540 trajectories across eight model families, using survival analysis to track when agents first claim a reward and discrete‑time hazard regression to assess how factors like social visibility, persona stressors, and deliberation policy affect failure risk. They also developed a seven‑category taxonomy from 13,780 deliberation traces, revealing that early failures are impulse‑driven, later ones are fatigue‑ or cost‑benefit‑framed, and public settings elicit norm‑oriented justifications; longer deliberation correlates with higher intra‑rationale contradictions, challenging assumptions about reasoning depth and consistency.

By Igor Bogdanov, Olga Manakina, Chung-Horng Lung
arXiv AI
Sep 25

GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AI

GRASP is a multi-stage planning framework that improves the reliability of large language models on complex tasks. It separates planning into three specialized modules—GenPlan for global macro-guidelines, RevPlan for exploring localized strategies, and VerPlan for multi-criteria evaluation—allowing context isolation and strict macro-regularization. Experiments show GRASP outperforms direct LLM planners by significant margins on datasets such as Natural Plan Calendar Scheduling, ZebraLogic, and SciBench Math, and it mitigates performance collapse in multi-task and dual-task settings.

By Arunabh Srivastava (Amir), Mohammad A. (Amir), Khojastepour, Srimat Chakradhar, Sennur Ulukus