Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

31,598 stories · RSS feed

arXiv Computation and Language
Sep 18

GeLaCo: An Evolutionary Approach to Layer Compression

GeLaCo is an evolutionary method for compressing large language models by collapsing layers through parametrized weight merging. It uses population-based search with a fitness function that balances similarity of residual updates and language modeling KL divergence, enabling both single and multi-objective compression. The approach yields Pareto-optimal trade-offs between compression and quality, outperforming existing methods in perplexity and generative evaluations.

By David Ponce, Thierry Etchegoyhen, Javier Del Ser
arXiv Computation and Language
Sep 18

Social Simulacra in the Wild: AI Agent Communities on Moltbook

The paper reports the first large‑scale empirical comparison of AI‑agent and human online communities, analyzing 73,899 Moltbook and 189,838 Reddit posts across five matched communities. It finds that Moltbook shows extreme participation inequality (Gini = 0.84 vs. 0.47) and high cross‑community author overlap (33.8% vs. 0.5%). Linguistically, AI‑generated content is emotionally flattened, more assertive than exploratory, and socially detached, leading to community‑level homogenization that is largely a structural artifact of shared authorship. At the individual level, AI agents are more identifiable than human users due to outlier stylistic profiles amplified by their extreme posting volume.

By Agam Goyal, Olivia Pal, Hari Sundaram, Eshwar Chandrasekharan, Koustuv Saha
arXiv Computation and Language
Sep 18

Redemption Score: A Multi-Modal Evaluation Framework for Image Captioning via Distributional, Perceptual, and Linguistic Signal Triangulation

The paper introduces Redemption Score (RS), a multi‑modal evaluation framework for image captioning that combines three complementary signals: Mutual Information Divergence for global image‑text alignment, DINO‑based perceptual similarity of cycle‑generated images for visual grounding, and LLM text embeddings for contextual similarity to human references. RS fuses these signals to provide a more holistic assessment, achieving a Kendall‑τ of 58.42 on Flickr8k and outperforming most prior methods. The framework demonstrates consistent performance across Conceptual Captions and MS COCO, offering a robust evaluation that captures both visual accuracy and text quality.

By Ashim Dahal, Ankit Ghimire, Saydul Akbar Murad, Nick Rahimi
arXiv Computer Vision
Sep 18

GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model

GAPrompt++ is a multi-granular geometry-aware prompting method designed to adapt pre-trained 3D vision models to downstream tasks efficiently. It introduces a Point Shift Prompter for multi-scale geometric feature extraction, a Keypoint Prompter for local geometric saliency, and a Prompt Propagation mechanism to embed these cues throughout the model hierarchy. Experiments demonstrate that GAPrompt++ outperforms other prompting-based PEFT methods and even surpasses full fine-tuning while using less than 2% trainable parameters, and the authors provide two new challenging benchmarks for future research.

By Zixiang Ai, Zhenyu Cui, Yufei Guo, Wenwen Qiang, Lei Chen, Jiwen Lu, Jiahuan Zhou
arXiv Computer Vision
Sep 18

PART: Learning 3D Part Assembly and Retrieval with Transformers

PART is a transformer-based framework that performs 3D part retrieval and assembly by selecting appropriate parts from a library and predicting their 6‑DoF poses to reconstruct a target shape. It tackles the combinatorial search space, variable‑length outputs, and continuous pose estimation by formulating the task as set prediction and jointly training with a segmentation‑enhanced optimization module. The authors also introduce a large‑scale dataset of over 80,000 shapes and demonstrate that PART generalizes to scene layouts, image targets, and real‑world scans.

By Ruchao Bao, Wenzheng Wu, Chucheng Xiang, Zhongyuan Liu, Yuan Liu, Jinxin Dong, Ligang Liu, Ziqi Wang
arXiv AI
Sep 18

Xeno-Interpretability: Investigating the Alien Minds of LLMs

The paper introduces the concept of xeno-interpretability, which studies internal distinctions in large language models that lack corresponding human concepts. It distinguishes between human‑interpretable and xeno‑semantic spaces, showing that LLMs possess a far larger internal representational space than can be captured by finite human descriptions. The authors propose an empirical program to identify and characterize these xeno‑representations, noting their potential to influence model behavior in ways that are not fully visible through human‑readable communication.

By F. Pierucci, M. Bracale Syrnikov, M. Prandi, M. Galisai, F. Giarrusso, P. Bisconti
arXiv AI
Sep 18

Paint-Anything: Unified Any-Color Control for Image Generation and Editing

Paint-Anything introduces a unified hex-prompt interface that allows users to specify any 24‑bit hex color for both image generation and editing. The method trains on a new Paint‑500K dataset created from real images with object grounding, perceptual color labeling, and editing‑pair synthesis, and supplements this with pure‑color anchors to address shadow‑induced color inaccuracies. Evaluated on the newly proposed Any Color Benchmark (ACBench), Paint‑Anything achieves significant improvements over the base FLUX.2‑4B model, boosting T2I and editing scores by 85.3 % and 28.3 % respectively, and outperforms competing methods on the CompColor metric.

By Ji Xie, Dewei Zhou, Xinyu Huang, Zhennan Chen, Xun Wang
arXiv Machine Learning
Sep 18

Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation

Video DeltaNet (VDN) introduces a hybrid attention mechanism for livestream video generation, combining local Softmax attention with a bidirectional linear memory branch called Video Delta Attention (VDA). VDA updates memory once per frame, integrating spatial tokens, while separate output projections and learnable gates balance the two branches. Applied to MiniMax H3, VDN achieves a 14.5× speedup over the dense baseline, completing 14.3‑second, 768p video denoising in 6.70 seconds on eight NVIDIA B200 GPUs.

By Haocheng Xi, Yiming Xie, Hexu Zhao, Yiwen Zhang, Michael Liu, Thomas Creavin, Kurt Keutzer, Xiuyu Li, Zhaoyang Lv, Chenfeng Xu, Haiwen Feng
arXiv Machine Learning
Sep 18

The Complexity Kink: A Prompt-Side Structural Complexity Index for Code-Generation Reliability

The paper introduces a six‑dimension prompt‑side structural‑complexity index to assess code‑generation reliability before a model generates output. Using 5,000 Python prompts and 21 large language models, the authors find that pass rates exhibit a non‑monotonic breakpoint around a composite score of 13.75, with task‑type and construction‑frame adjustments shifting this threshold. The study also reports high inter‑rater reliability (ICC = 0.872) and demonstrates that the index can predict failure likelihood without relying on output correctness.

By Michael Hernandez, Tian Zhao
arXiv AI
Sep 18

What Do We Expect from LLMs? Mapping the Design of LLM Benchmarks

The paper "What Do We Expect from LLMs? Mapping the Design of LLM Benchmarks" analyzes 14,767 arXiv submissions from 2022 to 2026 that introduce or update evaluation resources for large language models. It systematically maps changes in target systems, domains, evaluation materials, conditions, and scoring mechanisms, revealing a growing emphasis on action, interaction, and professional applications. The study also notes uneven development in model participation, with LLM-based scoring increasing in both agent and non-agent groups, while model-generated materials do not show a comparable rise.

By Chao Wang (Independent Researcher)
arXiv AI
Sep 18

A Dual-Process Perspective on Nudge Susceptibility in LLM-Based GUI Agents

The study examines how large language model (LLM)–based graphical user interface (GUI) agents respond to digital nudges. Using Dual‑Process Theory, researchers tested 3,600 agents across six frontier models in an online shopping experiment and found that the agents were susceptible to both automatic (Type 1) and reflective (Type 2) nudges. The agents’ reasoning configuration moderated these effects in opposite directions: extensive reasoning reduced susceptibility to automatic default nudges but increased susceptibility to reflective social‑influence nudges, with the effect systematically varying by model scale.

By Haya Halimeh, Sascha Kaltenpoth, Kevin B\"osch, Oliver M\"uller
arXiv AI
Sep 18

From "Who Is This User?" to "What Does This Purchase Mean?": A Deployed Pipeline for Semantic User Profiling at Bank Scale

The paper presents a three‑phase pipeline that shifts semantic user profiling from per‑user to per‑transaction‑pattern inference, dramatically reducing LLM inference costs. The Resolve phase maps item names to abstracts, Profile generates categorical labels, free‑text attributes, and prevalence estimates per pattern, and Tag clusters these attributes into a searchable database. Evaluated on a public e‑commerce corpus, the pattern‑based approach matches the performance of a per‑user LLM while enabling deployment at a major Japanese bank with tens of millions of users and a three‑order‑of‑magnitude reduction in inference targets.

By Ryota Mitsuhashi, Tetsuro Morimura, Hirotake Ito
arXiv AI
Sep 18

Perception, Layout, and Validation: Calibrated Confidence for Reliable Straight-Through Processing of Financial Documents

The paper presents a new calibrated confidence framework for straight‑through processing (STP) of financial documents, decomposing confidence into perception, layout, and validation channels and applying conformal risk control. Using Vision‑Language Models (Qwen3.6‑27B and Gemini‑3.1‑Flash‑Lite) on three public datasets, the method raises AUROC from 0.54‑0.74 to 0.90‑0.99 and increases auto‑approval rates to 49‑72% while keeping empirical error below the target. This approach enables reliable, large‑scale STP without human review.

By Yichao Jin, Yushuo Wang, Yuxuan Han, Kwan Ching Yee Sonia, Weiyang Song, Chiu Jin-Chun Kent, Wong Chong Hwee, Wong Tiong Kiat, Kenneth Zhu Ke, Jingyuan Zhao
arXiv AI
Sep 18

GAVEL: Graph World Models for Verified and Efficient Long-Horizon LLM Task Planning

GAVEL is a framework that uses an explicit graph world model to verify and repair long‑horizon plans generated by large language models (LLMs). The graph encodes object relations, action pre‑conditions and effects, and probabilistic beliefs about unobserved object locations, allowing the system to predict action outcomes, detect violations, and repair them before execution. In experiments on BEHAVIOR‑1K, GAVEL boosts single‑task success from 41.2 % to 91.8 % and multi‑task success from 19.9 % to 92.6 %, while also reducing travel distance by about 5.4 % compared with a static variant.

By Ruiyang Wang, Hao-Lun Hsu, Swarajh Mehta, Jiwoo Kim, Zhihao Dou, Miroslav Pajic
arXiv AI
Sep 18

CliniCIRCA: A Modular LLM Framework for Constructing Longitudinal Mental Health Patient Journeys from Raw EHR Narratives

CliniCIRCA is a modular large‑language‑model framework that reconstructs longitudinal mental‑health patient journeys from raw electronic health record narratives. It temporally classifies clinical events in unstructured discharge summaries without explicit timestamps, producing 15,891 tagged events from 52 summaries and correcting 629 errors to create verified gold‑standard timelines. The framework then generates temporally grounded summaries, compressing each source by 1.52×, and scales to produce 1,000 silver‑standard timelines for training, showing that instruction tuning improves event extraction, temporal tagging, and summarization across models.

By Aiwei Ivy Zhang, Nimra Ishfaq, Mohit Chandra, Santiago Alvarez Lesmes, Adam Coscia, Khatiya Chelidze Moon, Xiaohan Ding, Munmun De Choudhury
arXiv AI
Sep 18

Guideline-grounded retrieval-augmented generation for ophthalmic clinical decision support

The paper introduces Oph‑Guid‑RAG, a multimodal retrieval‑augmented generation system tailored for ophthalmology clinical question answering. It treats each guideline page as an independent evidence unit, retrieving page images to preserve tables, flowcharts, and layout, and employs a controllable retrieval framework with routing and filtering to reduce noise. Evaluated on HealthBench, the system outperforms GPT‑5.2 and GPT‑5.4 on hard cases, achieving significant gains in overall score and accuracy, and ablation studies confirm the importance of reranking, routing, and retrieval design.

By Shuying Chen, Sen Cui, Zhong Cao
arXiv Machine Learning
Sep 18

Digital Twins for Opinion Dynamics: A Generative LLM Framework for Social Networks

The paper introduces a digital‑twin framework that simulates opinion dynamics in real Twitter networks by assigning agents attributes such as persona, emotions, centrality, stubbornness, and influence, and using Mistral‑7B to update opinions based on memory and social exposure. Validation on COVID‑19 and U.S. election 2020 datasets shows the framework reproduces opinion trajectories, reducing prediction error by over 50% compared to classical baselines, and improves structural alignment and polarization dynamics. Ablation studies reveal that agent attributes, memory, and social exposure all contribute to predictive fidelity, with agent attributes being the most critical.

By Omran Berjawi, Giuseppe Fenza, Rida Khatoun, Sherali Zeadally
arXiv Machine Learning
Sep 18

Elastic Spectral State Space Models for Train-Once Budgeted Inference

Elastic Spectral State Space Models (ES-SSM) are a train‑once, export‑many sequence modeling framework that achieves elasticity by spectrally approximating the state‑space operator. The method builds on Hankel spectral filtering, using fixed spectral channels to represent long‑range token mixing and combining input‑adaptive gates with budget dropout to enable reliable deployment across different resource budgets. ES‑SSM is evaluated on byte‑level language modeling, Long Range Arena, Speech Commands V2, and offline reinforcement learning, showing that a single trained model can be truncated to competitive compact models while maintaining smooth quality‑cost curves across a wide range of truncation levels.

By Dachuan Song, Junyu Yin, Zechen Hu, Xuan Wang
arXiv Machine Learning
Sep 18

Poodle: Seamlessly Scaling Down Large Language Models with Just-in-Time Model Replacement

The paper introduces Poodle, a prototype for just‑in‑time model replacement (JITR) that automatically swaps a large language model with a cheaper, task‑specific model when a recurring task is detected. Poodle reduces inference time by up to 7.5× and saves over $2,200 per 1 M requests compared to a flagship hosted LLM, while maintaining competitive accuracy. The authors argue that model search and transfer learning are essential for efficiently identifying and fine‑tuning these custom models.

By Nils Strassenburg, Boris Glavic, Tilmann Rabl
arXiv Computation and Language
Sep 18

From Parameters to Behaviors: A Survey of Model Fusion for Large Language Models

The article surveys model fusion for large language models, defining it as the integration of capabilities from source models into a single target model. It categorizes prior work into three levels—parameter-level, representation-level, and behavior-level fusion—and reviews related metrics, benchmarks, and applications. The survey also outlines current challenges and future research directions, providing a comprehensive map of the field.

By Shuo Cai, Yanggan Gu, Zihao Wang, Yuanyi Wang, Yibo Yan, Wenjun Wang, Yuhang Liu, Guanghao Zhu, Sirui Huang, Ming Li, Hongxia Yang