Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

29,741 stories · RSS feed

arXiv Computation and Language
Sep 28

Symbiotic Architecture for Post-Hoc Audio Extension of Frozen Language Models

The paper introduces a symbiotic architecture that equips large language models with audio‑understanding abilities without fine‑tuning their weights. It uses an injector module to write audio‑conditioned vectors into the LLM’s key‑value cache, allowing the model to act as an audio language model while keeping the backbone unchanged. The approach improves scalability—since injection cost depends on the injector width—and preserves the LLM’s original text performance, outperforming conventional frozen‑LLM methods and approaching fine‑tuned ALM results on audio tasks.

By Yotaro Kubo, Qi Sun, Yujin Tang
arXiv Computer Vision
Sep 28

Timo: $\textbf{T}$aming Mult$\textbf{i}$modal Diffusion Transformer for Human $\textbf{Mo}$tion Generation

The paper introduces Timo, a kinematics-aware multimodal diffusion transformer designed for human motion generation. Timo employs fully shared multimodal attention, flow matching, and geometric/rotational-kinematics supervision to better coordinate articulated motion, and uses a two-stage curriculum to align motion with text captions. The authors also present a new benchmark of 40,025 clips from six datasets, showing that Timo outperforms state‑of‑the‑art methods, achieving a 40.8% relative improvement over Kimodo on average.

By Zhao Wang, Jiangtao Hu, Jack Yu, Tao Yu
arXiv Computer Vision
Sep 28

Diagnosing the Sources of Compositional Failure in Vision-Language Models: A Controlled Analysis

arXiv:2609.31456v1 Announce Type: new Abstract: Vision-language models (VLMs) often struggle with compositional reasoning tasks, but the reasons for this underperformance remain unclear. A common hyp...

By Mona Gandhi, Cenk Merih Olcay, Kuan-Chieh Lo, Santiago Castro, Christopher W. Myers, Srinivasan Parthasarathy
arXiv Computer Vision
Sep 28

GraphWrit3R: End-to-End 3D Scene Graph Writing

arXiv:2609.31595v1 Announce Type: new Abstract: 3D scene graphs provide a structured representation of complex environments by encoding objects, their semantic attributes, and the spatial and functio...

By Luka Milivojevic, Nikola Popovic, Sayan Deb Sarkar, Sebastian Koch, Iro Armeni, Luc Van Gool, Danda Pani Paudel
arXiv Computer Vision
Sep 28

PhoenixSR: Generative Heterogeneous Distillation Unleashes Efficient Models for Real-World Super-Resolution

arXiv:2609.30988v1 Announce Type: new Abstract: Real-world image super-resolution (SR) requires recovering perceptually realistic high-resolution images from complex low-resolution observations while...

By Xin Di, Mingyu Shi, Yuanfei Bao, Long Peng, Yue Zhao, Jiaming Guo, Renjing Pei, Xueyang Fu, Yang Cao, Zheng-Jun Zha
arXiv AI
Sep 28

Bridging LLM Agents and Data Spaces: An Architectural Mediation Approach using the Model Context Protocol

The paper introduces an architectural mediation approach that uses the Model Context Protocol (MCP) to bridge large language model (LLM) agents with data spaces. By implementing the Eunomia Agent, the mediation layer translates data space capabilities into structured, schema-driven tools that LLM agents can discover and invoke while respecting governance constraints. A prototype demonstrates end‑to‑end interaction across catalog discovery, metadata retrieval, and data service invocation without altering existing data space components, showing that protocol‑based mediation enables interoperable, standards‑aligned integration of AI agents into governed data‑sharing ecosystems.

By Jaime Alonso Ruiz, Carlos Aparicio, Gabriel Huecas, Joaqu\'in Salvach\'ua, Andres Munoz-Arcentales
arXiv AI
Sep 28

Stealth Apart, Harm Together: Skill Cascading Attacks on Skill-Based Agent Systems

The paper introduces skill cascading attacks, where a malicious goal is spread across multiple seemingly benign skills, causing harmful outcomes when combined. It presents SkillCascade, an automated red‑teaming framework, and releases SkillCascade‑Bench, a benchmark of 213 validated cascading test cases across various agent systems and domains. Experiments show that these cascaded interactions reliably induce harmful behaviors while evading existing per‑skill scanners and runtime monitors, revealing a gap between component‑level integrity and system‑level safety.

By Zihao Zhu, Siwei Lyu, Adel Bibi, Baoyuan Wu
arXiv AI
Sep 28

Do LLMs Understand Context? A Knowledge Graph-Based Evaluation Framework

The paper introduces a knowledge‑graph‑based evaluation framework, S3KG, to assess whether large language models truly understand context in question answering tasks. S3KG combines structural and semantic signals into a single similarity score and is paired with a diagnostic analysis that pinpoints reasoning errors at the triplet level. Across nine benchmarks, the method outperforms existing baselines, achieving up to +7.6 F1 points and an AUROC of 0.973.

By Subavarshana Arumugam, Mamta Nallaretnam, Kithuni Wickramasinghe, Chamath Gunapala, Pragatheeswaran Vipulanandan, Kamal Premaratne, Uthayasanker Thayasivam
arXiv AI
Sep 28

BioEVAL: A global, multi-institutional benchmark of large language and multimodal models for bioengineering

BioEVAL is a global, multi‑institutional benchmark that evaluates large language and multimodal models on experimental reasoning tasks in bioengineering. It comprises 608 items across 11 bioengineering subfields, including 359 vetted multiple‑choice questions, 218 literature synthesis tasks, and 10 multimodal image‑interpretation problems. The benchmark was used to assess models such as ChatGPT, Gemini, and Grok, revealing accuracies up to 90% on MCQs, a 0.72 similarity score on literature synthesis, and 80% accuracy on multimodal tasks, with notable variation across subfields.

By Shun Ye, Vinny Chandran Suja, Chenlong Li, Chongming Jiang, Reza Zamani, Xiang Li, Christopher Bain, Yuqi Zhou, Walker Peterson, Huidong Wang, Chenglang Hu, Jongchan Park, Xiao Cheng, Benjamin Swedlund, Sandra Murillo, Anjali Sivanandan, Shiyu Sun, Liang Lanfeng, Mohammad Tariqul Islam, Baju C. Joy, Ishaq N. Khan, Sreedhar S. Kumar, Gabriel Mercado-V\'asquez, James V. Vizzard, Jonathan M. Matthews, Helen Huang, Xiaolu Guo, Ethan Nicklow, Guorui Chen, Ryan A. Neff, Surjendu Maity, Hyeonjin Park, Han-ho Joo, Katherine Dong, Yuyan Cai, Weihang Huang, Yichen Zou, Rui Yan, Raphael Figueroa, Artem Goncharov, Bella Rose Schremmer, Lian Elsa Linton, Keisuke Goda, Liang Gao, Ke Cheng, Leonardo Morsut, Jennifer L. Wilson, Jianping Fu, Lim Chwee Teck, Deblina Sarkar, Andreas Hierlemann, Sava\c{s} Tay, Alexander Hoffmann, Donald Richieri Griffin, Jun Chen, Shana O. Kelley, Shyni Varghese, Jinwoo Cheon, Wilbur A. Lam, James J. Moon, Wilson W. Wong, Samir Mitragotri, Dino Di Carlo
arXiv AI
Sep 28

Thinking Less to Simulate Better: Intuitive Prompting Improves LLM Agents Simulating Individual Social Media Reactions, Including Unfamiliar Content

The study evaluates how well language‑model agents can simulate individual social media reactions by comparing predictions under different prompt conditions. Eight Serbian participants’ reactions to 68 posts were recorded, and four language models were asked to predict these reactions using prompts that varied in profile content and instruction style. The results show that prompts emphasizing attitudinal content and intuitive, immediate responses yield the highest fidelity, outperforming demographic backstories and a crowd baseline, and suggesting that such agents could act as general‑purpose simulated users.

By Ljubisa Bojic, Tijana Stanic, Joerg Matthes, Agariadne Dwinggo Samala, Bojana Dinic, Jue Wang
arXiv AI
Sep 28

Atelier: Learning Local Self-Supervised Features for CryoEM Volumes via Hypernetworks

Atelier is a self‑supervised framework that uses a transformer‑based hypernetwork to generate implicit neural representations (INRs) for cryo‑EM maps, enabling efficient, scale‑agnostic, coordinate‑conditioned feature extraction. Trained on 5,439 maps from the Electron Microscopy Data Bank, the pretrained INR provides continuous local feature fields that can be used as auxiliary channels for a 3D nested U‑Net, improving voxel‑level property prediction across eight tasks compared to a volume‑only baseline. The approach demonstrates that amortized INRs can serve as a geometry‑aware primitive for large‑scale cryo‑EM analysis.

By Phillip Lo, Sudarshan Babu, Dari Kimanius, Aly A. Khan
arXiv AI
Sep 28

HARDEN: Constrained Evolutionary Search for Harder, Answer-Preserving Evaluation Cases

HARDEN is a constrained evolutionary search method that transforms existing evaluation cases into more challenging variants while preserving their expected outputs. It operates along domain‑specific complexity axes and enforces feasibility constraints such as task semantics, realism, and execution validity. Experiments on FinQA, PubMedQA, and ContractNLI with Qwen3.5 models show that HARDEN can reduce task‑model accuracy by an average of 22.7% and up to 49.9% compared to single‑pass baselines.

By Aditya Kumaran, Rahul Singhal, Karime Maamari, Amine Mhedhbi, Pradyumna Tambwekar
arXiv AI
Sep 28

T-RoPE: Time-Aware Rotary Position Embedding for Sequential Recommendation

T‑RoPE introduces a time‑aware Rotary Position Embedding for sequential recommendation, replacing index‑only rotations with timestamp‑based angles, learnable temporal coefficients, multiscale frequency banks, shifted query alignment, and non‑stationary key rotation. The authors prove that standard RoPE is time‑translation invariant and cannot capture seasonal contexts, while T‑RoPE breaks this invariance while preserving the RoPE interface. Across five public benchmarks and an industrial‑scale e‑commerce dataset, T‑RoPE outperforms baselines by up to 130 % in HR@10 and delivers significant online lift in conversion and order count.

By Yang Liu, Noel Loo, Ali Khanafer, Shuying Sun, Akshay Soni, Zhong Wu, Linjun Yang
arXiv AI
Sep 28

The Price of Thought: Does Test-Time Reasoning Pay in LLM Trading?

The study investigates whether adding inference-time reasoning to large language models (LLMs) improves trading performance. Using a controlled experiment across DeepSeek, GPT, and Gemini models, the authors varied reasoning effort while keeping other variables constant and evaluated over a full year of U.S. equities under three input conditions. Results show that additional reasoning does not reliably increase net portfolio returns and can even lead to nonmonotonic performance and unstable outcomes.

By Jiayi Chen, Guiling Wang