Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

31,598 stories · RSS feed

Hugging Face Trending Papers
Sep 17

SETTer: Sparse-Encoder Transformer for Long-term Multivariate Time Series Forecasting

SETTer is a transformer-based model designed for long‑term multivariate time‑series forecasting. It introduces decoupled self‑attention and hybrid masking to better capture short‑ and long‑term patterns across time and channel dimensions, while adding simple explainable structures to highlight discriminative patterns. Experiments on real‑world benchmarks show that a single‑layer SETTer outperforms state‑of‑the‑art models in 88% of scenarios.

Hugging Face Trending Papers
Sep 17

Before the Arrest: Benchmarking LLMs on Criminal Profiling from Incomplete Evidence

The paper introduces the Profiling, Investigation, and Judgment (PIJ) benchmark, which contains 2,500 real homicide cases from five countries to evaluate large language models (LLMs) on pre‑arrest criminal investigation tasks. It assesses LLMs across criminal profiling, crime process reconstruction, and sentence prediction, revealing that performance drops as tasks require more implicit reasoning about unknown suspect profiles. The study finds that LLMs lag behind human experts, especially in inferential categories like motivation and victim‑offender relationships, and exhibit biases in gender, age, and motive attribution.

Hugging Face Trending Papers
Sep 17

MaSCoD: A Multi-Agent Framework for Structural-Context-Guided Candidate Causal Graph Generation

MaSCoD is a multi‑agent framework that explicitly addresses the premature omission of causal relations by first organizing candidate third variables and local structural patterns before making direct‑edge judgments. Using GPT‑5.4 and GPT‑4o as backbones, the study evaluates MaSCoD on Auto‑MPG, DWD, and Sachs datasets, finding that the Full phase—where structural hypotheses are supplied early—generally improves recall and F1 scores compared to a No Phase 1 approach, though it can also raise false‑positive rates. Ablation experiments reveal that providing both structural and contextual information does not always outperform providing only one, and that the benefits of the Full phase vary across datasets and backbones. whyItMatters":"The paper demonstrates that explicitly pre‑organizing structural context can improve causal graph generation performance, highlighting the importance of designing omission control mechanisms in causal discovery with large language models."

Hugging Face Trending Papers
Sep 17

VākQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answering

VākQA is a newly introduced benchmark for Telugu spoken factoid question answering, comprising 2,001 question‑answer pairs across six domains, 2.53 hours of speech audio, bilingual transcriptions, and human‑verified reference answers. The study validates automatic evaluation methods against human judgments, finding that Gemini‑as‑a‑judge best approximates human ratings but is inconsistently strict, while open‑weight judges tend to penalize correct Telugu answers that differ in surface form. Using this validated setup, the authors benchmark proprietary and open‑weight models, highlighting challenges such as cultural specificity loss in translation, phonetic confusions from speech input, and compounded errors from cascaded ASR‑MT pipelines.

Hugging Face Trending Papers
Sep 17

A Dual-Process Perspective on Nudge Susceptibility in LLM-Based GUI Agents

The paper examines how large language model (LLM) based graphical user interface (GUI) agents respond to digital nudges. Using a randomized online shopping experiment with 3,600 agents across six frontier models, it finds that agents are vulnerable to both automatic and reflective nudges. The study shows that the agents’ reasoning configuration moderates these effects in opposite directions—reducing susceptibility to automatic nudges while increasing it to reflective social influence nudges—and that this redirection is systematically linked to model scale.

Hugging Face Trending Papers
Sep 17

SnapPhysics: A Physics-Aware Scene Graph from a Single View for Interactive Mixed Reality Scenes

SnapPhysics is a training‑free framework that reconstructs 3D objects and estimates their physical properties—such as mass, friction, and center of gravity—from a single image. It combines instance‑level 3D reconstruction with a physics‑aware scene graph that encodes inter‑object relationships, providing structured context for vision‑language model reasoning. Experiments on 3D‑FRONT and real captured scenes show significant improvements over prior methods, reducing errors in mass estimation and enhancing scene‑level F‑Score.

Hugging Face Trending Papers
Sep 17

Dictionary-Constrained Grapheme-to-Phoneme for Unsegmented Languages from LLM-Annotated Data

The paper introduces a context‑aware neural grapheme‑to‑phoneme (G2P) system for unsegmented languages like Japanese, combining a discriminative conditional random field over a dictionary‑based word lattice with large language model‑generated training data. By generating over two million synthetic sentences, the method addresses data scarcity and achieves superior performance compared to traditional morphological analyzers and neural sequence models. On the Joyo‑Kanji‑Yomi benchmark, it attains 99.62% target word reading accuracy, 0.32% target word phoneme error rate, and 0.14% sentence phoneme error rate.

Hugging Face Trending Papers
Sep 17

DeliveryGym: An RL Environment for Long-Horizon Embodied Agent Planning with Adaptive Curriculum

DeliveryGym is a 3D reinforcement learning environment that simulates continuous courier shifts, integrating multimodal tool interaction and persistent world dynamics to compute trajectory rewards based on simulator events. It provides feedback on resource consumption—time, energy, and money—across entire delivery trajectories, enabling agents to learn planning that balances immediate task success with long‑term constraints. The environment also adapts future training shifts to a policy’s weaknesses while keeping evaluation fixed, demonstrating that both learning from complete shifts and targeted training improve agent performance on complex delivery tasks.

Hugging Face Trending Papers
Sep 17

Rethinking Multi-Agent Collaboration: When More Is Less

The paper examines when multi‑agent collaboration is truly beneficial as large language models grow more capable. It finds that multi‑agent systems yield systematic advantages mainly for long‑horizon tasks with sparse dependencies, while single‑agent approaches excel in tightly coupled, sequential workflows. The authors introduce SAIGE, a lightweight, graph‑based collaboration framework that balances context efficiency and performance, demonstrating that adding more agents or deeper recursion does not always improve outcomes.

Hugging Face Trending Papers
Sep 17

SoK: Trading Agents or Market Crashers? Dissecting Robustness and Security Failures in Academic Financial LLM Trading Schemes

The paper "SoK: Trading Agents or Market Crashers? Dissecting Robustness and Security Failures in Academic Financial LLM Trading Schemes" introduces FARSIGHT, a framework that evaluates financial LLM agents on robustness to market turbulence and security against three attack types. Applying FARSIGHT to 15 academic schemes reveals that 80% fail at least one robustness metric and all exhibit security vulnerabilities, highlighting the risk that a single compromised agent can trigger market-wide crashes.

Hugging Face Trending Papers
Sep 17

MiX: Micro-Inverted-Scaling for End-to-End Low-Bit Vision-Language Model Acceleration

MiX: Micro-Inverted-Scaling for End-to-End Low-Bit Vision-Language Model Acceleration proposes a new quantization format that inverts the traditional microscaling approach by assigning private exponents to each element and a shared mantissa. The adaptive dual-format MiX-MX inference framework maps this format to a custom accelerator, replacing multipliers with shifters. Evaluations show that 4.5-bit MiX matches or surpasses NVFP4 accuracy on multimodal benchmarks while improving area efficiency by 25% and delivering 2.3–4.5× speedup with 1.4–2.9× energy reduction compared to the Focus accelerator.

arXiv Machine Learning
Sep 17

The evolution of sex for artificial intelligence: a population-genetic framework for multigenerational model populations

The paper draws a parallel between AI model development and population genetics, treating successive model generations as analogous to sexual and asexual reproduction. It demonstrates that training models on peers’ outputs reproduces classic genetic processes such as the Wright–Fisher model, while combining parents’ weights can either cancel or preserve inherited advantages depending on the method. Experiments across recurrent, feedforward, and language models confirm these analogies and reveal architecture‑specific biases, including the Fisher‑Muller effect and reproductive isolation when lineages learn conflicting conventions.

By Giorgio F. Gilestro
arXiv Machine Learning
Sep 17

CompileRover: Revolutionizing Virtual Machine Compiler Optimization with a Tri-Role LLM-Driven Framework

CompileRover is a new optimization framework for virtual machine compilers that uses a tri‑role LLM‑driven collaboration mechanism involving a referee, an advisor, and an operator. It tackles common issues such as redundant computations, inefficient loops, and suboptimal function implementations by applying control‑flow analysis, code‑structure transformations, and dynamic execution pattern recognition. Benchmark evaluations show that CompileRover consistently outperforms existing virtual machine compilers, reducing execution overhead, improving data‑flow consistency, and enhancing overall compiler performance.

By Mingqiao Mo, Yunlong Tan, Hao Zhang
arXiv AI
Sep 17

The Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Models

The paper examines the role of schema linking in Text-to-SQL systems and finds that recent large language models can effectively use relevant schema elements even when many irrelevant ones are present. Consequently, the authors eliminate schema linking when the entire schema fits within the model’s context window, instead employing augmentation, selection, and correction techniques to enhance accuracy. Their approach achieves first place on the BIRD benchmark with a 71.83% accuracy.

By Karime Maamari, Fadhil Abubaker, Daniel Jaroslawicz, Amine Mhedhbi
arXiv AI
Sep 17

QiT: Quantum-Inspired Transformer for Visual Recognition Task

QiT is a Quantum‑Inspired Transformer designed for visual recognition tasks. It replaces quantum neural network concepts with scalable classical operations: angle‑inspired encoding of image tokens, self‑attention over periodic features approximating quantum fidelity kernels, and gated multiplicative emulation of variational circuit interactions. The model achieves competitive performance on image‑classification benchmarks, matching a classical Transformer while avoiding the high runtime costs of simulated quantum models.

By Badri N. Patro, Vijay Agneeswaran
arXiv AI
Sep 17

A Lightweight CNN Integrated Compact Convolutional Transformer for Multi-Scale Feature Learning and reducing computational complexity for breast cancer mammography image detection and classification

The paper presents a lightweight CNN‑integrated Compact Convolutional Transformer (CCT) designed for multi‑scale feature learning in breast cancer mammography. With only 250,435 parameters, the model achieved 99‑100% accuracy across three datasets using 5‑fold cross‑validation, demonstrating robust generalization. Explainable AI components were added to clarify the classification process, aiming to increase clinical trust in resource‑constrained settings.

By Md Taimur Ahad (Department of Management North South University, Dhaka, Bangladesh), Ainuddin Ahmed (Department of Management North South University, Dhaka, Bangladesh)
arXiv AI
Sep 17

${M}^2$Tok: Multi-head Multi-codebook Discrete Action Tokenization for Vision-Language-Action Models

The paper introduces ${M}^2$Tok, a Multi-head Multi-codebook Action Tokenizer that reduces reconstruction loss in discrete action tokenization for Vision‑Language‑Action models. By decomposing latent action features into multiple heads and assigning independent codebooks to each, the tokenizer expands representational expressivity and improves policy performance. Experiments on RoboTwin, Simpler‑Env, and zero‑shot real‑world tasks show superior reconstruction fidelity and higher success rates compared to prior methods.

By Chunpu Xu, Zhixuan Liang, Yuhao Zhang, Chi-Min Chan, Jessie Wang, Yang Xiao, Mengkang Hu, Xiaokang Yang, Yao Mu
arXiv AI
Sep 17

Objective vs. Search: Decomposing What Makes a Good Tokeniser

The paper introduces two new tokenisation algorithms—BottomUpLL and TopDownComp—to systematically explore the 2x2 design space defined by optimisation objective (compression vs. log‑likelihood) and search procedure (bottom‑up merging vs. top‑down pruning). Experiments across model sizes, vocabularies, and domains show that the search procedure, rather than the objective, consistently yields lower bits‑per‑byte, while no clear pattern emerges on the BLiMP benchmark. These findings clarify how tokeniser design choices influence language‑model performance and provide guidance for constructing tokenisers more principledly.

By Ahmetcan Yavuz, Clara Meister, Tiago Pimentel