Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

28,678 stories · RSS feed

arXiv Machine Learning

Oct 2

SE-ADD: Self-Evolving Audio Deepfake Detection with Mistake-Driven Supervision

arXiv:2609.39679v1 Announce Type: cross Abstract: Audio deepfake detection (ADD) must remain effective when new spoofing attacks emerge after deployment. Emerging audio language model (ALM)-based ADD...

By Rong Wan, Wei Xie, Jiaxi Li, Wenwu Wang, Lu Yin, Yiliao Song, Xilu Wang

llms fine-tuning

arXiv Machine Learning

Oct 2

PassGPT+: Leveraging Linguistic Priors for Password Modeling

arXiv:2609.39880v1 Announce Type: cross Abstract: Passwords remain the dominant online authentication mechanism, and understanding how humans choose them is essential for defensive strength estimatio...

By Rajneesh Anand, Neeraj Lakshmanan, Masoud Yari

llms diffusion nlp benchmarks

arXiv Machine Learning

Oct 2

HyDRA: A Hybrid Dual-Mode Network for Closed- and Open-Set RFFI with Optimized VMD

arXiv:2507.12133v2 Announce Type: replace Abstract: Device recognition is vital for security in wireless communication systems, particularly for applications like access control. Radio Frequency Fing...

By Hanwen Liu, Yuhe Huang, Yifeng Gong, Yanjie Zhai, Jiaxuan Lu

llms efficiency benchmarks

arXiv Machine Learning

Oct 2

Contrastive Representation Shaping for LLM Unlearning

arXiv:2601.22028v2 Announce Type: replace Abstract: Most LLM unlearning methods aim to approximate retrain-from-scratch behaviors with minimal distribution shift, often via alignment-style objectives...

By Haoran Tang, Rajiv Khanna

llms rag benchmarks safety

arXiv Machine Learning

Oct 2

MatGPTQ: Efficient and Accurate Inference over Nested Quantized Models

arXiv:2602.03537v2 Announce Type: replace Abstract: Matryoshka Quantization (MatQuant), Any-Precision-LLM (AP) and AnyBCQ (AB) are recent quantization approaches showing that a single integer-quantiz...

By Maximilian Kleinegger, Elvir Crn\v{c}evi\'c, Dan Alistarh

llms efficiency benchmarks

arXiv Machine Learning

Oct 2

Less Data Approximates More: Earning Faithful Confidence in High-Stakes Domains

arXiv:2604.08454v2 Announce Type: replace Abstract: Large language models are increasingly deployed in high-stakes domains, where confident yet incorrect inferences may cause severe real-world harm,...

By Haokai Ma, Lee Yan Zhen, Gang Yang, Yunxiang Chen, Yunshan Ma, Tat-Seng Chua, Ee-Chien Chang

llms reinforcement-learning efficiency benchmarks

arXiv Machine Learning

Oct 2

Measuring Structure in Graph Benchmark Datasets Using Graph Invariants

arXiv:2605.06462v2 Announce Type: replace Abstract: Progress in graph learning is hindered by benchmark practices that conflate the contributions of node features and graph structure, making it hard...

By Richard von Moos, Mathieu Alain, Bastian Rieck

llms benchmarks

arXiv Machine Learning

Oct 2

Prototype Guided Post-pretraining for Single-Cell Representation Learning

arXiv:2605.07938v2 Announce Type: replace Abstract: Single-cell representation learning (SCRL) from gene expression data offers a way to uncover the complex regulatory logic underlying cellular funct...

By Sachini Weerasekara, Natasha Darras, Sagar Kamarthi, Colles Price, Jacqueline Isaacs

llms rag fine-tuning

arXiv Machine Learning

Oct 2

VIP-COP: Context Optimization for Tabular Foundation Models

arXiv:2605.12904v2 Announce Type: replace Abstract: Tabular foundation models (TFMs) have emerged as a powerful paradigm for in-context learning on structured data, enabling direct prediction on new...

By Yilong Chen, Xueying Ding, Leman Akoglu

llms efficiency

arXiv Machine Learning

Oct 2

Preference Instability in Reward Models: Detection and Mitigation via Sparse Autoencoders

arXiv:2605.16339v2 Announce Type: replace Abstract: Preference learning in large language models relies on reward models as proxies for human judgment. However, these models frequently exhibit prefer...

By Shunchang Liu, Xin Chen, Belen Martin Urcelay, Francesco Croce

llms diffusion reinforcement-learning benchmarks safety

arXiv Machine Learning

Oct 2

Learning to Select Source-Traceable Evidence for Language-Model Prediction from Irregular Clinical Time Series

arXiv:2605.20292v2 Announce Type: replace Abstract: Numerical time-series models effectively process irregular electronic health record (EHR) trajectories, but do not expose which temporal patterns s...

By Kwanhyung Lee, Juhwan Choi, Jongheon Kim, Joohyung Lee, Hyeongwon Jang, Jeonguk Lee, Jisoo Jung, Eunho Yang

llms benchmarks

arXiv Machine Learning

Oct 2

$\textit{BlockFormer}$ : Transformer-based inference from genomic contact maps

arXiv:2605.21617v3 Announce Type: replace Abstract: Locating genomic features from genomic contact maps, such as centromere identification from genome-wide chromosome conformation capture techniques,...

By Elo\"ise Touron, Pedro L. C. Rodrigues, Julyan Arbel, Nelle Varoquaux, Michael Arbel

llms safety

arXiv Machine Learning

Oct 2

One QK Channel, Many Sources: Tracing Low-Precision Attention Collapse

arXiv:2608.02091v2 Announce Type: replace Abstract: A bfloat16 transformer can train normally, then collapse abruptly. Prior work links collapse to structured attention errors and shows QK normalizat...

By Shuxiao Xie, Shuyang Xie, Yuan Cao, Dezhi Ran, Wei Yang, Tao Xie

llms

arXiv Machine Learning

Oct 2

Steer-to-Detect: Probing Hidden Representations for Detection of LLM-Generated Texts

arXiv:2605.12890v2 Announce Type: replace-cross Abstract: The rapid advancement of large language models (LLMs) has made machine-generated text increasingly difficult to distinguish from human-writte...

By Luxu Liang, Xiang Li

llms safety

arXiv Machine Learning

Oct 2

GeoFP8: Geometry-Aware FP8 Gradient Compression for Distributed LLM Training

arXiv:2607.07494v2 Announce Type: replace-cross Abstract: Gradient communication is a primary scaling bottleneck in large language model (LLM) pretraining. Communicating gradients in low-precision fo...

By Jieying Wang, Zizhong Wang, Fangru Linghu, Shuyuan Fan, Jiajia Li, Zhao Zhang

llms efficiency

arXiv Computer Vision

Oct 2

Query Independent Variable Rate Visual Token Coding

arXiv:2610.00204v1 Announce Type: new Abstract: Visual-token compression for vision--language models is posed almost entirely as a selection problem: decide which tokens to keep and discard the rest....

By Hongbo Zhang, Zihao Yang, Liuyang Song, Daqian Yang, Haoyang Yao, Yan Wen, Zhengtao Yao

llms efficiency benchmarks

arXiv Computer Vision

Oct 2

Memorizon: Training World Models Beyond Their Context Window

arXiv:2610.00544v1 Announce Type: new Abstract: Streaming world models should render a place consistently across repeated visits. Directly supervising such revisits requires training samples that cap...

By Tingting Liao, Xuezhi Liang, Hao Li, Guangyi Liu

llms

arXiv Computer Vision

Oct 2

FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answering

arXiv:2610.00573v1 Announce Type: new Abstract: Query-aware keyframe selection enables multimodal large language models (MLLMs) to process long videos using only a small set of question-relevant fram...

By Haifeng Huang, Biyin Xu, Chunsheng Xin, Yang Li

llms nlp multimodal benchmarks

arXiv Computer Vision

Oct 2

Paying for Too Many Tokens? Valid and Cost-Efficient Multimodal LLM Annotation with Simple Heuristics

arXiv:2610.00809v1 Announce Type: new Abstract: Vision-Language Models (VLMs) enable video annotation at scale, but costs accumulate quickly: processing a typical 60-second short-form video at one fr...

By Zhixi Zhu, Kristina Gligoric

llms multimodal

arXiv Computer Vision

Oct 2

Machine Translation for Sign Languages

arXiv:2610.00881v1 Announce Type: new Abstract: Sign language machine translation has progressed substantially over the past decade, evolving from isolated sign recognition to end-to-end translation...

By Ozge Mercanoglu Sincan, Anton Pelykh, Edward Fish, Harry Walsh, JianHe Low, Karahan Sahin, Oline Ranum, Sobhan Asasi, Steven Emery, Richard Bowden

llms computer-vision nlp

Get the daily briefing