arXiv Machine Learning July 22, 2026 By Ye Qiao

A Better Start for Language Models: Domain-Conditional Position Offsets

Read the original on arXiv Machine Learning →

arXiv:2607. 18302v1 Announce Type: new Abstract: Autoregressive language models are least accurate at the beginning of a sequence, where little context forces reliance on a generic pretraining prior.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 9

InA-Probe: Instruction-Aware Active Probing for Time Series Forecasting with LLMs

arXiv:2606. 08601v1 Announce Type: new Abstract: Large Language Models (LLMs) have recently demonstrated impressive potential for time series forecasting.

By Peiliang Gong, Emadeldeen Eldele, Chenyu Liu, Ziyu Jia, Yi Ding, Xinliang Zhou, Lianchao Gu, Qi Zhu, Yang Liu, Daoqiang Zhang, Xiaoli Li

llms benchmarks safety

arXiv Machine Learning

Jun 11

Teaching Diffusion to Speculate Left-to-Right

arXiv:2606. 11552v1 Announce Type: cross Abstract: Large language models (LLMs) achieve remarkable performance across a wide range of tasks, but their autoregressive decoding process incurs substantial inference costs due to inherently sequential token generation.

By Lexington Whalen, Yuki Ito, Ryo Sakamoto

llms diffusion benchmarks safety

arXiv AI

Jun 9

CrossVLA: Cross-Paradigm Post-Training and Inference Optimization for Vision-Language-Action Models

arXiv:2605. 21854v2 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models have rapidly converged on a small set of architectural patterns: discrete-token autoregression (e.

By Zhi Liu

llms reinforcement-learning fine-tuning multimodal benchmarks safety

arXiv AI

Jun 11

Soft-Prompt Tuning for Fair and Efficient LLM Benchmark Evaluation

arXiv:2606. 12117v1 Announce Type: cross Abstract: Benchmark scores often misrepresent a large language model's (LLM's) knowledge, because they rely, e.

By Selen Erkan, Bastian Boll, Kristian Kersting, Bj\"orn Deiseroth, Letitia Parcalabescu

llms benchmarks

arXiv Machine Learning

Jun 2

Reconsidering Positional Supervision in Masked Diffusion Language Model Training

arXiv:2601. 22947v2 Announce Type: replace-cross Abstract: Masked diffusion language models (MDLMs) generate text by unmasking tokens in parallel and have recently emerged as alternatives to autoregressive language models.

By Mengyu Ye, Keito Kudo, Ryosuke Takahashi, Jun Suzuki

llms diffusion fine-tuning benchmarks safety

arXiv Machine Learning

Jun 8

TALAN: Task-Aligned Latent Adaptation Networks for Targeted Post-Training of Large Language Models

arXiv:2606. 06902v1 Announce Type: new Abstract: Targeted post-training aims to improve reasoning, math, and code without degrading strengths.

By Chengkai Zhang, Ziteng Liu, Junpu Wang, Zeyi Tao, Yang Wang, Sagar Chordia, Qin Huang

llms fine-tuning benchmarks

Related stories

InA-Probe: Instruction-Aware Active Probing for Time Series Forecasting with LLMs

Teaching Diffusion to Speculate Left-to-Right

CrossVLA: Cross-Paradigm Post-Training and Inference Optimization for Vision-Language-Action Models

Soft-Prompt Tuning for Fair and Efficient LLM Benchmark Evaluation

Reconsidering Positional Supervision in Masked Diffusion Language Model Training

TALAN: Task-Aligned Latent Adaptation Networks for Targeted Post-Training of Large Language Models