arXiv Machine Learning

What Do Language Priors Contribute to Darcy-Flow Inversion? A Mechanistic Audit

arXiv:2606. 24967v1 Announce Type: new Abstract: In ill-posed inverse problems, the recovered solution depends as much on the prior as on the data, yet much of the engineering knowledge that could serve as that prior is recorded qualitatively rather than in formal mathematical form.

arXiv Machine Learning
Sep 21

Generative inversion for early ranking of competing geologic interpretations

The paper introduces a workflow that ranks competing geological interpretations by converting them into spatial priors and assessing their consistency with hydraulic‑head observations. Using a text‑to‑image model to generate 1600 geologic images per interpretation, a variational autoencoder encodes them, and a supervised inverse network maps head data into this latent space, producing log‑conductivity fields for flow simulation. The method is validated on a synthetic Johansen Formation benchmark and applied to two conceptual models of the Culebra Dolomite, yielding compatibility scores that align with independent evidence.

By Harun Ur Rashid, Daniel O'Malley
arXiv Machine Learning
1d ago

Autoregressive Drillhole Modelling Under Distribution Shift

Autoregressive modelling, successful in language tasks, is applied to mineral‑exploration drillholes where lithology is revealed sequentially from shallow to deep. The authors introduce DrillBench, a benchmark of 49,671 Western Australian drillholes for next‑layer prediction and autoregressive stratigraphic generation across a graded transfer spectrum. Experiments show that spatial conditioning helps locally but fails under strong shift, while autoregressive models transfer more robustly; a backbone‑agnostic recipe combining large‑scale pretraining and spatial retrieval improves generalisation, especially in distant geological splits.

By Yihao Ding, Daniel Yitian Su, Yiran Zhang, Christopher M. Gonzalez, Wei Liu
arXiv AI
Sep 10

A*-Thought-V2: Efficient Latent Reasoning via Geometric Dynamics of LLM

A*-Thought-V2 is a framework that models Chain-of-Thought reasoning as a geometric trajectory in a 3D PCA space, using explicit-implicit latent tokens to compress steps that deviate from the main question-to-solution direction. The method measures alignment angles to decide which steps remain text and which become latent, and introduces stepwise embedding forcing and label forcing to train the architecture. Experiments on Qwen models show up to 2.6% accuracy gains, halved response length, and significant reductions in computation and training time.

By Xiaoang Xu, Siyuan Liu, Shuo Wang, Junlan Feng, Fanyu Meng, Zhu Zhang, Jixun Wang, Xiaorong Wang, Zihan Zhou, Xin Li, Chaojun Xiao, Yiming Zhang, Huijia Wu, Liuyu Xiang, Peipei Li, Zhaofeng He
arXiv Machine Learning
Sep 10

LLM Layers Immediately Correct Each Other

arXiv:2609.07876v1 Announce Type: cross Abstract: Recent methods in language model interpretability employ techniques such as sparse autoencoders to decompose residual stream contributions into linea...

By Arjun Patrawala, Jiahai Feng, Erik Jones, Jacob Steinhardt