arXiv Machine Learning June 18, 2026 By Sanghyeok Choi, Henry Gouk, Esmeralda S. Whitammer

Structured Inference with Large Language Gibbs

Read the original on arXiv Machine Learning →

arXiv:2606. 19264v1 Announce Type: new Abstract: The knowledge encoded in large language models (LLMs) can serve as a substrate for structured reasoning over variables describing a complex world, but accessing this knowledge in a probabilistically coherent manner poses a difficult inference problem.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

llms

arXiv AI

Aug 3

AI4BayesCode: From Natural Language Descriptions to Validated Modular Stateful Bayesian Samplers

arXiv:2605. 18476v2 Announce Type: replace-cross Abstract: Coding and computation remain major bottlenecks in Markov chain Monte Carlo (MCMC) workflows, especially as modern sampling algorithms have become increasingly complex and existing probabilistic programming systems remain limited in model support, extensibility, and composability.

By Jungang Zou, Alex Ziyu Jiang, Qixuan Chen

llms agents benchmarks

arXiv AI

Jun 10

Using Probabilistic Programs to Train Inductive Reasoning in Large Language Models

arXiv:2606. 09856v1 Announce Type: cross Abstract: Post-training Large Language Models (LLMs) for reasoning typically focuses on deductive tasks such as mathematics and coding where correctness is verifiable.

By Liyi Zhang, Akshay K. Jagadish, Brenden M. Lake, Thomas L. Griffiths

llms agents fine-tuning benchmarks safety

arXiv Machine Learning

Jun 16

Simplifying the Modeling of Arbitrary Conditionals in Natural Language

arXiv:2606. 14943v1 Announce Type: cross Abstract: Causal Transformers model sequences through an autoregressive factorization of the joint distribution, which enables efficient left-to-right decoding and conditional likelihood computation.

By Yinhan Lu, Eric Elmoznino, L\'eo Gagnon, Sarthak Mittal, Tejas Kasetty, Guillaume Lajoie

llms fine-tuning

arXiv Machine Learning

Jul 28

Verbalized Particle Posterior: Bayesian Inference over Natural Language Hypotheses

arXiv:2607. 22961v1 Announce Type: new Abstract: Verbalized Machine Learning (VML) parameterizes a model as a natural-language prompt that an LLM evaluates as f(x; theta).

By Yan Zhang, Shikan Lian, Shibo Li

llms benchmarks

arXiv Machine Learning

Jun 2

d2: Improving Reasoning in Diffusion Language Models via Trajectory Likelihood Estimation

arXiv:2509. 21474v4 Announce Type: replace Abstract: While diffusion language models (DLMs) have achieved competitive performance in text generation, improving their reasoning ability with reinforcement learning remains an active research area.

By Guanghan Wang, Gilad Turok, Yair Schiff, Marianne Arriola, Volodymyr Kuleshov

llms diffusion reinforcement-learning benchmarks

arXiv AI

Jul 9

When Does In-Context Search Help? A Sampling-Complexity Theory of Reflection-Driven Reasoning

arXiv:2607. 06720v1 Announce Type: new Abstract: Training large language models (LLMs) with extended reasoning has enabled in-context search, in which models iteratively generate, critique, and revise solution attempts.

By Yotam Wolf, Noam Wies, Amnon Shashua

llms reinforcement-learning

Related stories

AI4BayesCode: From Natural Language Descriptions to Validated Modular Stateful Bayesian Samplers

Using Probabilistic Programs to Train Inductive Reasoning in Large Language Models

Simplifying the Modeling of Arbitrary Conditionals in Natural Language

Verbalized Particle Posterior: Bayesian Inference over Natural Language Hypotheses

d2: Improving Reasoning in Diffusion Language Models via Trajectory Likelihood Estimation

When Does In-Context Search Help? A Sampling-Complexity Theory of Reflection-Driven Reasoning