arXiv Machine Learning
Amortizing intractable inference in large language models
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Jun 16
Latent Thought Flow: Efficient Latent Reasoning in Large Language Models
arXiv:2606. 16222v1 Announce Type: new Abstract: Large Language Models (LLMs) increasingly rely on intermediate reasoning, yet explicit Chain-of-Thought (CoT) suffers from a linguistic space bottleneck: each thought must be decoded into tokens, causing high inference overhead.
arXiv Machine Learning
3d ago
Delta-AI: Local objectives for amortized inference in sparse graphical models
arXiv:2310.02423v3 Announce Type: replace Abstract: We present a new algorithm for amortized inference in sparse probabilistic graphical models (PGMs), which we call $\Delta$-amortized inference ($\D...
arXiv Machine Learning
Jun 18
Structured Inference with Large Language Gibbs
arXiv:2606. 19264v1 Announce Type: new Abstract: The knowledge encoded in large language models (LLMs) can serve as a substrate for structured reasoning over variables describing a complex world, but accessing this knowledge in a probabilistically coherent manner poses a difficult inference problem.
arXiv AI
Jun 15
Deep Dense Exploration for LLM Reinforcement Learning via Pivot-Driven Resampling
arXiv:2602. 14169v2 Announce Type: replace-cross Abstract: Effective exploration is a key challenge in reinforcement learning for large language models: discovering high-quality trajectories within a limited sampling budget from the vast natural language sequence space.
arXiv AI
Jun 15
LEPO: Latent Reasoning Policy Optimization for Large Language Models
arXiv:2604. 17892v4 Announce Type: replace-cross Abstract: Recently, latent reasoning has been introduced into large language models (LLMs) to leverage rich information within a continuous space.
arXiv AI
Jun 19
Manifold Bandits: Bayesian Curriculum Learning over the Latent Geometry of Large Language Models
arXiv:2606. 19750v1 Announce Type: cross Abstract: Reinforcement learning (RL) is a central approach for improving reasoning capabilities in large language models (LLMs), where training efficiency depends critically on how problems are sampled during optimization.