arXiv Machine Learning October 23, 2026 By Junmo Cho, Suhan Kim, Sangjune An, Minsu Kim, Dong Bok Lee, Heejun Lee, Sung Ju Hwang, Hae Beom Lee

GFlowPO: Generative Flow Network as a Language Model Prompt Optimizer

Read the original on arXiv Machine Learning →

GFlowPO introduces a probabilistic framework for optimizing language model prompts by treating prompt search as posterior inference over latent prompts, regularized by a meta-prompted reference-LM prior. The method first fine‑tunes a lightweight prompt‑LM using an off‑policy Generative Flow Network objective that reuses past prompt evaluations for sample‑efficient exploration. It then applies a training‑free Dynamic Memory Update to refine the meta‑prompt with diverse and top‑performing prompts, leading to consistent improvements over recent discrete prompt optimization baselines on few‑shot classification, instruction induction, and question‑answering tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Aug 3

TAPR: Enhancing LLM Performance with a Task-Aware Prompt Rewriter

arXiv:2607. 28657v1 Announce Type: new Abstract: Large Language Models (LLMs) often require carefully crafted prompts to unlock their full potential, which can be a barrier for non-expert users.

By Oliver Savolainen, Emanuele Bastianelli, Hosein Azarbonyad

llms nlp reinforcement-learning fine-tuning benchmarks

arXiv Machine Learning

Aug 31

Meta-Prompt Optimization for LLM-Based Sequential Decision Making

The paper introduces EXPO, an algorithm that automatically optimizes the meta-prompt—specifically the task description and meta-instruction—for large language model agents in sequential decision-making tasks such as Bayesian optimization and multi-armed bandits. Building on adversarial bandit techniques to handle non-stationary rewards, the authors extend EXPO to EXPO-ES, which also optimizes exemplars (historical interactions) within the meta-prompt. Experiments demonstrate that these methods significantly improve the performance of LLM-based agents in sequential decision-making scenarios.

By Mingze Kong, Zhiyong Wang, Yao Shu, Zhongxiang Dai

llms agents reinforcement-learning safety

arXiv Computation and Language

Oct 15

ForkGRPO: Efficient Exploration and Fine-Grained Credit Assignment for Diffusion Language Models

arXiv:2610.19408v1 Announce Type: new Abstract: Diffusion large language models (dLLMs) have advanced rapidly, yet strengthening their reasoning through reinforcement learning (RL) remains an open ch...

By Zhaoyan Jia, Chengwei Zhou, Gourav Datta, Massoud Pedram

llms diffusion reinforcement-learning benchmarks

arXiv Computation and Language

Oct 1

AdaGEPA: Adaptive Feedback Allocation for Reflective Prompt Optimization

arXiv:2609.39927v1 Announce Type: new Abstract: Prompt optimization improves the performance of language-model systems on downstream tasks by refining their prompts. Classical methods evaluate prompt...

By Junyang Chen, Zecheng Wang, Jingbang Chen

benchmarks

arXiv AI

Jul 13

Prompt-Driven Exploration

arXiv:2607. 08837v1 Announce Type: cross Abstract: Exploration is essential to RL since a policy cannot improve by repeatedly sampling the behaviors it already prefers.

By Sunshine Jiang, John Marangola, David Zhang, Raghuram Kowdeed, Ruiyang Luo, Nitish Dashora, Richard Li, Pulkit Agrawal, Zhang-Wei Hong

llms reinforcement-learning robotics multimodal

arXiv AI

Jul 14

Nested-ReFT: Efficient Reinforcement Learning for Large Language Model Fine-Tuning via Off-Policy Rollouts

arXiv:2508. 10123v3 Announce Type: replace-cross Abstract: Advanced reasoning in LLMs on challenging domains like mathematical reasoning can be tackled using verifiable rewards based reinforced fine-tuning (ReFT).

By Maxime Heuillet, Yufei Cui, Boxing Chen, Audrey Durand, Prasanna Parthasarathi

llms reinforcement-learning fine-tuning benchmarks safety

One email a morning, machine-written

Related stories

TAPR: Enhancing LLM Performance with a Task-Aware Prompt Rewriter

Meta-Prompt Optimization for LLM-Based Sequential Decision Making

ForkGRPO: Efficient Exploration and Fine-Grained Credit Assignment for Diffusion Language Models

AdaGEPA: Adaptive Feedback Allocation for Reflective Prompt Optimization

Prompt-Driven Exploration

Nested-ReFT: Efficient Reinforcement Learning for Large Language Model Fine-Tuning via Off-Policy Rollouts