arXiv AI
OSCC: Certified Observation-Safe Coupling Optimization for Gradient-Noise Control in Imperfect-Information Learning
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jun 29
PAC-Bayesian Certificates for Quadratic Closed-Loop Control
arXiv:2606. 28281v1 Announce Type: cross Abstract: PAC-Bayesian bounds provide finite-sample guarantees for data-dependent randomized predictors, but applying them to learning-based control is difficult because the natural objective is a quadratic trajectory cost.
arXiv Machine Learning
Sep 25
Intrinsic-Extrinsic Coupling in Learning Dynamics
The paper introduces a framework for intrinsic‑extrinsic coupling in learning dynamics, defining it via a continuation‑conditioned value of a constrained learning‑state intervention and observation‑relative fibers. It presents an executable finite‑frame classifier‑head that protects current logits while repairing historical margins, and distinguishes local admissibility, intervention value, and complete‑policy performance. Experiments on CLINC‑derived class‑incremental tasks, output distillation with RoBERTa, and SGDW dynamics demonstrate that coupling can produce both positive and negative interactions, and that coordinated content controls can match or exceed development gains while guided allocation reduces cross‑entropy loss compared to standard replay.
Hugging Face Trending Papers
Sep 24
Intrinsic-Extrinsic Coupling in Learning Dynamics
The paper introduces a framework for intrinsic‑extrinsic coupling in learning dynamics, where a learner’s current observations do not solely dictate its future training responses. It formalizes this coupling through a continuation‑conditioned value of a constrained learning‑state intervention and employs an executable finite‑frame classifier‑head to protect current logits while adjusting historical margins. Experiments across CLINC‑derived class‑incremental settings, output distillation with RoBERTa, and SGDW dynamics reveal that coupling can produce both positive and negative interactions, and that coordinated interventions can match or exceed development gains while reducing cross‑entropy loss compared to standard replay.
arXiv AI
Jun 16
MA-SBI: Misspecification-Aware Simulation-Based Inference via Side-Channel Guidance
arXiv:2606. 16923v1 Announce Type: new Abstract: Simulation-based inference (SBI) of latent parameters is often hindered by simulator misspecification, the mismatch between simulated and real-world observations caused by inherent modeling simplifications.
arXiv AI
Oct 9
Trust Region Q Adjoint Matching
The paper introduces Trust Region Q Adjoint Matching (TRQAM), an off‑policy fine‑tuning algorithm that stabilizes reinforcement learning of pretrained flow policies by adaptively controlling the path‑space KL divergence between the fine‑tuned and pretrained policies. TRQAM achieves this through projected dual descent, which adjusts a trust‑region parameter λ during sampling and ensures the KL penalty is exactly weighted in the stochastic optimal control objective. Experiments on 50 OGBench tasks show TRQAM consistently outperforms prior methods, achieving a 68% success rate in offline RL versus 46% for the strongest baseline.
arXiv Machine Learning
Oct 8
COPC: Coupled Off-Policy Correction for Asynchronous LLM Reinforcement Learning
The paper introduces COPC, a Coupled Off-Policy Correction method for asynchronous reinforcement learning of large language models. COPC coordinates policy-side and advantage-side corrections by combining token-level ratio masking with two-sided clipped-ratio weighting of TD residuals, addressing both policy mismatch and advantage staleness. Experiments show COPC outperforms existing asynchronous baselines on tool-integrated mathematical reasoning and search tasks, while maintaining training stability and minimal overhead.