arXiv Statistics ML
Temporal-Difference Calibration of Black-Box Simulators
Read the original on arXiv Statistics ML →The Flow has not summarised this story yet — read it at arXiv Statistics ML.
Related stories
Hugging Face Trending Papers
Oct 26
Temporal-Difference Calibration of Black-Box Simulators
We develop a derivative-free temporal-difference (TD) framework for calibrating black-box simulators using one-step transitions from a target system and noisy simulator-generated continuation values....
arXiv AI
Jun 16
MA-SBI: Misspecification-Aware Simulation-Based Inference via Side-Channel Guidance
arXiv:2606. 16923v1 Announce Type: new Abstract: Simulation-based inference (SBI) of latent parameters is often hindered by simulator misspecification, the mismatch between simulated and real-world observations caused by inherent modeling simplifications.
arXiv Machine Learning
Aug 12
Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling
arXiv:2608. 10896v1 Announce Type: cross Abstract: Constant-stepsize temporal-difference (TD) learning is attractive for policy evaluation, but inference from a single Markov trajectory must account for serial dependence and a stepsize-dependent stationary target.
arXiv AI
Oct 19
OSCC: Certified Observation-Safe Coupling Optimization for Gradient-Noise Control in Imperfect-Information Learning
arXiv:2609.33543v2 Announce Type: replace Abstract: Coupled rollouts can reduce the noise of counterfactual action comparisons, but two issues prevent standard common-random-number constructions from...
arXiv AI
Oct 19
Exploration and Experimentation with a Misspecified Simulator
The paper investigates how to collect data for recalibrating a misspecified simulator that models a partially observed real-world system as a fully observed Markovian process. It compares four data‑collection strategies: never recalibrating, passive on‑policy recalibration, continuous exploration across all units, and randomized experimentation on a sample of units. Theoretical analysis and a vending‑machine simulation show that experimentation can outperform passive adaptation when drift is invisible to on‑policy data or when recalibration lags behind ongoing drift, while exploration is preferable when trying worse actions is costly and dynamics may not have changed.
arXiv AI
Jun 17
Kolmogorov Regression for Robust Diffusion Policies
arXiv:2606. 18186v1 Announce Type: cross Abstract: Finite-dimensional (FD) diffusion policies exhibit temporal drift owing to discretization artifacts that degrade long-horizon performance (when deployed on physical systems).