arXiv AI

Complementary Feature Domains: Information Preservation Does Not Imply Predictive-Contribution Preservation

arXiv Machine Learning
Oct 9

Refinement as a Service: Algorithmic Predictor Refinement

The paper investigates how to combine multiple calibrated predictors into a single refined predictor that preserves all available information and cannot be further refined. It models calibrated predictors as signaling schemes and defines refinement via feature‑independent garblings, showing that a new predictor is constructible exactly when its signal vector lies in the linear span of the input signal vectors. The authors provide algorithmic results: deterministic refinement is polynomial‑time solvable for two predictors but NP‑hard for many, while randomized refinement admits a polynomial‑time algorithm for any number of inputs by decomposing signal vectors into extreme rays of a polyhedral cone.

By Wei Tang, Hanrui Zhang
arXiv Machine Learning
Jun 30

Decision-Value Attribution in Predict-then-Optimize Systems

arXiv:2606. 29878v1 Announce Type: new Abstract: Predictive models are increasingly embedded in operational decision-making, yet standard explanation methods typically explain forecasts rather than the decisions those forecasts induce.

By Konstantinos Ziliaskopoulos, Alexander Vinel, Alice E. Smith
arXiv Machine Learning
Oct 8

An Informational Curse of Horizon in Goal-Conditioned Policy Learning

The paper identifies an informational curse of horizon in goal-conditioned policy learning, showing that longer goal relabeling horizons during training can hurt policy generalization and performance. Controlled experiments with oracle planners separate training horizons from test horizons, revealing that behavioral cloning policies degrade with longer horizons while reinforcement learning mitigates this effect. The authors attribute this to reduced conditional mutual information between actions and hindsight-relabeled goals, and demonstrate that distilling short-horizon policy Jacobians into long-horizon policies improves performance, especially in combinatorial manipulation tasks.

By John L. Zhou, Yuxuan Dong, Jonathan C. Kao
arXiv Machine Learning
Jun 9

Disentangled Feature Importance

arXiv:2507. 00260v3 Announce Type: replace-cross Abstract: When predictors are statistically dependent, the appropriate definition of feature importance depends on the operational goal.

By Jin-Hong Du, Kathryn Roeder, Larry Wasserman
Hugging Face Trending Papers
Jun 29

Decision-Value Attribution in Predict-then-Optimize Systems

Predictive models are increasingly embedded in operational decision-making, yet standard explanation methods typically explain forecasts rather than the decisions those forecasts induce. This distinction is important in predict-then-optimize systems: large forecast changes may leave the optimizer's action unchanged, while small changes can alter the selected decision and its realized value.