arXiv Machine Learning
Oct 9

Measuring Learned Monotone Temporal Aggregation at Matched Admissibility

The paper evaluates a recurrent network that learns monotone temporal aggregation for risk scoring, comparing it to hand‑crafted monotone aggregates used in deployed pipelines. Functional regression shows the learned channel can reproduce the geometrically weighted separable family of engineered statistics with Spearman ρ ≥ 0.996, while it struggles with consecutivity, time localization, and exposure floor, all of which can be fixed with an admissible basis. In practice, the learned aggregator matches or exceeds engineered counterparts in full‑sample scenarios, offers modest AUC gains in certain decay regions, and maintains performance where tree‑ensemble scores flatten.

By Yew Lee Tan
arXiv AI
Aug 21

Credit Without Ground Truth: Auditing Step-Level Credit Assignment in LLM Agents Against Executed Replay

arXiv:2608. 19760v1 Announce Type: cross Abstract: Audited against causal ground truth from executed replay in a single-agent tool environment (ALFWorld), none of the step-level credit signals used to train LLM agents -- LLM-judge scores, outcome-conditioned logprob ratios, or the policy's own confidence -- identifies which steps causally matter better than chance.

By Haiyue Zhang