arXiv Machine Learning

Measuring Learned Monotone Temporal Aggregation at Matched Admissibility

The paper evaluates a recurrent network that learns monotone temporal aggregation for risk scoring, comparing it to hand‑crafted monotone aggregates used in deployed pipelines. Functional regression shows the learned channel can reproduce the geometrically weighted separable family of engineered statistics with Spearman ρ ≥ 0.996, while it struggles with consecutivity, time localization, and exposure floor, all of which can be fixed with an admissible basis. In practice, the learned aggregator matches or exceeds engineered counterparts in full‑sample scenarios, offers modest AUC gains in certain decay regions, and maintains performance where tree‑ensemble scores flatten.

arXiv Computer Vision
Aug 24

When does fusing hand-crafted knowledge with learned representations pay? A cost-normalized benchmark of stacking, substitution, and interference

arXiv:2608.21098v1 Announce Type: new Abstract: Fusing prior knowledge with data-driven learning is attractive where data is scarce, yet no controlled account says when it helps, is redundant, or har...

By Ahmad AlMughrabi, Albert Clop, Benjamin Busam, Ricardo Marques, Petia Radeva
arXiv Machine Learning
Sep 23

Matryoshka attribution: Learning to attribute language model outputs to representations and weights

Matryoshka Attribution (MAttr) is a mask‑learning method that identifies nested subsets of a language model’s internal components by minimizing downstream loss. It uses a differentiable sigmoid top‑k operator and randomizes sparsity during training to produce an attribution ordering of components. MAttr tops the Mechanistic Interpretability Benchmark leaderboard and can be applied via reinforcement learning to pinpoint weight changes that control behaviors such as refusal in Llama 3.1 8B Instruct, where restoring just 1% of weights removes refusals while preserving capabilities.

By Aryaman Arora, Kirill Acharya, Nathan Hu, Yanzhe Zhang, Noah Goodman, Dan Jurafsky, Christopher Potts