arXiv Machine Learning By Anqi Peter Li

Activation-Space Order-Swap Geometry: A Site-Asymmetry Audit

Read the original on arXiv Machine Learning →

The paper introduces a site-asymmetry audit for activation-space interventions, decomposing order-dependent activation statistics into a canonical additive response from single interventions and an antisymmetrized second difference that removes first-order and self-curvature effects. Across six language-model families, the single-intervention baseline accounts for most of the bracket norm, while the corrected residual often clears a generic-interaction null. The method also transfers to non-language models, demonstrating its portability.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
6d ago

FLIP: Final Layer Inference-Time Probing for Vision-Language Models

FLIP is a final‑layer inference‑time probe designed to test whether a logit‑facing intervention site in an open‑weight vision‑language model (VLM) supports structured, task‑linked computation rather than generic perturbation. The probe applies elementwise flooring to the final normalized hidden state before logit computation, leaving other model components unchanged. By sweeping intervention strength on a controlled detection/counting task, FLIP identifies three regimes—negligible change, a bounded interior regime with improved detection recall and reduced counting error, and over‑suppression—while a four‑criterion protocol ensures the observed effects are mechanistically interpretable.

By Drandreb Earl O. Juanico, Rowel O. Atienza
arXiv Machine Learning
Jun 2

Measuring the Symmetry--Data Exchange Rate

arXiv:2606. 01090v1 Announce Type: cross Abstract: Equivariance theory predicts that an architectural symmetry prior reduces sample complexity by a factor of |G|; this is widely cited but rarely measured as a scaling law with controls that separate the prior from its confounds.

By Ahmed M. Adly