arXiv Machine Learning

Phase Marginalization for Patch-Grid Instability in Vision Transformers

arXiv:2606. 08132v1 Announce Type: cross Abstract: Vision Transformers operate on fixed patch grids, which can introduce phase-dependent instability for dense prediction: changing the patch partition can change the token evidence available to a pixel, especially near boundaries.

Hugging Face Trending Papers
3d ago

SPARC: Subspace Position-Aware Robust Few-Shot Calibration for Distribution-Shifted Industrial Anomaly Detection

SPARC is a few‑shot calibration technique for vision‑based industrial anomaly detectors that corrects deployment‑time nuisances by projecting patch features onto a per‑cell subspace, requiring only up to eight verified‑normal images and no gradient updates. It operates between the encoder and detector, using a closed‑form, spatially indexed estimate based on the encoder’s native patch grid. Across seven detectors on shift‑prone benchmarks, SPARC boosts pooled Image AUROC by 13.8 pp and AU‑PRO₀.₃ by 3.5 pp, while showing modest changes on benchmarks without engineered shift.

arXiv AI
Jun 4

Revisiting Model Stitching In the Foundation Model Era

arXiv:2603. 12433v3 Announce Type: replace-cross Abstract: Model stitching, connecting early layers of one model (source) to later layers of another (target) via a light stitch layer, has served as a probe of representational compatibility.

By Zheda Mai, Ke Zhang, Fu-En Wang, Zixiao Ken Wang, Albert Y. C. Chen, Lu Xia, Min Sun, Wei-Lun Chao, Cheng-Hao Kuo