← Back to all news
arXiv AI By Andrea Santomauro, Luigi Portinale, Giorgio Leonardi

Robustness of Similarity-based Positional Encoding Under Rotations: Theoretical Analysis and Experimental Validation

Read the original on arXiv AI →

arXiv:2606. 17961v1 Announce Type: cross Abstract: Positional encoding is a fundamental component of Transformer architectures, as it injects information about the spatial or sequential arrangement of inputs.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Machine Learning
Jul 8

Geometric Stability: The Missing Axis of Representations

arXiv:2601. 09173v5 Announce Type: replace Abstract: Representational similarity analysis and related methods compare the internal geometries of neural networks, but they measure only alignment between spaces, leaving a blind spot -- whether a representation's structure is reliably recoverable, not merely similar.

By Prashant C. Raju
safety
More like this →
arXiv AI
Sep 15

Predicting build orientation for SLM dental parts: a comparison of rotation representations and direct vector regression

The study investigates how to automatically predict the build orientation for selective laser melting (SLM) of dental parts using supervised machine learning. Researchers trained two different neural network backbones—ResNet‑50 on multi‑view images and PointNeXt‑S on point clouds—on about 2,400 patient‑specific parts, evaluating 13 different ways to represent the up‑axis (six classical SO(3) parameterizations and seven unit‑sphere representations). They found that applying test‑time augmentation (TTA) over 21 known rotations consistently reduced angular error, with the octahedral map achieving the lowest mean error (10.6°) on ResNet‑50, while direct S² representations performed best overall but may be influenced by label noise.

By Felix Schmalzel, Reimar Waitz, Moritz Kronberger, Thorsten Sch\"oler
fine-tuning
More like this →