arXiv Machine Learning

IsoAct: Geometry-Aware Post-hoc Debiasing via Isometric Actions

IsoAct is a post‑hoc debiasing framework that respects the geometry of non‑Euclidean representations. It identifies nuisance‑predictive directions via Fisher discriminant analysis in tangent coordinates and corrects them using manifold‑native actions that keep the representation on its manifold. Experiments on hyperspherical, hyperbolic, and SE(3) spaces show that IsoAct reduces nuisance recoverability while preserving utility and manifold validity, notably improving kinase‑group recoverability and structural prediction on the KLIFS dataset.

arXiv Machine Learning
Sep 7

Nested Inductive Bias Framework for SPD Manifold Learning

The paper introduces a Nested Inductive Bias framework that uses a two‑stage diffeomorphic composition to pull back non‑Euclidean target geometries onto symmetric positive definite (SPD) manifolds. This approach allows the construction of curvature‑aligned Riemannian classifiers that respect both matrix constraints and the intrinsic relational geometry of data. Empirical results on kinematic, signal processing, and synthetic benchmarks show that class separability degrades when metric curvature does not match the data distribution, and the authors also propose the Rational Conformal Metric (RCM) for robust vectorized architectures.

By Tushar Das
arXiv Machine Learning
Sep 23

Discovering Data Manifold Geometry through Geometric Properties

arXiv:2602.02611v2 Announce Type: replace Abstract: A prevailing paradigm in modern representation learning is the map-first approach, in which a representation map is learned from reconstruction, em...

By David Vigouroux (ANITI, IMT Atlantique - DSD, LaTIM), Lucas Drumetz (IMT Atlantique - MEE, Lab-STICC\_OSE, ODYSSEY), Ronan Fablet (IMT Atlantique - MEE, Lab-STICC\_OSE, ODYSSEY), Fran\c{c}ois Rousseau (IMT Atlantique - DSD, LaTIM)
arXiv AI
Jun 30

Representation Learning for Equivariant Inference with Guarantees

arXiv:2505. 19809v3 Announce Type: replace-cross Abstract: In many real-world applications of regression, conditional probability estimation, and uncertainty quantification, exploiting symmetries rooted in physics or geometry can dramatically improve generalization and sample efficiency.

By Daniel Ordo\~nez-Apraez, Vladimir Kosti\'c, Alek Fr\"ohlich, Vivien Brandt, Karim Lounici, Massimiliano Pontil
arXiv Machine Learning
Oct 21

LocaLeJEPA: Maximum Entropy Representations under Geometric Priors

LocaLeJEPA extends Joint-Embedding Predictive Architectures (JEPA) by introducing a manifold-theoretic reformulation that aligns representation learning with non‑Euclidean geometric priors. It incorporates a locally Euclidean distribution‑matching regularizer, LocaLeReg, to stabilize training and scale to large models. Experiments on ImageNet‑1K show that LocaLeJEPA outperforms the original LeJEPA across both hyperbolic and Euclidean backbones, improving linear and k‑NN classification as well as downstream tasks.

By Kartik Tandon, Alessio Borgi, Pavel Snopov, In\'es Garc\'ia-Redondo, Davide D'Ascenzo, Sebastiano Cultrera di Montesano, Fabrizio Silvestri, Pietro Li\`o, Francesca Dominici, Randall Balestriero, Claudio Battiloro
arXiv Machine Learning
Jul 13

Group Invariant Spectral Embedding

arXiv:2607. 08987v1 Announce Type: new Abstract: Spectral embedding methods are widely used for dimensionality reduction and clustering of high-dimensional datasets with intrinsic low-dimensional structures.

By Yeari Vigder, Paulina Hoyos, David Thong, Joakim and\'en, Joe Kileel, Amit Moscovich