arXiv Machine Learning By Mani Shayestehfar

Nonlinear Maps Between Irreducible Representations in Graph Neural Networks

Read the original on arXiv Machine Learning →

The paper introduces a degree‑resolved framework for nonlinear interactions between irreducible representations in graph neural networks, enabling mixing of non‑isomorphic representations that linear equivariant maps cannot achieve. Using this framework, the authors build Specht Triple, a residual module for unordered graph triples, and demonstrate that it reduces aggregate standardised test MSE by 11.05% on a synthetic structural benchmark compared to a parameter‑matched linear baseline. The results highlight irreducible decomposition as a useful inductive bias for nonlinear higher‑order equivariant processing.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Aug 19

HyPE-GT: where Graph Transformers meet Hyperbolic Positional Encodings

HyPE-GT introduces a framework that generates learnable hyperbolic positional encodings for Graph Transformers, enabling the capture of complex hierarchical relationships in graph-structured data. Unlike traditional Euclidean encodings, HyPE’s hyperbolic encodings can be selected to suit specific downstream tasks and help mitigate oversmoothing in deep Graph Neural Networks. Experiments on molecular benchmarks and large-scale Open Graph Benchmark datasets demonstrate improved performance, while additional tests on Coauthor and Copurchase networks confirm HyPE’s effectiveness in controlling oversmoothing.

By Kushal Bose, Swagatam Das