arXiv AI

A Sheaf-Theoretic and Topological Perspective on Complex Network Modeling and Attention Mechanisms in Graph Neural Models

arXiv:2601. 21207v4 Announce Type: replace-cross Abstract: Combinatorial and topological structures, such as graphs, simplicial complexes, and cell complexes, form the foundation of geometric and topological deep learning (GDL and TDL) architectures.

arXiv Machine Learning
1d ago

Higher-Order Positional Encodings for Graph Representation Learning

The paper introduces higher-order positional encodings that enrich graph representations by incorporating topological information from lifted incidence structures, without altering existing graph learning backbones. It theoretically shows that these encodings can mix graph Laplacian frequencies beyond what scalar spectral filters achieve, and demonstrates their effectiveness on Graph Transformers for datasets like ZINC and synthetic benchmarks. The approach bridges graph positional encodings and topological deep learning, enabling standard models to exploit higher-order interactions.

By Caleb Stam, Aagrim Hoysal, Sanjukta Krishnagopal
arXiv AI
Sep 7

Global to Local: Topology-Preserving Adaptive Graph Pooling via Granular-Ball

The paper introduces Topology-Preserving Adaptive Graph Pooling (TPAGP), a method that partitions graphs into granular balls by combining node features and topology to create multi-granularity representations. TPAGP captures both global and local structural patterns, unlike prior pooling methods that coarsen graphs by removing or clustering nodes. Experiments show TPAGP outperforms existing pooling techniques on benchmark datasets, reducing information loss from fixed-granularity strategies.

By Sen Zhao, Gaojie Xu, Shuyin Xia, Yifan Guan, Yi Liu, Yi Wang, Wei Wang
Hugging Face Trending Papers
Sep 8

Topology-induced Operators Reveal Complementary Graph Representations without Training

The paper demonstrates that high‑quality graph embeddings can be produced without complex models or training by propagating random features through topological structures derived from random walks and anonymous walks. These training‑free embeddings capture node proximity and structural roles, respectively, and perform competitively on node, edge, and graph tasks while often requiring less computation. Combining the two embedding types further improves inference quality for some tasks.

arXiv Machine Learning
Jun 5

HOPSE: Scalable Higher-Order Positional and Structural Encoder for Combinatorial Representations

arXiv:2505. 15405v3 Announce Type: replace Abstract: While Graph Neural Networks (GNNs) have proven highly effective at modeling relational data, pairwise connections cannot fully capture multi-way relationships naturally present in complex real-world systems.

By Guillermo Bern\'ardez, Marco Montagna, Louis Van Langendonck, Martin Carrasco, Amirreza Akbari, Louisa Cornelis, Mathilde Papillon, Pere Barlet-Ros, Nina Miolane, Lev Telyatnikov