← Back to all news
arXiv AI

Batch Before You Lift: Scalable Topological Deep Learning on Large Graphs

Batch Before You Lift: Scalable Topological Deep Learning on Large Graphs introduces Cluster‑TNN, a framework that lifts graph data locally instead of constructing a full lifted representation. By partitioning the input graph, sampling node clusters, and reconstructing induced subgraphs at runtime, Cluster‑TNN creates topological mini‑batches that preserve necessary connectivity for higher‑order structures. Across 21 matched comparisons, it reduces peak GPU memory by an average of 83.2% while maintaining competitive predictive performance, enabling the first training of multiple higher‑order Topological Neural Networks on large datasets such as Reddit and OGBN Products.

Related stories

Hugging Face Trending Papers
Oct 8

Batch Before You Lift: Scalable Topological Deep Learning on Large Graphs

Batch Before You Lift: Scalable Topological Deep Learning on Large Graphs introduces Cluster‑TNN, a framework that lifts graph data locally instead of globally, enabling efficient mini‑batch construction for higher‑order domains such as hypergraphs and simplicial complexes. By partitioning the input graph and dynamically sampling node clusters at runtime, Cluster‑TNN reduces peak GPU memory usage by an average of 83.2% across 21 comparisons while preserving connectivity needed for topological structures. This approach allows the first training of multiple higher‑order Topological Neural Networks on large datasets like Reddit and OGBN Products, demonstrating a general strategy for scaling Topological Deep Learning beyond global domain construction.

More like this →
arXiv Machine Learning
Jun 5

HOPSE: Scalable Higher-Order Positional and Structural Encoder for Combinatorial Representations

arXiv:2505. 15405v3 Announce Type: replace Abstract: While Graph Neural Networks (GNNs) have proven highly effective at modeling relational data, pairwise connections cannot fully capture multi-way relationships naturally present in complex real-world systems.

By Guillermo Bern\'ardez, Marco Montagna, Louis Van Langendonck, Martin Carrasco, Amirreza Akbari, Louisa Cornelis, Mathilde Papillon, Pere Barlet-Ros, Nina Miolane, Lev Telyatnikov
benchmarks
More like this →
arXiv Machine Learning
Oct 3

Higher-Order Positional Encodings for Graph Representation Learning

The paper introduces higher-order positional encodings that enrich graph representations by incorporating topological information from lifted incidence structures, without altering existing graph learning backbones. It theoretically shows that these encodings can mix graph Laplacian frequencies beyond what scalar spectral filters achieve, and demonstrates their effectiveness on Graph Transformers for datasets like ZINC and synthetic benchmarks. The approach bridges graph positional encodings and topological deep learning, enabling standard models to exploit higher-order interactions.

By Caleb Stam, Aagrim Hoysal, Sanjukta Krishnagopal
llmsbenchmarks
More like this →