arXiv Machine Learning

SAOT: Self-Supervised Continual Graph Learning with Structure-Aware Optimal Transport

arXiv:2607. 00377v1 Announce Type: new Abstract: Self-supervised Continual Graph Learning (CGL) aims to successively learn from a graph sequence with different tasks without label supervision - a paradigm that has attracted widespread attention.

arXiv AI

Jul 14

UNIT: Unleash Large Language Models Potential for Graph Continual Learning

arXiv:2607. 10159v1 Announce Type: new Abstract: In real-world multimodal web scenarios, graph-structured data often arrives in a streaming manner, making graph continual learning a crucial paradigm for continuously modeling such evolving structures.

By Tairan Huang, Yili Wang, Beibei Hu, Yiting Shi, Qiutong Li, Changlong He, Jianliang Gao

llms fine-tuning multimodal benchmarks

arXiv Machine Learning

Jun 2

G2LoRA: Gradient Orthogonal Low-Rank Adaptation Framework for Graph Continual Learning on Text-Attributed Graphs

arXiv:2606. 01873v1 Announce Type: new Abstract: LLM-as-Aligner has emerged as a prevalent pre-training paradigm for Text-Attributed Graphs(TAGS), aligning graph and text modalities into a shared embedding space via CLIP-style contrastive learning.

By Yuhan Wang, Yibo Ding, Yutong Ye, Mufan Zhao, Wenbo Zhang, Ruijie Wang, Jianxin Li

llms rag fine-tuning multimodal benchmarks safety

arXiv Machine Learning

Jul 14

CA-DGCL: Dynamic Graph Continual Learning via Condensation and Attachment

arXiv:2607. 11112v1 Announce Type: new Abstract: Dynamic graph continual learning (DGCL) is an effective manner for handling catastrophic forgetting in dynamic graphs.

By Tingxu Yan Ye Yuan

arXiv Machine Learning

Jul 7

Graph Classification via Network Usable Information: From Representation Evaluation to Structure Selection

arXiv:2607. 03587v1 Announce Type: new Abstract: We propose NetinfoGC, a framework for graph classification that extends the Network Usable Information (NUI) paradigm to graph-level learning.

By Abdullah Shaik, Anwar Said

rag benchmarks

arXiv AI

Jul 21

DIB-OD: Preserving the Invariant Core for Robust Heterogeneous Graph Adaptation via Decoupled Information Bottleneck and Online Distillation

arXiv:2604. 10882v2 Announce Type: replace-cross Abstract: Graph Neural Network pretraining is pivotal for leveraging unlabeled graph data.

By Yang Yan, Yunxuan Li, Qiuyan Wang, Tianjin Huang, Qiudong Yu

fine-tuning efficiency benchmarks

arXiv AI

Jul 14

Graph Optimization Foundation Model: Tokenizing Graph via A Language-Model Paradigm

arXiv:2509. 24256v2 Announce Type: replace-cross Abstract: The pretrain-transfer paradigm, which underpins the success of large language models (LLMs), has demonstrated the immense power of creating foundation models that learn generalizable representations from vast datasets.

By Yunhao Liang, Pujun Zhang, Yuan Qu, Jingyuan Yang, Shaochong Lin, Zuo-jun Max Shen

llms

arXiv Machine Learning

Jul 21

Node4All: Learning Node Representation Beyond Datasets

arXiv:2607. 17272v1 Announce Type: new Abstract: Node representation learning has advanced rapidly, yet most existing methods rely on per-dataset training and hyperparameter tuning.

By Dooho Lee, Jaemin Yoo

llms benchmarks

arXiv Machine Learning

Jun 30

DRIFT: A Benchmark for Task-Free Continual Graph Learning with Continuous Distribution Shifts

arXiv:2605. 12998v3 Announce Type: replace Abstract: Continual graph learning (CGL) aims to learn from dynamically evolving graphs while mitigating catastrophic forgetting.

By Guiquan Sun, Xikun Zhang, Jingchao Ni, Dongjin Song

benchmarks

arXiv AI

Aug 6

NodeJEPA: Structure-Conditioned Latent Prediction for Node-Level Graph Self-Supervised Learning

arXiv:2608. 04381v1 Announce Type: cross Abstract: Self-supervised learning on graphs is largely shaped by contrastive methods that depend on carefully designed augmentations, and by generative methods that reconstruct node attributes in the input space.

By Tinghe Zhang, Jian Xu, Jiaheng Chen, Jiaxing Li, Yucheng Xiao, Qiang Wang

rag diffusion fine-tuning benchmarks

arXiv AI

6d ago

Representation Finetuning for Continual Learning

arXiv:2603. 11201v3 Announce Type: replace-cross Abstract: The world is inherently dynamic, and continual learning aims to enable models to adapt to ever-evolving data streams.

By Haihua Luo, Xuming Ran, Tommi K\"arkk\"ainen, Huiyan Xue, Zhonghua Chen, Qi Xu, Fengyu Cong

fine-tuning benchmarks

arXiv Machine Learning

Aug 4

HP-JEPA: Hierarchical Partitioning for Multi-Resolution Graph Joint-Embedding Predictive Learning

arXiv:2608. 00491v1 Announce Type: new Abstract: Graph self-supervised learning aims to learn transferable representations from large-scale unlabeled graph data.

By Ruichen Xu, Jingxiang Qu, Wenhan Gao, Jiaxing Zhang, Linsey Pang, Ravid Shwartz-Ziv, Yann LeCun, Yuefan Deng

rag diffusion benchmarks

arXiv AI

Jul 24

Semi-Supervised Text-Attributed Graph Distillation

arXiv:2607. 20477v1 Announce Type: new Abstract: {\em Text-Attributed Graphs} (TAGs) have emerged as an expressive data model for integrating graph topology with rich textual semantics.

By Yurui Lai, Samir Moustafa, Renchi Yang, Tsz Nam Chan

llms efficiency benchmarks

Related stories