arXiv Machine Learning
6d ago

HERO: Preserving Structure and Semantics in Heterogeneous Continual Graph Learning

HERO is a heterogeneous continual graph learning framework that preserves historical knowledge at both structural and semantic levels while adapting to new tasks. It uses DiSCo to select representative target nodes and reconstruct compact heterogeneous contexts, and applies multi-level knowledge distillation to align task-conditioned predictions with semantic responses. Experiments on four datasets with three HGNN backbones show HERO achieves best or tied-best average performance while maintaining competitive forgetting.

By Guiquan Sun, Xikun Zhang, Jingchao Ni, Dongjin Song
arXiv AI
6d ago

Router Drift Control: Mitigating Off-Policy Degradation in Mixture-of-Experts Reinforcement Learning

The paper introduces Router Drift Control (RDC), a method for mitigating off‑policy degradation in Mixture‑of‑Experts reinforcement learning. RDC uses the disagreement between rollout and training routers to detect stale routing decisions and selectively rejects high‑drift responses, thereby avoiding the gradient bias introduced by Rollout Routing Replay (R3). Experiments show that RDC improves validation accuracy, especially in asynchronous training settings, outperforming both R3 and Truncated Importance Sampling (TIS).

By Liangyao Jin, Zhixin Wang, Liming Liu, Mingjun Zhang, Zhengzhou Zhu, Fangcheng Fu, Jinlong Hou, Yuan Cheng, Xiaohe Hu, Ping Zhang, Siyuan Feng
arXiv Machine Learning
Oct 8

HCPN-GCN: Scaling Hierarchical Prototype Networks with Cone Geometry for Continual Graph Learning

HCPN-GCN is a graph-aware extension of Hierarchical Prototype Networks that replaces linear feature extractors with Graph Convolutional Networks and introduces cone-based prototypes with a diversity regularization objective. This design yields richer graph-aware representations, reduces prototype proliferation, and maintains near-zero forgetting. Experiments on six continual graph learning benchmarks show consistent accuracy improvements over the original HPN and other baselines while using roughly 30× fewer atomic prototypes.

By Sammuel R. Silva, Vander L. S. Freitas, Gladston Moreira, Eduardo J. S. Luz, Rodrigo Silva