arXiv Machine Learning By Maksim Utushkin, Andrei Ovsiannikov, Alexander D'yakonov

Scaling Graph Neural Networks for Friend Recommendation: Multi-Hash User Embeddings and Temporal Neighbor Sampling

Read the original on arXiv Machine Learning →

The paper presents a scalable graph neural network (GNN) system for friend recommendation on a massive social graph. It introduces two key design choices: multi-hash ID embeddings that shrink the embedding table by over 98% without hurting ranking quality, and a timestamp-sorted compressed sparse row (CSR) storage with binary search that reduces temporal neighbor sampling from linear to logarithmic time. Experiments on a 194‑million‑user, 28‑billion‑edge graph show that these techniques enable production‑grade performance, boosting friend additions by 16% and unique friend adders by 11.5% in an online A/B test.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Jun 18

RankGraph-2: Lifecycle Co-Design for Billion-Node Graph Learning in Recommendation

arXiv:2606. 18379v1 Announce Type: cross Abstract: Graph-based retrieval at billion-node scale requires jointly solving three tightly coupled problems -- graph construction, representation learning, and real-time serving -- yet existing work addresses each in isolation.

By Renzhi Wu, Zikun Cui, Junjie Yang, Tai Guo, Hong Li, Xian Chen, Li Yu, Ke Pan, Sri Reddy, Mahesh Srinivasan, Nipun Mathur, Haomin Yu, Hong Yan
arXiv Machine Learning
Oct 7

Multi-Probe Zero Collision Hash (MPZCH): Mitigating Embedding Collisions and Enhancing Model Freshness in Large-Scale Recommenders

The paper introduces Multi-Probe Zero Collision Hash (MPZCH), an indexing mechanism that uses linear probing to reduce or eliminate collisions in embedding tables for large-scale recommendation systems. MPZCH employs auxiliary tensors and CUDA kernels to support configurable probing and active eviction, thereby retiring obsolete IDs and resetting reassigned slots to prevent stale embeddings. Experiments show that MPZCH achieves zero collisions for user embeddings, improves item embedding freshness and quality, and maintains training and inference performance comparable to existing methods.

By Ziliang Zhao, Bi Xue, Emma Lin, Tianqi Lu, Mengjiao Zhou, Kaustubh Vartak, Shakhzod Ali-Zade, Tao Li, Bin Kuang, Rui Jian, Bin Wen, Dennis van der Staay, Yixin Bao, Xiujin Li, Chao Deng, Henry Wei, Songbin Liu, Qifan Wang, Kai Ren
arXiv Machine Learning
Jul 31

Fully Inductive Cardinality Estimation

arXiv:2607. 28311v1 Announce Type: cross Abstract: Query optimization of Basic Graph Patterns (BGP) SPARQL queries over Knowledge Graphs (KG) requires accurate cardinality estimation.

By Tim Schwabe, Lukas Ketzer, Maribel Acosta