arXiv Machine Learning

Scaling Graph Neural Networks for Friend Recommendation: Multi-Hash User Embeddings and Temporal Neighbor Sampling

The paper presents a scalable graph neural network (GNN) system for friend recommendation on a massive social graph. It introduces two key design choices: multi-hash ID embeddings that shrink the embedding table by over 98% without hurting ranking quality, and a timestamp-sorted compressed sparse row (CSR) storage with binary search that reduces temporal neighbor sampling from linear to logarithmic time. Experiments on a 194‑million‑user, 28‑billion‑edge graph show that these techniques enable production‑grade performance, boosting friend additions by 16% and unique friend adders by 11.5% in an online A/B test.

arXiv AI
Jun 18

RankGraph-2: Lifecycle Co-Design for Billion-Node Graph Learning in Recommendation

arXiv:2606. 18379v1 Announce Type: cross Abstract: Graph-based retrieval at billion-node scale requires jointly solving three tightly coupled problems -- graph construction, representation learning, and real-time serving -- yet existing work addresses each in isolation.

By Renzhi Wu, Zikun Cui, Junjie Yang, Tai Guo, Hong Li, Xian Chen, Li Yu, Ke Pan, Sri Reddy, Mahesh Srinivasan, Nipun Mathur, Haomin Yu, Hong Yan
arXiv Machine Learning
Oct 7

Multi-Probe Zero Collision Hash (MPZCH): Mitigating Embedding Collisions and Enhancing Model Freshness in Large-Scale Recommenders

The paper introduces Multi-Probe Zero Collision Hash (MPZCH), an indexing mechanism that uses linear probing to reduce or eliminate collisions in embedding tables for large-scale recommendation systems. MPZCH employs auxiliary tensors and CUDA kernels to support configurable probing and active eviction, thereby retiring obsolete IDs and resetting reassigned slots to prevent stale embeddings. Experiments show that MPZCH achieves zero collisions for user embeddings, improves item embedding freshness and quality, and maintains training and inference performance comparable to existing methods.

By Ziliang Zhao, Bi Xue, Emma Lin, Tianqi Lu, Mengjiao Zhou, Kaustubh Vartak, Shakhzod Ali-Zade, Tao Li, Bin Kuang, Rui Jian, Bin Wen, Dennis van der Staay, Yixin Bao, Xiujin Li, Chao Deng, Henry Wei, Songbin Liu, Qifan Wang, Kai Ren
arXiv Machine Learning
Jul 31

Fully Inductive Cardinality Estimation

arXiv:2607. 28311v1 Announce Type: cross Abstract: Query optimization of Basic Graph Patterns (BGP) SPARQL queries over Knowledge Graphs (KG) requires accurate cardinality estimation.

By Tim Schwabe, Lukas Ketzer, Maribel Acosta
arXiv Machine Learning
Jun 5

Bridging the Semantic-Collaborative Gap: An Asymmetric Graph Architecture for Cold-Start Item Recommendation

arXiv:2606. 06225v1 Announce Type: cross Abstract: Collaborative filtering and graph-based recommendation models are highly effective because they leverage observed user interactions, but this dependence creates a fundamental cold-start challenge when newly added content has no interaction history.

By Anh Truong, John Trenkle, Yuanbo Chen, Honghong Zhao, Abdullah Alchihabi, Effy Fang, Michael Tamir
arXiv AI
Jun 9

Projection and Quantisation: A Unifying View of Learning to Hash, from Random Projections to the RAG Era

arXiv:2510. 04127v2 Announce Type: replace-cross Abstract: Approximate nearest neighbour (ANN) search underpins large-scale retrieval, increasingly within the retrieval-augmented generation pipelines that ground large language models, yet the methods that address it have multiplied across communities until they are seldom read as a single field.

By Sean Moran
arXiv Machine Learning
Sep 22

Connected Content Retriever: Dense Graph Edge Features Powering Pre-Ranking at LinkedIn

The paper introduces Connected Content Retriever (CC Retriever), a pre‑ranking system for LinkedIn’s Feed that uses dense graph edge features to score candidate content from a billion‑scale index within a 120 ms latency budget. By leveraging GPU‑based sorted‑search primitives, the system can apply a full deep ranking model with 50× more parameters, achieving a 2.5% lift in content time spent in online experiments. The work details the economic‑graph features and model architecture that enable this scalable, low‑latency scoring pipeline.

By Akhilesh Gupta, Sudarshan Srinivasa Ramanujam, Chirag Bhanuprasad Mehta, Reshma Asharaf Beena, Dhritiman Das, Birjodh Singh Tiwana, Bhargavkumar Kanubhai Patel, Mack Lee, Renyi Tang
arXiv Machine Learning
Aug 11

PreGress: Ranking-Native Pre-training and Prompting for Graph Node Ranking

arXiv:2608. 09016v1 Announce Type: cross Abstract: Node ranking is a fundamental problem in graph information retrieval, measuring the relative importance of nodes and supporting a wide range of applications such as influence analysis, recommendation, and graph-based retrieval augmented generation.

By Lujie Ban, Jiasheng shi, Yingli Zhou, Kaiwen Xue, Daiyin Wang, Xubin Li, Shuanghua Li, Chenhao Ma