arXiv:2602. 11410v2 Announce Type: replace Abstract: Click-through rate (CTR) prediction is fundamental to online advertising systems.
By David Pardoe, Neil Daftary, Miro Furtado, Aditya Aiyer, Yu Wang, Liuqing Li, Tao Song, Lars Hertel, Young Jin Yun, Senthil Radhakrishnan, Zhiwei Wang, Tommy Li, Khai Tran, Ananth Nagarajan, Ali Naqvi, Yue Zhang, Renpeng Fang, Avi Romascanu, Arjun Kulothungun, Deepak Kumar, Praneeth Boda, Fedor Borisyuk, Ruoyan Wang
arXiv:2607. 14161v1 Announce Type: cross Abstract: Pinterest is where people turn inspiration into action as users browse ideas, then take steps toward realization, often by discovering shoppable content.
By Junpeng Hou, XianXing Zhang, Sai Xiao, Derek Cheng, Darren Reger, Olafur Gudmundsson, Mehdi Ben Ayed, Zhiqing Rao, Huizhong Duan
The paper introduces ReST, a recommendation‑native Transformer scaling framework designed to handle noisy, irregular, and sparsely supervised user behavior sequences in production ranking. ReST employs a dual‑gated attention encoder with rotary positional and temporal embeddings, and a lightweight cross decoder that decouples heavy encoding from fast decoding, enabling efficient compute‑once, decode‑many‑times ranking. Experiments on industrial and public benchmarks show that ReST outperforms traditional Transformer blocks, achieving higher accuracy and consistent scaling across sequence length, depth, and width, and a one‑week online A/B test on a production advertising platform yielded a 1.31% AUC lift and an 11.93% increase in a core revenue metric within a 50 ms P99 latency budget.
By Jie Chen, Xiangqian Yu, Yanchao Lian, Tan Lu, Run Yang, Zhengchun Shang, Xing Wang, Cheng Chen, Ke Hu, Qiang Li, Tianjiu Yin, Xiaobing Liu
Discriminative World Models for Web Agents proposes a new training objective called predicted‑state matching, which forces a world model to produce representations that can distinguish the true resulting web state from those produced by alternative actions. The authors train these models on a branching dataset from WebArena Go‑Browse, where each decision point includes multiple actions and their outcomes. Experiments show that models trained with predicted‑state matching outperform those trained with standard supervised next‑state prediction on a held‑out benchmark, improve PRM‑style action ranking on WebPRMBench, and enhance end‑to‑end task success on WebArena‑Lite when used for test‑time action selection.
The study examines two behavioral inference tasks—session-level user identification and next-domain prediction—using large-scale anonymous web browsing traces. Classical and neural models are applied to user identification, while graph-based methods combined with Large Language Models (LLMs) are used for next-domain prediction. Results show that short browsing sessions are highly identifiable and future navigation is highly predictable, with LLM-derived semantic features offering only marginal improvements over structural and sequential models.
By Ralph Elsaghbini, Omran Berjawi, Walid Fahs, Rida Khatoun
arXiv:2606. 26277v1 Announce Type: cross Abstract: Sequential user behavior modeling is widely adopted in industrial recommender systems; however, significant gaps remain in financial services, where pre-login web interactions and authenticated in-app experiences differ drastically.
By Dianjing Fan, Yao Li, Kyaw Hpone Myint, Dwipam Katariya, Alexandre G. R. Day, Pranab Mohanty, Giri Iyengar