arXiv Machine Learning
Oct 3

Do Your Own Research: Learning to Forecast by Learning to Search

The paper introduces an agentic forecasting environment built on 2,100+ resolved Polymarket questions, where a language model (Qwen3.5-35B-A3B) learns to gather evidence during rollout via web search, page reading, and financial time series, all filtered to avoid post‑cutoff leaks. Training with single‑epoch GRPO and a Brier‑score reward improves calibration by 30‑40% and reduces search attempts, while the trained policy outperforms four frontier models in evidence‑based forecasting, achieving lower soft‑Brier scores at roughly 5% of the inference cost. The authors release the environment, dataset, and per‑rollout records as a reusable harness for temporal forecasting agents.

By Yusuf Afifi, Artur Kiulian, Anton Polishko, Mykola Khandoga, Hamudi Naanaa, Alina Krasnobrizha
arXiv Computation and Language
Sep 30

Can Language Models Learn to Forecast Stock Prices

arXiv:2609.36914v1 Announce Type: new Abstract: Post-training has been shown to significantly improve language models' performance on tasks with verifiable outcomes, including mathematical reasoning,...

By Jiacheng Guo, Suozhi Huang, Shuzhen Li, Yunlong Gao, Zerui Cheng, Jason Ge, Shushu Liang, Zihao Li, Hao Lu, Ming Yin, Shilong Liu, Jiashuo Liu, Xu Kuang, Mengdi Wang
arXiv Computation and Language
Nov 4

RAP: Research Attention Prediction in Language Agents

The paper introduces Research Attention Prediction (RAP), a benchmark designed to evaluate large language model (LLM) agents’ ability to infer changes across entire research fields from limited evidence gathered during online scholarly searches. RAP is built on a local search environment comprising 356,357 dated arXiv papers and includes two evaluation sets: a Core set of 2,160 questions covering 54 AI/ML fields and an Extended set spanning 269 fields. Experiments show that while search improves agents’ recognition of recent changes, their forecasting of future shifts remains limited or even negative, indicating that LLM agents can detect some recent developments but struggle to reliably anticipate future research activity.

By Yingqian Wu, Jingcong Liang, Shengbin Yue, Siyuan Wang, Zhenfei Yin, Junchi Yu, Zhongyu Wei