arXiv AI

LiveOption: Evaluating LLM Agents in Structured Option Trading with Nonlinear Payoffs

LiveOption is an evaluation framework designed to assess large language model (LLM) agents in option trading, a domain characterized by nonlinear payoffs and multi-leg strategy construction. The framework treats option trading as structured sequential decision-making under realistic execution and capital constraints, offering a reproducible environment with standardized interaction protocols. It includes three task suites—portfolio overlays, event-driven earnings trading, and 0DTE intraday trading—and introduces a hierarchical metric suite that evaluates action validity, decision quality, risk characteristics, and outcome-level performance, revealing that current agents often fail to achieve competitive returns.

arXiv AI
Jun 9

Beyond Agent Architecture: Execution Assumptions and Reproducibility in LLM-Based Trading Systems

arXiv:2606. 08285v1 Announce Type: new Abstract: Large language models (LLMs) and agentic systems are increasingly proposed for financial trading, yet their reported performance remains difficult to compare because studies vary in data provenance, temporal split discipline, execution timing, turnover treatment, and transaction-cost modeling.

By Junyi Yao, Zihao Zheng
arXiv Computation and Language
Oct 8

LiveMACE: Process-Aware Evaluation of LLM Agent Capabilities in Evolving Markets

arXiv:2610.09872v1 Announce Type: cross Abstract: Evaluating agents by outcomes alone can obscure the capabilities that produce them. This problem is especially pronounced in evolving environments, w...

By Jun Zhao, Leiming Fu, Yanbo Wen, Yiding Wang, Xuantong Liu, Yang Shu, Yuyang Lu, Xuanran Xing, Jingqi Tong, Hao Xu, Qi Zhang, Xuanjing Huang
arXiv AI
Sep 17

EvolveTrade: Experience-Driven Policy Refinement for Self-Evolving LLM Trading Agents

EvolveTrade is a self‑evolving framework that treats the system prompt of a tool‑using LLM trading agent as a text‑parameterized policy. After each update interval, a Policy Agent revises this policy using accumulated decision traces and portfolio feedback while keeping the backbone LLM fixed, allowing the agent to refine its information‑acquisition and portfolio‑construction procedures over time. Experiments across multiple market regimes and two LLM backbones show that EvolveTrade often improves Sharpe Ratio and Cumulative Return over fixed‑policy baselines, with behavioral analyses indicating increased code‑mediated analysis and regime‑relevant computations.

By Sehee Kim, Yumin Choi, Minki Kang, Sung Ju Hwang
arXiv AI
Sep 15

Are LLMs Good Financial User Simulators? A Preliminary Study

Large language models (LLMs) are being tested as simulators of individual financial decision-making. In a controlled paper‑trading experiment with 120 volunteers, the study evaluated whether an LLM could predict a participant’s next‑day trading action, chosen security, and transaction size using only pre‑cutoff information. Results showed that including market context improved predictions of actions and tickers, but sizing remained challenging, and the models tended to over‑predict hold actions, under‑predict sells, and simplify multi‑security trades.

By Jiajie He, Jiangyuan Hong, Dongling Ni, Wenjin Liu, Xintong Chen
arXiv AI
Jul 14

Can Agentic Trading Systems Pay for Their Own Intelligence?

arXiv:2607. 10286v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly used in trading systems, where model reasoning, tool use, and continual decisions incur costs that are expected to produce trading value.

By Qiqi Duan, Changlun Li, Chen Wang, Fan Zhang, Mengxiang Wang, Dayi Miao, Peixian Ma, Jiangpeng Yan, Liyuan Chen, Shuoling Liu, Preslav Nakov, Yuyu Luo, Nan Tang
arXiv AI
Sep 25

Agent Memory with Episodic Retrieval for Financial Decision-Making

META (Memory Enhanced Trading Agent) is a new agent-based trading framework that augments large language models with episodic memory. It combines specialized indicator agents—such as Trend, MACD, Stochastic, RSI, SMA, AVWAP, and Heikin‑Ashi—with a Decision Agent that fuses their reports, while a Memory module retrieves and updates past trading episodes encoded as market state embeddings with outcomes and reflections. By recalling relevant experiences and adaptively reweighting signals under similar market regimes, META improves directional accuracy and robustness in short‑horizon evaluations, offering regime‑aware, interpretable, and low‑latency decision‑making for financial trading.

By Nuoyue Xu, Jiang Liu, Wenxuan Huang, Xiang Zhang, Juntai Cao, Jiaqi Wei
arXiv AI
Jun 26

OpenFinGym: A Verifiable Multi-Task Gym Environment for Evaluating Quant Agents

arXiv:2606. 26350v1 Announce Type: new Abstract: Although large language model agents are increasingly applied to quantitative-finance workflows, their evaluation remains fragmented across isolated tasks, while the financial relevance of benchmark tasks is often overlooked.

By Kaicheng Zhang, Wen Ge, Lei Jiang, Weixin Yang, Jordan Langham-Lopez, Jialin Yu, Lukasz Szpruch, Hao Ni