arXiv AI By Masoud Soleimani

LLM-Generated Counterfactual Stress Scenarios for Portfolio Risk Simulation via Hybrid Prompt-RAG Pipeline

Read the original on arXiv AI →

The paper presents a transparent, auditable LLM pipeline for macro‑financial stress testing that uses structured prompting and optional retrieval of country fundamentals and news to generate G7 macroeconomic scenarios. These scenarios are mapped to portfolio losses via a three‑channel PCA factor model, with the macro‑to‑factor mapping explicitly stipulated rather than estimated. Experiments across thousands of scenarios show that severity is driven by prompt design, numerical and narrative severity are weakly linked, and different LLMs exhibit varying degrees of consistency with their own stated changes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 5

Time Series Forecasting Benchmarks Need Scenario-Grounded Stress Testing

The paper argues that current time‑series forecasting benchmarks are too narrow, rewarding low held‑out error while failing to capture real‑world failure modes such as structured input anomalies, regime shifts, and sensor faults. It proposes scenario‑grounded stress testing, where each test includes historical data, future targets, a semantic scenario, a failure operator, and a difficulty level, to make evaluation interpretable and deployment‑relevant.

By Yuyang Zhao, Lian Xu, Hao Xue
arXiv AI
Aug 11

Reproducing and Stress-Testing Two Approaches to LLM Reasoning Reliability: Test-Time Probability Aggregation and Logic-Representation Editing

arXiv:2608. 08514v1 Announce Type: new Abstract: We independently reproduce two recent methods for making large language model (LLM) reasoning more reliable, and stress-test them across domains and models (RPC across four new task domains with Qwen3-8B, LCF across four 7-8B models).

By Minhan Cho, Jimin Kweon