arXiv AI

LLM-Generated Counterfactual Stress Scenarios for Portfolio Risk Simulation via Hybrid Prompt-RAG Pipeline

The paper presents a transparent, auditable LLM pipeline for macro‑financial stress testing that uses structured prompting and optional retrieval of country fundamentals and news to generate G7 macroeconomic scenarios. These scenarios are mapped to portfolio losses via a three‑channel PCA factor model, with the macro‑to‑factor mapping explicitly stipulated rather than estimated. Experiments across thousands of scenarios show that severity is driven by prompt design, numerical and narrative severity are weakly linked, and different LLMs exhibit varying degrees of consistency with their own stated changes.

arXiv AI
Oct 5

Time Series Forecasting Benchmarks Need Scenario-Grounded Stress Testing

The paper argues that current time‑series forecasting benchmarks are too narrow, rewarding low held‑out error while failing to capture real‑world failure modes such as structured input anomalies, regime shifts, and sensor faults. It proposes scenario‑grounded stress testing, where each test includes historical data, future targets, a semantic scenario, a failure operator, and a difficulty level, to make evaluation interpretable and deployment‑relevant.

By Yuyang Zhao, Lian Xu, Hao Xue
arXiv AI
Aug 11

Reproducing and Stress-Testing Two Approaches to LLM Reasoning Reliability: Test-Time Probability Aggregation and Logic-Representation Editing

arXiv:2608. 08514v1 Announce Type: new Abstract: We independently reproduce two recent methods for making large language model (LLM) reasoning more reliable, and stress-test them across domains and models (RPC across four new task domains with Qwen3-8B, LCF across four 7-8B models).

By Minhan Cho, Jimin Kweon
arXiv Machine Learning
Jun 9

Forward-Looking Stress Testing Under Macro Scenarios: Stable SVaR Estimation Using a Hybrid GPR-HS Framework with SACS

arXiv:2606. 07575v1 Announce Type: cross Abstract: Regulatory stress testing frameworks, including the Comprehensive Capital Analysis and Review (CCAR) and the Internal Capital Adequacy Assessment Process (ICAAP), require robust Stressed Value-at-Risk (SVaR) estimation under forward-looking macroeconomic scenarios.

By Ujjwala Vadrevu