The Analyst in the Prompt: Role, Retrieval, and Memory Biases in LLM Financial Analysis

The study examines how user context—such as memory, profiles, and role prompts—affects Large Language Models’ (LLMs) financial analysis. Using 3,575 SEC filings and twelve LLMs, the authors distinguish between evidence selection and interpretation, finding that most context spillover arises from differing interpretations under various roles rather than from retrieving different evidence. They evaluate two mitigation strategies—expressing investor mindset as a user profile instead of an assistant role, and separating evidence-based from personalized outputs—both of which reduce but do not eliminate spillover, with effectiveness varying across models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

• llms