arXiv AI By Abhidip Bhattacharyya, Shira Wein

For What Reason? Interpreting Models' Encoding of Causation and Antithesis

Read the original on arXiv AI →

arXiv:2607. 18570v1 Announce Type: cross Abstract: Discourse relations provide document structure, critical to language understanding and enabling language model performance and ethicality.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

arXiv AI
Jun 15

Jacobian Scopes: token-level causal attributions in LLMs

arXiv:2601. 16407v3 Announce Type: replace-cross Abstract: Large language models (LLMs) make next-token predictions based on clues present in their context, such as semantic descriptions and in-context examples.

By Toni J. B. Liu, Baran Zadeo\u{g}lu, Nicolas Boull\'e, Rapha\"el Sarfati, Gurbir Arora, Christopher J. Earls
arXiv Machine Learning
Jun 17

Dissociating Decodability and Causal Use in Bracket-Sequence Transformers

arXiv:2604. 22128v2 Announce Type: replace-cross Abstract: When trained on tasks requiring an understanding of hierarchical structure, transformers have been found to represent this hierarchy in distinct ways: in the geometry of the residual stream, and in stack-like attention patterns maintaining a last-in, first-out ordering.

By Aryan Sharma, Cutter Dawes, Shivam Raval