arXiv Machine Learning August 7, 2026 By Mehrshad Saadatinia, Parsa Razmara, Ardalan Aryashad, Ali Abbasi, Seyedarmin Azizi

CircuitSteer: Geometrically Aligned Multi-Layer Steering via Sparse Autoencoder Circuits

Read the original on arXiv Machine Learning →

arXiv:2608. 05732v1 Announce Type: new Abstract: Controlling the behavior of large language models (LLMs) remains a critical challenge for AI alignment.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 16

Scalable Circuit Learning for Interpreting Large Language Models

arXiv:2606. 16939v1 Announce Type: cross Abstract: A prominent research direction in mechanistic interpretability is learning sparse circuits over LLM components to reveal how they jointly produce model behavior.

By Naiyu Yin, Dennis Wei, Tian Gao, Amit Dhurandhar, Karthikeyan Natesan Ramamurthy, Yue Yu

llms benchmarks safety

arXiv AI

Jun 12

Language Model Circuits Are Sparse in the Neuron Basis

arXiv:2601. 22594v2 Announce Type: replace-cross Abstract: The high-level concepts that a neural network uses to perform computation need not be aligned to individual neurons (Smolensky, 1986).

By Aryaman Arora, Zhengxuan Wu, Jacob Steinhardt, Sarah Schwettmann

llms benchmarks safety

arXiv AI

Jun 26

Discovering Millions of Interpretable Features with Sparse Autoencoders

arXiv:2606. 26620v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) have emerged as a powerful tool for decomposing superposed language model representations into sparse and interpretable features.

By XinYang He, Wei Wang, Bing Zhao, Xuan Ren, WenBo Li, WeiXu Qiao, Hu Wei, Lin Qu

llms efficiency

arXiv Machine Learning

Jul 9

Distributed Sparse Interventions in Language Models

arXiv:2607. 07128v1 Announce Type: new Abstract: Language models perform a wide range of tasks at varying levels of abstraction with the capacity to flexibly infer tasks from context, execute multiple tasks simultaneously, and select among competing tasks.

By Maximilian S. Ernst (Max Planck School of Cognition, Center for Lifespan Psychology Max Planck Institute for Human Development, Machine Learning Group Technische Universit\"at Berlin), Lorenz Linhardt (Machine Learning Group Technische Universit\"at Berlin, Berlin Institute for the Foundations of Learning and Data), Aaron Peikert (Center for Lifespan Psychology Max Planck Institute for Human Development), Oliver Eberle (Machine Learning Group Technische Universit\"at Berlin, Berlin Institute for the Foundations of Learning and Data)

llms

arXiv AI

Jun 16

DifFRACT: Diffusion Feature Reconstruction and Attribution for Circuit Tracing

arXiv:2606. 15796v1 Announce Type: cross Abstract: Mechanistic interpretability seeks to explain neural network behavior by decomposing model computations into interpretable features and circuits.

By Artyom Mazur, Nina Konovalova, Aibek Alanov

llms diffusion efficiency multimodal benchmarks safety

arXiv Machine Learning

Jun 9

Beyond Linear Activation Steering: Invertible Latent Transformations for Controlling LLM Behavior

arXiv:2606. 08454v1 Announce Type: new Abstract: Activation steering provides a lightweight inference-time mechanism for controlling large language models (LLMs) by modifying their internal activation vectors toward desired behaviors.

By Tuc Nguyen, Thai Le

llms diffusion benchmarks safety

Related stories

Scalable Circuit Learning for Interpreting Large Language Models

Language Model Circuits Are Sparse in the Neuron Basis

Discovering Millions of Interpretable Features with Sparse Autoencoders

Distributed Sparse Interventions in Language Models

DifFRACT: Diffusion Feature Reconstruction and Attribution for Circuit Tracing

Beyond Linear Activation Steering: Invertible Latent Transformations for Controlling LLM Behavior