arXiv AI
Jun 9
The AI Epistemic Deference Index: A Continuous Measure of Sycophancy
arXiv:2606. 07897v1 Announce Type: new Abstract: Current AI models frequently exhibit epistemic sycophancy, endorsing claims to agree with a user.
Measuring and Detecting Harmful AI Sycophancy
arXiv:2608. 05624v1 Announce Type: new Abstract: Sycophantic responses are becoming pervasive in large language models (LLMs), and prior work has pointed out that some of them could be harmful.
Related stories
arXiv Machine Learning
Jun 11
Mechanisms of Introspective Awareness
arXiv:2603. 21396v5 Announce Type: replace Abstract: Recent work has shown that LLMs can sometimes detect when steering vectors are injected into their residual stream and identify the injected concept -- a phenomenon termed "introspective awareness.
arXiv AI
Jul 7
Unsupervised Features Mining via Activation Geometry
arXiv:2607. 04222v1 Announce Type: new Abstract: Interpretability methods aim to reveal the features represented inside large language models (LLMs).
arXiv AI
Aug 5
Your Agentic LLMs Secretly Encode Latent Signals of Indirect Prompt-Injection Exposure
arXiv:2608. 02657v1 Announce Type: cross Abstract: Agentic LLMs are vulnerable to indirect prompt injection (IPI) attacks, e.
arXiv AI
Jun 12
Prefill Awareness in Large Language Models
arXiv:2606. 12747v1 Announce Type: new Abstract: Safety-relevant studies of language models, including alignment and jailbreaking evaluations and AI control protocols, often rely on prefilling model outputs.
arXiv Machine Learning
Jun 24
Bridging Mechanistic Interpretability and Prompt Engineering with Gradient Ascent for Interpretable Persona Control
arXiv:2601. 02896v3 Announce Type: replace Abstract: Controlling emergent behavioral personas (e.
arXiv Machine Learning
Aug 5
Inverted Detection and Control in Steering Vectors
arXiv:2608. 02957v1 Announce Type: new Abstract: Steering vectors (SVs) are widely used to influence the expression of concepts (e.
arXiv Machine Learning
Jun 2
Unlearning Isn't Invisible: Detecting Unlearning Traces in LLMs from Model Outputs
arXiv:2506. 14003v5 Announce Type: replace Abstract: Machine unlearning (MU) for large language models (LLMs), commonly referred to as LLM unlearning, seeks to remove specific undesirable data or knowledge from a trained model, while maintaining its performance on standard tasks.
arXiv AI
Jul 7
The Rise of Verbal Tics in Large Language Models: A Systematic Analysis Across Frontier Models
arXiv:2604. 19139v3 Announce Type: replace-cross Abstract: As Large Language Models (LLMs) continue to evolve through alignment techniques such as Reinforcement Learning from Human Feedback (RLHF) and Constitutional AI, a growing and increasingly conspicuous phenomenon has emerged: the proliferation of verbal tics--repetitive, formulaic linguistic patterns that pervade model outputs.
arXiv Machine Learning
Jun 10
Predicting Future Behaviors in Reasoning Models Enables Better Steering
arXiv:2606. 11172v1 Announce Type: new Abstract: Deployed large reasoning models (LRMs) often behave unexpectedly.
arXiv Machine Learning
Jul 30
ToxScreen: Detecting Whether an LLM Has Been Poisoned
arXiv:2607. 26849v1 Announce Type: cross Abstract: As large language models (LLMs) are deployed in high-stakes domains, adversaries may poison training data to implant backdoors: hidden triggers that covertly manipulate model behavior at inference time.
arXiv AI
1d ago
Would this change your answer? Evaluating Explanations of LLM Behavior In The Wild with Counterfactual Experiments
arXiv:2608. 16747v1 Announce Type: cross Abstract: Many areas of AI research, such as language model interpretability and chain of thought faithfulness, seek to explain model behaviors.