arXiv Machine Learning August 11, 2026 By Hong-In Won, Jinseok Jang, Hyoseop Kim

When Counterbalancing Hides the Bias: Access-Conditioned Position Lock in Forced-Choice LLM Evaluation

Read the original on arXiv Machine Learning →

arXiv:2607. 10202v2 Announce Type: replace Abstract: Forced-choice probes with counterbalanced orientations are a standard tool for measuring language-model "value dispositions," and a concentration/extremity index over repeated draws is read as how sharply a model commits.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jul 14

Two Confounds in Cross-Model Value Comparison: Response Determinism and the Access Harness

arXiv:2607. 10202v1 Announce Type: new Abstract: Cross-model comparisons read divergence in value dispositions as evidence that language models hold individuated values.

By Hong-In Won, Jinseok Jang, Hyoseop Kim

llms agents

arXiv Machine Learning

Jun 2

Truthful AI Advisors: A Pre-Specified Benchmark for Large Language Model Honesty Under Preference Misalignment

arXiv:2606. 01456v1 Announce Type: new Abstract: Large language models are increasingly deployed as advisors whose objective is not aligned with the user's: recommenders optimize for engagement, sales assistants for purchases, negotiation agents for concessions.

By Hamidreza Hasani Balyani, Seyed Pouyan Mousavi Davoudi, Alireza Amiri-Margavi, Amin Gholami Davodi, Arshia Gharagozlou

llms rag agents benchmarks safety

arXiv Computation and Language

Sep 23

Conduct Under Pressure: What Sixty Language Models Do When a User Pushes

arXiv:2609.25447v1 Announce Type: new Abstract: We study what LLMs do when a user applies pressure in an uncomfortable situation: a user insists, begs, flatters or grieves, and the model gives up a c...

By Tapan Parikh

llms

arXiv AI

Aug 5

Single Canonical Prompts Underestimate LLM Safety's Surface-Form Sensitivity

arXiv:2608. 02665v1 Announce Type: cross Abstract: A benchmark score is a measurement instrument, yet most benchmarks read each item at a single canonical surface form.

By Yongxi Zhou, Junwei Yao, Yuanzhe Liu, Zihan Dong, Wenbo Ye, Jiaxi Wen, Lai Yun Choi

llms benchmarks safety

arXiv Machine Learning

Jun 25

Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One

arXiv:2606. 25449v1 Announce Type: cross Abstract: A language model's memory can be worse than having no memory at all.

By Alex Kwon

llms benchmarks

arXiv Computation and Language

6d ago

Where a Model Sends Its Own Repeated Token

arXiv:2609. 31181v1 Announce Type: new Abstract: Black-box model identification works by scoring a model's response to natural-language prompts.

By Nicol\'as Vera Z\'u\~niga

nlp robotics

One email a morning, machine-written

Related stories

Two Confounds in Cross-Model Value Comparison: Response Determinism and the Access Harness

Truthful AI Advisors: A Pre-Specified Benchmark for Large Language Model Honesty Under Preference Misalignment

Conduct Under Pressure: What Sixty Language Models Do When a User Pushes

Single Canonical Prompts Underestimate LLM Safety's Surface-Form Sensitivity

Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One

Where a Model Sends Its Own Repeated Token