arXiv AI

Quantitative Promise Theory: Intentionality and Inference in Autonomous Agents

arXiv:2606. 08552v1 Announce Type: new Abstract: I discuss some quantitative representations of Promise Theory for processes involving autonomous agents.

arXiv AI
Nov 6

Satisficing as competitive Bayesian weighting: a minimal model of goal-directed choice under an unattained target

The paper introduces Risk‑Sensitive Satisficing (RS), a bandit learning rule that evaluates actions based on their past frequency and their surplus or shortfall relative to an aspiration level. RS can be reformulated as Attention Competitive Bayes (ACB), a Bayesian‑like estimator where the aspiration level serves as a prior mean and the limited number of trials limits how strongly evidence can override this prior. ACB predicts that unchosen actions gradually revert toward the aspiration level (pseudo‑forgetting) and that when the aspiration is unattainable, exploration never fully settles, reducing regret in simulations.

By Moto Shinriki, Yu Kono, Tatsuji Takahashi
arXiv AI
Oct 2

Empty Commitments: When Agents Promise What Their Runtime Cannot Deliver

The paper introduces the concept of empty commitments, where an agent promises an action that its current tools or runtime cannot execute. It defines empty commitments using commitment semantics, identifies three failure types, and proposes an anchoring condition for realistic tool promises. The authors also outline a measurement protocol that tests follow‑up requests across five setups, each adding a different persistence affordance, with the environment either implicit or explicitly stated.

By Jiaqi Tang, Lan Wei, Bingyu Shen, Boyang Li
Hugging Face Trending Papers
Jun 28

Safety from Honesty in a Disinterested AI Predictor

As AI systems become more capable, training procedures that optimize for downstream outcomes risk introducing implicit agency: goal-directed behavior that designers never specified. We present a formal safety argument for the Scientist AI (SAI) Predictor, trained to approximate the Bayesian posterior conditioned on a dataset of "epistemically contextualized" natural-language statements.

arXiv AI
Jun 30

Safety from Honesty in a Disinterested AI Predictor

arXiv:2606. 29657v1 Announce Type: new Abstract: As AI systems become more capable, training procedures that optimize for downstream outcomes risk introducing implicit agency: goal-directed behavior that designers never specified.

By Yoshua Bengio, Oliver Richardson, Tom\'a\v{s} Gaven\v{c}iak, Michael Cohen, Rory Svarc, Damiano Fornasiere, Gael Gendron, David Hyland, Aton Kamanda, Adam Oberman, Francis Rhys Ward, Anna Gaven\v{c}iak, Jacob Livingston Slosser, Vincent Mai, Iulian Serban, Joumana Ghosn