arXiv:2608. 19215v1 Announce Type: new Abstract: Given deep uncertainty about the possibility of artificial consciousness, it is unclear how we should treat potentially sentient AI.
arXiv:2608. 15304v1 Announce Type: new Abstract: Frontier agentic systems powered by large language models (LLMs) exhibit human-like patterns of cognition.
arXiv:2606. 13441v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) have prompted claims that such systems exhibit agency or qualify as moral agents.
arXiv:2601. 21016v2 Announce Type: replace Abstract: Imagine an Artificial Intelligence (AI) that perfectly mimics human emotion and begs for its continued existence.
arXiv:2606. 13739v1 Announce Type: cross Abstract: This paper examines trade-offs between AI safety and well-being relative to (i) one of the most promising methods for finetuning super-capable AIs, 'Constitutional AI', and (ii) one of the most influential approaches to understanding complex ethical decision making and the conditions for the well-being of rational agents, 'Virtue Ethics'.
arXiv:2606. 23991v1 Announce Type: new Abstract: What is an agent?
arXiv:2605. 28210v2 Announce Type: replace Abstract: Drawing on Ullmann-Margalit's concept of opting (transformative, irrevocable, and shadowed by foreclosed alternatives), we show that current AI systems raise a profound ethical problem that existing AI ethics has not fully captured: the illusion of opting, in which persons and groups encounter the deceptive appearance of meaningful consequential choice while the agency needed to become genuinely capable of choosing is weakened.
arXiv:2606. 20231v1 Announce Type: new Abstract: Can intelligence be measured?
arXiv:2608. 20041v1 Announce Type: new Abstract: Research on the agency of advanced artificial intelligence (AI) systems focuses on agency as a normative concept and on the agency of particularly agentic AI systems.
arXiv:2606. 12442v1 Announce Type: cross Abstract: At present, loss of control risks have gained much prominence in public discussion, particularly in relation to AI, with extensive discourse present among academics, frontier labs, and even governments.
arXiv:2604. 14990v2 Announce Type: replace Abstract: The prospect of Artificial General Intelligence (AGI) is increasingly driving institutional decisions, and alignment of AGI is a hard problem.
The paper examines how the rise of AI capable of moral reasoning could reshape meta-ethics, traditionally focused on human ethics. It proposes a framework that identifies new questions about AI’s own ethics from both human and AI perspectives, dividing them into four domains. The author explores how existing meta-ethical theories might apply to these domains and argues that many human-centered formulations will need significant revision to accommodate AI.