arXiv AI
Jul 9
Measuring the metacognition of AI
arXiv:2603. 29693v3 Announce Type: replace Abstract: A robust decision-making process must take into account uncertainty, especially when the choice involves inherent risks.
Confidence-Building Measures for Artificial Intelligence: Workshop proceedings
Related stories
arXiv AI
6d ago
On Benchmarking Human-Like Intelligence in Machines
arXiv:2502. 20502v2 Announce Type: replace Abstract: Recent advances in Artificial Intelligence (AI) have yielded powerful computational models that, by learning from vast amounts of human-generated data, are increasingly posited as approximate models of human cognition.
arXiv AI
Jun 6
A Framework for Measuring Appropriate Reliance on Set-Valued AI Advice
arXiv:2606. 06081v1 Announce Type: new Abstract: Appropriate reliance on AI advice has become a central research theme in human-AI collaboration.
arXiv Machine Learning
Jul 9
Robust Human-AI Complementarity under Uncertainty
arXiv:2607. 06656v1 Announce Type: new Abstract: Machine learning models are often intended to augment rather than replace human decision makers, by providing information that is complementary to human judgement.
OpenAI Blog
Jun 21, 2016
Concrete AI safety problems
We (along with researchers from Berkeley and Stanford) are co-authors on today’s paper led by Google Brain researchers, Concrete Problems in AI Safety. The paper explores many research problems around ensuring that modern machine learning systems operate as intended.
arXiv AI
Jun 3
Towards a Science of AI Agent Reliability
arXiv:2602. 16666v3 Announce Type: replace Abstract: AI agents are increasingly deployed to execute important tasks.
arXiv AI
Jul 10
Psychological Competence as a Missing Dimension in AI Evaluation
arXiv:2607. 08285v1 Announce Type: new Abstract: Current AI evaluation frameworks focus primarily on technical performance, including accuracy, robustness, reasoning ability, and policy compliance.
OpenAI Blog
Nov 6, 2025
AI progress and recommendations
AI is advancing fast. We have the chance to shape its progress—toward discovery, safety, and a better future for everyone.
OpenAI Blog
Oct 26, 2023
Frontier risk and preparedness
To support the safety of highly-capable AI systems, we are developing our approach to catastrophic risk preparedness, including building a Preparedness team and launching a challenge.
arXiv AI
Jul 1
Wisdom Of The (AI) Crowd: Investigating Artificial Swarm Intelligence In Large Language Models
arXiv:2606. 31404v1 Announce Type: new Abstract: Human swarm intelligence demonstrates remarkable collective accuracy but faces scalability constraints in cost, coordination, and time.
Hugging Face Trending Papers
Aug 10
Consilience for Verifier-Free Test-Time Scaling
Test-time scaling often uses an external verifier, such as compilers and test cases in coding or trained value functions in robotics applications, to obtain high-quality rollouts. Verifier-free test-time scaling (or VF-TTS) is gaining extensive attention as a mechanism to enhance Large Language Model (LLM) reasoning, primarily because we do not have access to such high-quality verifiers in many real-world applications.
arXiv AI
Jul 23
Rethinking Uncertainty Evaluation in Large Language Models
arXiv:2607. 19367v1 Announce Type: new Abstract: Calibration is the primary criterion for evaluating LLM confidence, but it is insufficient: it admits trivially incoherent estimators, depends on the evaluation distribution, and does not test the extent to which the estimation can be interpreted as a consistent, underlying probability function.