OpenAI Blog
Jul 20
Safety and alignment in an era of long-horizon models
OpenAI shares lessons from deploying long-running AI models, highlighting new safety risks, observed failures, and improved safeguards through iterative deployment.
Safety Must Precede the Deployment of Open-Ended AI
arXiv:2502. 04512v4 Announce Type: replace Abstract: AI advancements have been significantly driven by a combination of foundation models and curiosity-driven learning aimed at increasing capability and adaptability.
Related stories
arXiv AI
Jun 30
Agentic Safety is an Epistemic Property, Not a Behavioral One
arXiv:2606. 28347v1 Announce Type: cross Abstract: Contemporary AI safety spans pre-training interventions, post-training alignment, deployment-time controls, monitoring, and red-teaming.
OpenAI Blog
Oct 26, 2023
Frontier risk and preparedness
To support the safety of highly-capable AI systems, we are developing our approach to catastrophic risk preparedness, including building a Preparedness team and launching a challenge.
OpenAI Blog
May 21, 2024
OpenAI safety practices
Artificial general intelligence has the potential to benefit nearly every aspect of our lives—so it must be developed and deployed responsibly.
arXiv AI
Jul 2
From Silos to Systems: Process-Oriented Hazard Analysis for AI Systems
arXiv:2410. 22526v2 Announce Type: replace Abstract: To effectively address potential harms from Artificial Intelligence (AI) systems, it is essential to identify and mitigate system-level hazards.
Hugging Face Trending Papers
Jun 4
Learning of Robot Safety Policies via Adversarial Synthetic Scenarios
In this work, we propose an agentic gamification framework for hazard-informed learning of robot safety policies through synthetic scenarios. We model scenario generation as an adversarial game between two agents: a Red Team that explores the space of potential failures by constructing hazardous situations, and a Blue Team that incrementally refines safety policies to prevent them.
arXiv AI
Jun 6
Towards Healthy Evolution: Exploring the Role and Mechanisms of Human-Agent Interaction in Self-Evolving Systems
arXiv:2606. 06114v1 Announce Type: new Abstract: Self-evolving agents improve through continual self-play and self-generated learning signals, but autonomous evolution can also cause capability degradation and safety drift.
arXiv AI
Jun 6
Learning of Robot Safety Policies via Adversarial Synthetic Scenarios
arXiv:2606. 05952v1 Announce Type: cross Abstract: In this work, we propose an agentic gamification framework for hazard-informed learning of robot safety policies through synthetic scenarios.
arXiv AI
Jun 12
Intelligence as Managed Autonomy: Failure, Escalation, and Governance for Agentic AI Systems
arXiv:2605. 27628v2 Announce Type: replace Abstract: As autonomous and agentic AI systems scale in robotic and human-machine environments, managing hallucination and persistent but unjustified action remains an open challenge.
OpenAI Blog
1d ago
Pacing model development in an era of cyber-critical capabilities
OpenAI is strengthening monitoring, alignment, and security for frontier AI models. See how new safeguards are guiding the pace of model development.
OpenAI Blog
Apr 5, 2023
Our approach to AI safety
Ensuring that AI systems are built, deployed, and used safely is critical to our mission.
arXiv AI
Jun 10
Understanding and mitigating the risks of OpenClaw for non-technical users: A practical guide with Skill
arXiv:2606. 11007v1 Announce Type: cross Abstract: OpenClaw has rapidly emerged as a transformative artificial intelligence (AI) agent framework, and its ability to autonomously execute complex, multi-step tasks has attracted an ever-growing and diverse user base.